DEVOURED
MolmoMotion: Language-guided 3D motion forecasting
Allen Institute for AI introduced MolmoMotion, a language-guided model capable of predicting 3D point trajectories in videos.
What: The research includes the MolmoMotion-1M dataset, which contains 3D point trajectory data from 1.16 million videos to improve motion forecasting accuracy.
Original article
MolmoMotion, a new motion forecasting model, predicts future 3D point trajectories in videos using language instructions and initial object positions, outperforming existing methods. The model and its dataset, MolmoMotion-1M, feature vast datasets of 3D point trajectories from 1.16M videos, with a benchmark for accuracy testing.
Explore all 55 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi