Multimodal model

MolmoMotion 4B H1 F32

4B vision-language model that forecasts 3D point trajectories from a single RGB observation frame, 2D query points, and a natural-language action instruction. Built on Molmo 2, it predicts where surface points on objects will move in 3D camera-frame space (in meters) over 32 future timesteps. Best used when only one observation keyframe is available.

Type
Multimodal
Weights
Open
Downloads
313
Likes
5
Pipeline
image text to text
License
apache-2.0

Model hub

allenai/MolmoMotion-4B-H1-F32

Repo
allenai/MolmoMotion-4B-H1-F32
Library
transformers
Access
Public
Technical tags and languages
transformers safetensors molmo2 image-text-to-text molmo-motion trajectory-forecasting 3d vision-language conversational custom_code
Open on Hugging Face

Papers

1

More from Ai2

11

About Ai2

1

Ai2 is a 501(c)(3) non-profit AI research institute founded in 2014 by the late Paul Allen (Microsoft co-founder), dedicated to conducting high-impact, open AI research and engineering for the common good, including open language models (OLMo), scientific AI tools (Semantic Scholar, Asta), environmental AI platforms, and embodied robotics research.