Text model

OLMo

OLMo is Ai2's fully open language model, released in February 2024 in 1B and 7B sizes. Unlike most open-weight releases it published the entire pipeline: weights, the 3-trillion-token Dolma training corpus, training and inference code, intermediate checkpoints and evaluation suite, all under Apache 2.0, so the model can be reproduced and studied end to end as well as run locally.

Type
Text
Weights
Open

More from Ai2

10

About Ai2

1

Ai2 is a 501(c)(3) non-profit AI research institute founded in 2014 by the late Paul Allen (Microsoft co-founder), dedicated to conducting high-impact, open AI research and engineering for the common good, including open language models (OLMo), scientific AI tools (Semantic Scholar, Asta), environmental AI platforms, and embodied robotics research.