Motif 2.6B
Motif 2.6B is Motif Technologies' ultra lightweight 2.6 billion parameter language model, built to deliver fast responses on low spec servers and personal devices. It uses proprietary Differential Attention and PolyNorm techniques to reduce hallucinations while keeping strong reasoning, coding, and math ability for its size, making it well suited for edge and on device deployment.
- Type
- Text
- Weights
- Open
- Downloads
- 657
- Likes
- 88
- Pipeline
- text generation
- License
- apache-2.0
Model hub
Motif-Technologies/Motif-2.6B
- Repo
- Motif-Technologies/Motif-2.6B
- Access
- Public
Technical tags and languages
Papers
7
More from Motif Technologies
5
-
Llama 3 Motif 102B Instruct
Text
Llama 3 Motif 102B Instruct is a 102-billion-parameter bilingual (Korean/English) large language model built…
-
196 DL
Motif 12.7B
Text
Motif 12.7B is a medium-large language model tuned for balanced reasoning, writing, and coding with long cont…
-
208 DL
Motif 2 12.7B Reasoning
Text
Motif 2 12.7B Reasoning is a 12.7 billion parameter reasoning focused language model from Motif Technologies,…
-
Motif Image 6B Preview
Image
Motif Image 6B Preview is a 6-billion-parameter text-to-image generation model released by Motif Technologies…
About Motif Technologies
1
Motif Technologies is an AI startup that develops open-source large language and vision models, such as Motif-2.6B and Motif-12.7B, aiming to democratize powerful, reliable AI.