K2 Horizon 375B A23B
K2 Horizon 375B A23B is a sparse mixture of experts language model with 375 billion total parameters and 23 billion active per token. It is built for coding and agentic tool use with a native 512K token context window and openly released weights, training code, and training data.
- Type
- Text
- Weights
- Open
- Downloads
- 5.9k
- Likes
- 82
- Pipeline
- text generation
- License
- apache-2.0
Model hub
IFM/K2-Horizon-375B-A23B
- Repo
- IFM/K2-Horizon-375B-A23B
- Library
- transformers
- Access
- Public
Technical tags and languages
More from Institute of Foundation Models
5
-
2k DL
K2 Horizon 0.9B
Text
K2 Horizon 0.9B is a compact dense language model designed for highly constrained environments such as watche…
-
7.7k DL
K2 Horizon 3.7B
Text
K2 Horizon 3.7B is a dense language model aimed at developers and researchers who want to fine tune a small m…
-
3.1k DL
K2 Horizon 32B
Text
K2 Horizon 32B is a dense language model built for local hosting on laptops and on premise servers. It balanc…
-
K2 Horizon 36B A4B
Text
K2 Horizon 36B A4B is a sparse mixture of experts language model with 36 billion total parameters and about 4…
-
11k DL
K2 Horizon 7B
Text
K2 Horizon 7B is a dense language model tuned for mobile and on device applications. It offers strong softwar…