Multimodal model

Ternary Bonsai 27B

A 27B parameter language model compressed to ternary (1.71 bit) weights, retaining 95% of full precision intelligence while shrinking deployed size to about 7.2 GB. Runs full 27B class reasoning, math, and coding on a standard laptop or single GPU with a 262K token context window.

Type
Multimodal
Weights
Open
Downloads
1.2k
Likes
18
License
apache-2.0