Text model

Hy4 preview GGUF

Hy4 preview GGUF is Tencent's quantized release of the Hy4 preview Mixture-of-Experts language model, packaged as two llama.cpp compatible files. The Q4_K_M build is a standard 4 bit quantization at 4.86 bits per weight. The STQ1_0 build uses an imatrix aware mixed precision ternary encoding to reach 2.38 bits per weight, roughly half the size, using a weighted least squares scale and imatrix guided zero placement to preserve accuracy at very low bit widths.

Type
Text
Weights
Open
Downloads
379k
Likes
99

Model hub

AngelSlim/Hy4-preview-GGUF

Repo
AngelSlim/Hy4-preview-GGUF
Access
Public
Technical tags and languages
gguf endpoints_compatible imatrix conversational
Open on Hugging Face

More from Tencent

14

About Tencent

1

Tencent is a world-leading internet and technology company that develops innovative products and services to improve the quality of life of people around the world.