Sequential Hidden Decoding 8B n8
Sequential-Hidden-Decoding-8B-n8 is Tencent’s base language model variant that extends effective sequence length by 8x using multiple embedding passes while keeping the same Transformer backbone. Built on Qwen3-8B-Base, it is aimed at benchmarking, text completion, and fine-tuning research, with hidden latent steps acting like implicit reasoning before each predicted token.
- Type
- Text
- Weights
- Open
- Downloads
- 12M
- Likes
- 2.1k
- Pipeline
- text generation
- License
- apache-2.0
Model hub
Qwen/Qwen3-8B
- Repo
- Qwen/Qwen3-8B
- Library
- transformers
- Access
- Public
Technical tags and languages
Papers
2
More from Tencent
11
-
3k DL
AuK
Audio
AuK is a 1.5 billion parameter open source speech foundation model that generates and edits speech through na…
-
2.6k DL
EVIE-Preview-4.5B
Multimodal
EVIE-Preview-4.5B is a multilingual visual document retrieval model built on the Qwen3.5-4B vision language b…
-
Hunyuan Motion 1.0
Image
Tencent HY-Motion 1.0 is an open text-to-3D human motion generator using billion-scale Diffusion Transformer…
-
404 DL
Hunyuan MT Chimera 7B
Text
Hunyuan-MT-Chimera-7B is Tencent’s open-source translation ensemble model that combines multiple translation…
-
Hunyuan Translation Model 1.5
Text
Tencent-HY-MT1.5 is a multilingual machine-translation family with 1.8B and 7B models, supporting 33 language…
-
468 DL
Hunyuan-Large
Text
Hunyuan-Large is Tencent’s flagship large language model in the Hunyuan family. It’s built for advanced reaso…
-
3.1k DL
Hunyuan-MT-7B
Text
Hunyuan-MT-7B is Tencent’s compact 7B multilingual model tuned for fast, accurate translation and cross-lingu…
-
109k DL
Hunyuan3D-2
Image
Hunyuan3D-2 is Tencent’s second-generation text-to-3D model. It creates detailed 3D assets directly from natu…
About Tencent
1
Tencent is a world-leading internet and technology company that develops innovative products and services to improve the quality of life of people around the world.