nanowhale
nanowhale is a miniature DeepSeek-V4-style language model project, built to reproduce the core DeepSeek-V4 architecture at about 110M parameters. It is designed as an educational and research-scale model, with both a pretrained base version and an SFT chat version, rather than as a production frontier assistant.
- Type
- Text
- Weights
- Open
- Downloads
- 918
- Likes
- 24
- Pipeline
- text generation
- License
- apache-2.0
Model hub
HuggingFaceTB/nanowhale-100m-base
- Repo
- HuggingFaceTB/nanowhale-100m-base
- Library
- transformers
- Access
- Public
Technical tags and languages
More from Hugging Face
7
-
1.2k DL
Carbon-8B
Text
Carbon-8B is an open-source 8B generative DNA foundation model for DNA/RNA sequence generation, scoring, and…
-
37 DL
Distil Whisper
Multimodal
Distil Whisper is a distilled version of OpenAI's Whisper speech recognition model, roughly six times faster…
-
SmolLM2
Text
SmolLM2 is a family of very small open language models at 135M, 360M and 1.7B parameters, trained on 11 trill…
-
SmolLM3
Text
SmolLM3 is a 3B open model with dual-mode reasoning: the same weights answer directly or produce an extended…
About Hugging Face
1
Hugging Face is an Artificial Intelligence company that specializes in Machine Learning, Natural Language Processing, and AI Chatbots.