Audio model

Phi 4 multimodal

Phi 4 multimodal is Microsoft's 5.6B open-weight model that folds text, vision and speech into a single set of weights rather than stitching separate encoders together. It handles document and chart understanding, OCR, speech recognition, translation and summarisation, offers a 128K context window, is MIT licensed, and is small enough to run on a laptop or an edge device.

Type
Audio
Weights
Open
Downloads
264k
Likes
1.6k
Pipeline
automatic speech recognition
License
mit

Model hub

microsoft/Phi-4-multimodal-instruct

Repo
microsoft/Phi-4-multimodal-instruct
Library
transformers
Access
Public
Technical tags and languages
ar zh cs da nl en fi fr de he hu it ja ko no pl pt ru es sv th tr uk transformers safetensors phi4mm text-generation nlp code audio automatic-speech-recognition speech-summarization speech-translation visual-question-answering phi-4-multimodal
Open on Hugging Face

Papers

1

More from Microsoft

14

About Microsoft

1

Microsoft is a technology company that offers a wide range of software, cloud computing services, hardware, and artificial intelligence solutions.