video SALMONN 2
video-SALMONN 2 is an audio-visual large language model from Tsinghua and ByteDance that uses video frames and sound to generate rich captions and answers, reaching state-of-the-art on many audio-visual QA and video understanding benchmarks.
- Type
- Text
- Weights
- Open
- Downloads
- 26
- Likes
- 4
- Pipeline
- video text to text
- License
- apache-2.0
Model hub
tsinghua-ee/video-SALMONN-2
- Repo
- tsinghua-ee/video-SALMONN-2
- Library
- transformers
- Access
- Public
Technical tags and languages
Papers
1
More from ByteDance
11
-
118 DL
Depth Anything 3
Image
Depth Anything 3 is a spatial reconstruction model that predicts consistent geometry from arbitrary visual in…
-
Doubao Pro (1.5 Pro)
Text
Doubao 1.5 Pro (ByteDance) is a sparse-MoE flagship built for strong reasoning, coding, and multimodality. It…
-
Doubao Realtime Voice
Audio
Doubao Realtime Voice is ByteDance’s low-latency voice interface for the Doubao models—streaming speech-to-te…
-
Doubao-1.5-Pro
Text
AI model by ByteDance
-
952 DL
InfiniteYou
Image
Identity-preserving photo recrafting model packaged as an adapter on top of a FLUX.1-dev base.
-
Lance
Multimodal
Lance is ByteDance’s open-source 3B active-parameter unified multimodal model for image and video understandi…
-
2k DL
LatentSync-1.6
License openrail++ · 199,929 downloads · by ByteDance
-
OmniScient Model
Text
OmniScient Model (OSM) is an open-ended visual recognition approach that predicts free-form class labels for…
About ByteDance
1
ByteDance is a multinational technology company known for its content platforms, including TikTok and Douyin.