sokuji

<h3 align="center">Real-time speech translation — cloud or fully offline on your device</h3>

English | 日本語 | 中文

Why Sokuji?

Built by Kizuna AI Lab — we use AI to break language and accessibility barriers, creating genuine human connections. "Kizuna" (絆) means "bond" in Japanese, and Sokuji (即時) is our flagship tool to make real-time communication possible across any language.

Sokuji is a cross-platform live speech translation app for desktop and browser. It supports Local Inference — on-device ASR, translation, and TTS powered by WASM and WebGPU, with no API key required, no expensive GPU needed, fully offline, and completely private. It also integrates with cloud providers including OpenAI, Google Gemini, Palabra.ai, Kizuna AI, Doubao AST 2.0, and OpenAI-compatible APIs.

How It Works

graph LR
    A["🗣️ You speak<br/>(any language)"] --> B["🎙️ Sokuji"]
    B --> C{"Choose one"}
    C -->|"☁️ Cloud"| D["OpenAI · Gemini<br/>Palabra · Doubao..."]
    C -->|"🖥️ Local"| E["On-device AI<br/>ASR → Translate → TTS<br/>(fully offline, no GPU)"]
    D --> F["🔊 Translated voice"]
    E --> F
    F --> G["💻 Zoom · Teams · Meet<br/>Discord · Any app"]

    style A fill:#4a9eff,stroke:#357abd,color:#fff
    style B fill:#10a37f,stroke:#0d8a6a,color:#fff
    style C fill:#ff9f43,stroke:#e88a2e,color:#fff
    style D fill:#6c5ce7,stroke:#5a4bd1,color:#fff
    style E fill:#00b894,stroke:#009d7e,color:#fff
    style F fill:#fd79a8,stroke:#e56b96,color:#fff
    style G fill:#636e72,stroke:#525c60,color:#fff

Demo

https://github.com/user-attachments/assets/1eaaa333-a7ce-4412-a295-16b7eb2310de

Install

Sokuji is available as a Desktop App and a Browser Extension — same features, different reach.

Desktop App

Download from the Releases page:

Browser Extension

<details>
<summary>Install extension in Developer Mode</summary>

1. Download sokuji-extension.zip from the Releases page
2. Extract the zip file
3. Go to chrome://extensions/ and enable "Developer mode"
4. Click "Load unpacked" and select the extracted folder

</details>

Build from Source

git clone https://github.com/kizuna-ai-lab/sokuji.git
cd sokuji && npm install
npm run electron:dev        # Development
npm run electron:build      # Production

Features

Local Inference (Edge AI)

Run everything on your device — no API keys, no internet, no expensive GPU, complete privacy. Powered by WASM and WebGPU, Sokuji runs efficiently on any modern browser using your existing CPU and integrated graphics.

• 50 ASR models (32 offline + 10 streaming + 8 WebGPU including Whisper, Cohere Transcribe, Voxtral Mini 4B) covering 99+ languages
• 55+ translation pairs via Opus-MT + 5 multilingual LLMs (Qwen 2.5 / 3 / 3.5, GemmaTranslate) with WebGPU
• 136 TTS voices across 53 languages (Piper, Piper-Plus, Coqui, Mimic3, Matcha engines)
• One-click model download with IndexedDB caching

Cloud Providers

Audio

• Translate your voice — speak in your language, others hear the translation as if you spoke it natively
• Translate others' voice — capture meeting audio (extension) or any system audio (desktop) and get real-time translated subtitles
• Virtual Microphone — route translated audio to Zoom, Meet, Teams, or any app
• Real-time Passthrough — monitor your own voice while recording
• AI Noise Suppression — removes background noise, keyboard sounds, and other distractions
• Echo Cancellation — built-in with modern Web Audio API

Interface

• 30 languages — fully localized UI
• Simple Mode — streamlined setup for non-technical users
• Advanced Mode — waveform display and detailed controls

Privacy

Your audio stays on your device — if you choose Local Inference, nothing ever leaves.

• Cloud mode connects directly to provider APIs — no intermediary servers
• API keys stored locally only, never transmitted to us
• Local Inference processes everything on-device with zero network requests
• Anonymous usage analytics via PostHog

Tech Stack

• Desktop: Electron (Windows, macOS, Linux)
• Extension: Chrome/Edge Manifest V3
• UI: React + TypeScript + Zustand
• Local AI: sherpa-onnx (WASM) · Transformers.js · WebGPU
• Audio: Web Audio API · AudioWorklet · WebRTC
• i18n: i18next (30 languages)

Contributing

We welcome contributions! Please read our Contributing Guidelines before getting started.

License

AGPL-3.0

Sponsors

<table>
<tr>
<td><a href="https://signpath.org/">

</a></td>
<td>Free code signing on Windows provided by <a href="https://about.signpath.io/">SignPath.io</a>, certificate by <a href="https://signpath.org/">SignPath Foundation</a>.</td>
</tr>
</table>

Support

• Issues — Bug reports
• Discussions — Questions & ideas

Acknowledgments

• Cloud APIs: OpenAI, Google Gemini, Volcengine
• ASR: sherpa-onnx, OpenAI Whisper, SenseVoice, Moonshine, Cohere Transcribe, Voxtral Mini 4B
• TTS: Piper, Piper-Plus, Matcha-TTS, Coqui TTS, Mimic 3
• Translation: Opus-MT, Qwen, GemmaTranslate
• Infra: Transformers.js, ONNX Runtime, Electron, React

For detailed model licenses, see THIRD_PARTY_NOTICES.md.