Speakly

Speakly

[](https://github.com/speak-rs/speakly/actions) [](LICENSE) [](https://www.rust-lang.org)

High-performance, extensible speech recognition in Rust. Use local Whisper or cloud APIs (OpenAI, Google, Doubao) as a library, CLI, MCP server, or desktop GUI.

[中文](README.zh-CN.md)

Why Speakly?

| Feature | whisper-rs | transcribe-rs | Speakly | |---------|:----------:|:-------------:|:-----------:| | Local Whisper engine | ✅ | ✅ | ✅ | | Cloud providers (OpenAI / Google / Doubao) | ❌ | ❌ | ✅ | | Auto fallback across providers | ❌ | ❌ | ✅ | | Retry with exponential backoff | ❌ | ❌ | ✅ | | MCP server (Cursor / Claude) | ❌ | ❌ | ✅ | | Desktop GUI with waveform | ❌ | ❌ | ✅ | | CLI with batch + SRT output | ❌ | ✅ | ✅ | | In-app settings (no config file) | ❌ | ❌ | ✅ |

Quick start

cargo build --release

# Transcribe a file (uses OpenAI by default)
./target/release/speakly transcribe audio.wav

# Desktop GUI (real-time recording)
./target/release/speakly-gui

# MCP server (for Cursor / Claude)
./target/release/speakly-mcp --stdio

Enable local Whisper (optional)

Local Whisper runs entirely offline via whisper.cpp. It requires cmake to compile:

# macOS
brew install cmake

# Ubuntu / Debian
sudo apt install cmake

# Build with the whisper feature
cargo build --release --features whisper

# Download a Whisper model (~142 MB)
make model

As a library

[dependencies]
speakly-core = { version = "0.1", features = ["openai"] }
tokio = { version = "1", features = ["full"] }

use speakly_core::prelude::*;

#[tokio::main]
async fn main() -> Result {
    let speakly = Speakly::new()?;
    let result = speakly.transcribe_file("audio.wav").await?;
    println!("{}", result.text);
    Ok(())
}

Engines

| Engine | Type | Notes | Feature flag | |--------|------|-------|-------------| | Whisper | Local | Offline, 99+ languages, requires cmake | whisper | | OpenAI | Cloud | High accuracy | openai (default) | | Google | Cloud | Streaming, 120+ languages | google | | Doubao | Cloud | Optimized for Chinese | doubao |

Configuration

Use .speakly.toml in the project root or ~/.config/speakly.toml:

[speakly]
default_provider = "openai"

[providers.openai]
enabled = true
api_key_env = "OPENAI_API_KEY"

[providers.whisper]
enabled = true
model_path = "./models/ggml-base.bin"
language = "auto"
threads = 4

[audio]
sample_rate = 16000
channels = 1
enable_vad = true

Cloud engine setup

OpenAI

1. Get an API key from platform.openai.com.
2. export OPENAI_API_KEY=sk-your-key
3. Set [providers.openai] with enabled = true in .speakly.toml.

Google Cloud Speech-to-Text

1. Enable the Speech-to-Text API and create a service account key.
2. Save as google-credentials.json, set export GOOGLE_ACCESS_TOKEN=...
3. Set [providers.google] with enabled = true.

ByteDance Doubao

1. Get credentials from Volc Engine.
2. export DOUBAO_API_KEY=key && export DOUBAO_APP_ID=id
3. Set [providers.doubao] with enabled = true.

CLI

speakly transcribe audio.wav
speakly transcribe audio.wav --provider openai --language zh
speakly transcribe audio.wav -f srt
speakly transcribe *.wav --output-dir ./out
speakly providers

MCP Server

Add to Cursor's .cursor/mcp-settings.json:

{
  "mcpServers": {
    "speakly": {
      "command": "/path/to/speakly-mcp",
      "args": ["--stdio"]
    }
  }
}

Tools: transcribe_audio_file, list_providers.

Project layout

• speakly-core — Library (audio processing, provider abstraction, config)
• speakly-cli — Command-line tool
• speakly-mcp — MCP server for Cursor / Claude
• speakly-gui — Desktop app (egui + cpal, Catppuccin theme)
• examples/ — Usage examples

Development

make check    # Compile check
make test     # Run tests
make fmt      # Format code
make help     # List all targets

Docs

• [Architecture](ARCHITECTURE.md)
• [Providers](PROVIDERS.md)
• [MCP guide](MCP_GUIDE.md)
• [Contributing](CONTRIBUTING.md)
• [Changelog](CHANGELOG.md)

License

[MIT](LICENSE)

Source & license

This open-source MCP server is cataloged on AgentStack and links to its original source — we do not rehost the code.

• Author: speak-rs
• Source: speak-rs/speakly
• License: MIT
• Homepage: https://github.com/speak-rs/speakly

Install and usage instructions live in the source repository linked above.