Skip to content
softmaxePublic

About

Native macOS dictation app in Rust + GPUI: press a shortcut, speak, and paste text transcribed by your own self-hosted speech server, with optional LLM cleanup.

Topics

Resources

Security policy

Stars

2 stars

Watchers

0 watching

Forks

Repository files navigation

Whisper app icon

Whisper

English 简体中文

A native macOS dictation app built with Rust and GPUI. Press a shortcut, speak, and Whisper transcribes your voice with your own OpenAI-compatible speech server, optionally cleans up the text with a chat-completions model, and pastes the result into whatever app you are typing in.

Press the shortcut, speak, and the cleaned-up text is pasted where you type

Features

  • Dictate anywhere. Trigger with Globe/Fn, a single modifier such as Right Command, or any key combination. Double-tap a single key for hands-free recording (key combinations toggle with one press), or hold to talk. A floating recording pill shows a live waveform and the elapsed time, with a cancel button beside it; click the pill to finish or press Escape to cancel. During polishing, Skip inserts the recognized text immediately with local corrections and snippets still applied. If the server fails, the recording is kept so you can resend it.
  • Self-hosted models. Speech recognition goes to your own /audio/transcriptions endpoint; optional cleanup goes to a /chat/completions endpoint, with an editable prompt and a Prompt Studio to test it. Test Connection checks each server and lists its models.
  • Skip silence locally. Embedded Silero VAD trims pauses and non-speech sound from dictation uploads, with buffers around speech. History and recovery retain the original recording; Send anyway can bypass a no-speech result once.
  • Fewer hesitation sounds. Optional local filler-word removal works even with text cleanup off, while preserving the raw transcript in History.
  • Gets better with use. A dictionary supplies spelling hints, corrections you make right after a paste are learned, and Snippets expand short phrases into longer text. Removing a word or snippet can be undone.
  • History. Search with Cmd+K, open raw transcripts, re-transcribe from saved audio, undo a delete, and set how long audio and transcripts are kept.
  • File transcription. Drop in one audio or video file, or a batch; each transcript is saved to History.
  • Insights. Words, dictations and words per minute for the last 7 or 30 days or all time, each compared with the previous period; a trend chart that sets the period beside the one before it; highlights such as active days, busiest day and time spoken; and a Habits section with your streak calendar and weekly rhythm. Everything is computed on device.
  • Test your microphone. Record up to ten seconds and play it back from Settings > Dictation. The clip stays in memory and is never saved or sent.
  • Fits into macOS. Menu bar icon, standard app menu, start at login (macOS 13+), optional media pause while recording, English and Simplified Chinese UI, and light, dark, Tokyo Night or automatic themes.
  • Keyboard and VoiceOver. Every control is reachable with Tab and named for VoiceOver, lists and charts move with the arrow keys, and animations follow the macOS Reduce motion setting.

Data lives in ~/Library/Application Support/com.softmaxe.whisper.

Screenshots

The screenshots show the light theme in v0.0.29 with fictional sample data. Light, dark, Tokyo Night and automatic appearance are available in Settings > General.

History Insights
History grouped by day, with search Words, dictations and words per minute compared with the previous period, a trend chart across both periods, and highlights
Dictionary Speech-to-text settings
Dictionary words with their source, uses and last use Self-hosted speech server URL, connection test and model
File transcription
The file drop target above the transcription settings and where transcripts are saved

Install

brew install --cask softmaxe/tap/whisper

Releases are also published on the Releases page as a zipped app with a SHA-256 checksum. The app is signed with a persistent self-signed certificate, not notarized, so macOS may ask you to confirm the first launch in System Settings > Privacy & Security.

Performance compared with the Electron version

The app was previously built with Electron and React. Moving to Rust and GPUI made it faster to start, much lighter on memory and CPU, and a fraction of the size.

Measured on an Apple M2 Pro (32 GB), comparing the release bundles of both versions with the same data directory and settings.

Metric Rust + GPUI Electron Change
Launch to window on screen ~390 ms ~680 ms 43% faster
Launch to first painted content ~495 ms ~775 ms 36% faster
Memory, physical footprint (all processes) 83 MB 220–236 MB ~65% less
Memory, resident set (all processes) 154 MB ~698 MB ~78% less
Processes 2 9
CPU while recording 6.1% 43.6% ~86% less
CPU idle, app hidden 0.0% 0.0% same
CPU idle, control panel in front 1.2–1.4% 0.1% higher
App bundle size 95 MB 319 MB 70% smaller
Files in the bundle 19 344

The Rust bundle's 95 MB (measured on 0.0.6) includes a 43 MB static ffmpeg.

The one regression is idle CPU while the control panel is visible. GPUI keeps a display link ticking at the screen refresh rate for visible windows, even though nothing is redrawn. It stops once the window is hidden, minimized, closed or covered.

How it was measured:

  • Launch times are the median of 5 cold launches via open, after one warm-up. Two polls were timed: the window appearing in CGWindowList, and the window image showing painted UI.
  • Memory comes from footprint and ps, summed over the app's process tree after a 40-second settle.
  • CPU comes from top, averaged over 30 s idle and 10 s of recording (double-tap shortcut, then Escape).
  • Each steady-state run was repeated twice per app with matching results.

Transcription latency was not compared: both versions call the same server, which dominates end-to-end time.

Requirements

  • Apple Silicon Mac, macOS 12 or later
  • Rust, pinned in rust-toolchain.toml, and the Xcode command line tools (swiftc, clang) for the native helpers that build.rs compiles into resources/bin
  • A reachable speech recognition server; a cleanup server is optional

Build and run

cargo run                    # debug build
scripts/check.sh             # formatting, clippy and tests, as in CI
scripts/build-icons.sh       # rebuild app icons and README previews (full Xcode 26+)
scripts/bundle-macos.sh      # release build -> dist/Whisper.app (ad-hoc signed)

Bundling ffmpeg is optional. Uploads need it only for video and for audio other than MP3, WAV, M4A, WebM, Ogg/Opus, FLAC and AAC; without a bundled copy the app uses an ffmpeg from Homebrew or PATH. scripts/download-ffmpeg.sh fetches the pinned static build that releases ship into resources/bin. Run it before the bundle script.

Release signing and publishing are described in docs/macos-signing.md and docs/testing.md.

The app asks for Microphone access when you first dictate and needs Accessibility access for automatic paste and the Globe/modifier listeners.

Environment variables

Variable Purpose
WHISPER_USER_DATA_DIR Use another data directory (tests, side-by-side runs)
WHISPER_HELPERS_DIR Load the native helpers from another directory
WHISPER_SKIP_NATIVE_BUILD Skip building the native helpers in build.rs
WHISPER_DEV_SCENE Debug builds: open a fixed view at launch for screenshots, such as insights, settings:speech or pill:recording (values in src/ui/dev_scene.rs)
RUST_LOG Log filter, for example info,whisper::native=debug

Layout

  • src/: settings, database, audio capture, transcription and cleanup services, text processing, native macOS integrations
  • src/app.rs, src/ui/, src/dictation.rs: the GPUI app; src/main.rs only calls whisper::run()
  • resources/native/: Swift helper sources; resources/mediaremote-adapter/: vendored MediaRemoteAdapter
  • locales/: UI strings and cleanup prompts
  • packaging/, scripts/: app bundle metadata, signing and build scripts
  • docs/: signing and testing notes

License

GNU Affero General Public License v3.0.

About

Native macOS dictation app in Rust + GPUI: press a shortcut, speak, and paste text transcribed by your own self-hosted speech server, with optional LLM cleanup.

Topics

Resources

Security policy

Stars

2 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages