7h 35m 39s logged

🎙️ VoskFlow Devlog — Offline Speech Intelligence Desktop App

Building VoskFlow — an entirely offline, privacy-first voice dictation engine with an Apple/VOID-inspired minimalist HUD that works across any Windows app.

Here’s everything built, debugged, and polished over the latest development sprint! 🚀

⚡ What We Built & Accomplished

1. 🌌 The “VOID” Minimalist HUD & Pill Widget

Idle State: A discreet, 4px Warm Ochre (#DCA54C) dash docked right above the Windows taskbar.
Active State: Hold the global push-to-talk hotkey (Ctrl + Space), and the dash smoothly expands into a floating pill with live symmetrical audio waveform visualizer bars.
Hands-Free Auto Mode: Double-tap Ctrl to lock into hands-free streaming dictation.
Zero Distraction: When released, it transcribes offline in milliseconds and types your text directly into whatever window/app has focus.

2. 🛠️ Frameless 6-Step Onboarding & Calibration Wizard

Custom frameless Tauri + Webview2 window with dynamic particle starfield canvas.
Hardware RAM auto-detection to automatically recommend the right offline model (tiny.en, base.en, small.en).
Interactive Microphone Tuning & Voice Calibration step with live audio peak meters and immediate dictation verification.
Seamless transition to the full system Dashboard upon completion.

3. 🧵 Bulletproof AI STT Worker & Windows Engine Architecture

CTranslate2 & OpenMP Multi-threading Fix: Solved the infamous OpenMP CPU inference deadlock on Windows by isolating model initialization and transcription into a dedicated Python Queue worker loop.
float32 Universal Compute Engine: Standardized compute format to ensure compatibility across all CPU architectures (Intel & AMD) without quantization crashes.
Thread-Safe Qt Signal Dispatching: Re-architected background thread-to-GUI communication to eliminate GetDC (Invalid window handle) errors.

4. 🔕 Stealth Tray Engine & Lifecycle Management

Persistent Background Daemon: Closing the Dashboard now cleanly minimizes VoskFlow to the system tray so speech dictation is always on standby.
Auto-Cleanup for Stale Processes: Built automated socket & process-mutex cleanup to prevent orphan zombie backends when restarting or developing.
Tray Bridge: Open/close Dashboard anytime directly from the Windows notification tray menu.

🧠 Tech Stack

Frontend: Tauri v2, Rust, HTML5/CSS3 Canvas (Particle Physics), JetBrains Mono
AI Core: Faster-Whisper (CTranslate2 offline speech models)
Audio & System: PyAudio, NumPy, PyQt6 (Translucent GUI overlays), Pynput (Low-level global hotkeys)
Platform: Windows 11 / 10

🔮 What’s Next

Exportable custom voice shortcuts and automation macros.
Local custom vocabulary & dictionary substitution rules.
Packaging into a self-contained one-click .exe installer.

100% offline. Zero telemetry. Your voice stays on your machine. 🔒