You are browsing as a guest. Sign up (or log in) to start making projects!

2h 6m 20s logged

i cant do a video because it will casue a feedback loop Today I finally got a working voice-controlled
AI system inside my Godot project. The goal was to let the player speak
naturally to NPCs and have the game react in real time. First I set up a full
voice pipeline: with a Microphone input capture inside Godot  Real-time voice detection using audio
thresholds Automatic recording when the player starts speaking  Silence detection to stop recording  Exporting audio chunks as .wav files Sending
audio to Whisper (whisper.cpp) locally  Receiving
transcribed text for game logic This allows players to literally talk to the
game than i added the audio improvements At first, the audio was messy and hard
for Whisper to understand. The main issues were  Muddy frequencies, Missing clarity in speech ,
and Some words being cut off at the start  To fix this, I added audio processing directly
in Godot: using a Compressor to  balanced
loud/quiet parts of speech and a band-Pass Filter to removed low rumble + high
noise and Improve microphone sensitivity tuning. After these changes, the
speech became much cleaner and Whisper started producing more accurate
transcriptions.

 

0
3

Comments 0

No comments yet. Be the first!