Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

how're you handling latency on turn overlaps : buffered stream with early intent cutoff or full duplex with partial decoding?


We transcribe after 400ms of silence in 200ms chunks. 3 voice chunks (VAD) automatically interrupts, unless it's a back channel like "yeah" or "right" or something like that.

Whisper can transcribe in <100ms. We then wait for the turn detection model, LLM, and tts to trigger a streamed response back to eh client.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: