> also, "GPT-4o continuously listens to speech through the audio stream," is going to be problematic

This seems like a good place to leverage a wake word library, perhaps openWakeWord or porcupine. Then the user could wake the device before sending the prompt off to an endpoint.

It could even have a resting or snoozing animation, then have it perk up when the wake word triggers. Eerie to view, I'm sure...

https://github.com/dscripka/openWakeWord

https://github.com/Picovoice/porcupine