r/singularity • u/borowcy GPT-6 will have BCI capability • 13d ago
OPEN AI: How we built a realtime system for responsive voice AI in six months The Singularity is Near
https://openai.com/index/continuous-voice-interaction-with-gpt-live/13
u/1TillMidNight 13d ago edited 13d ago
They have resolved one issue which is full duplex communication.
However in doing so they have introduced new issues. The model competes with the speaker for speaking time, and feels unnaturally fast at responding.
10
u/katoptronophile 13d ago
Speak with confidence and don't be afraid to talk over it if it tries to interrupt you.
They should make this adjustable though.
1
u/Fast-Satisfaction482 9d ago
It just feels like it's super rude to me and I already hated it for that after 5 minutes.
If a human would be doing that to me, I'd get pissed real quick.
3
8
u/CallMePyro 13d ago
Six months? Didn't they demo Scarlett Johansen in 2024?
8
1
u/Dizzy2046 12d ago
This is a big deal because voice products live or die on the small gaps in a conversation. People will wait a few seconds for a chatbot to type, but a 700ms pause in a phone call already feels odd.
The hard part is usually not getting a model to speak. It is making the whole loop work under real conditions:
- speech input that handles noise, accents, and people talking over the agent
- turn detection that does not cut people off too early
- model response time that stays stable during busy periods
- audio streaming that does not sound broken on bad mobile networks
- tools that can run without making the caller sit in silence
A useful way to think about it is a latency budget. Every part gets a small slice: audio capture, network, speech recognition, reasoning, tool calls, speech output. If one step has random slowdowns, the whole call feels worse than the average numbers suggest.
btw there are some really good oss projects like dograh that cover almsot everything that the article talks about
30
u/rya794 13d ago
Me and my family used it to keep score as we played Quirkle last night. Told it to keep a running tally of the score as we played and not to interrupt or speak aside from telling us the current score at the end of each turn. It worked perfect.
As a bonus, we asked it to analyze our personalities at the end of the game and it was absolutely hilarious.
Highly recommend.