I have been building app that relied on open ai whisper as well as speech to text. The problem is the response time is too slow. It can get up to 12 second before it respond back with a voice. How can chatgpt app respond so fast? It’s always under 2 second.

How can chatgpt voice response so fast?

merefield May 17, 2024, 8:51am 2

It’s using a newer model for sure, one we don’t yet have access to via API for this modality.

2 Likes

Topic		Replies	Views
How does ElevenLabs or Deepgram realtime voice agents work as good as OpenAI Realtime API? Community realtime	3	897	February 26, 2025
How does the 'Call Annie' app achieve such remarkable speed with the ChatGPT API, and is it using stream mode? API api-speed	8	3662	September 24, 2024
How to reduce latency with GPT & Unity Requests API gpt-4 , api	2	457	July 3, 2024
Implementing audio conversation with AI API	8	3966	April 29, 2024
ChatGPT API Very Slow at generating Responses API gpt-4 , api	8	5245	December 25, 2023