I have been building app that relied on open ai whisper as well as speech to text. The problem is the response time is too slow. It can get up to 12 second before it respond back with a voice. How can chatgpt app respond so fast? It’s always under 2 second.

How can chatgpt voice response so fast?

merefield May 17, 2024, 8:51am 2

It’s using a newer model for sure, one we don’t yet have access to via API for this modality.

2 Likes

Topic		Replies	Views
How does the 'Call Annie' app achieve such remarkable speed with the ChatGPT API, and is it using stream mode? API api-speed	8	3610	September 24, 2024
How to reduce latency with GPT & Unity Requests API gpt-4 , api	2	433	July 3, 2024
How does ElevenLabs or Deepgram realtime voice agents work as good as OpenAI Realtime API? Community realtime	2	471	January 21, 2025
Implementing audio conversation with AI API	8	3853	April 29, 2024
ChatGPT API Very Slow at generating Responses API gpt-4 , api	8	5127	December 25, 2023