I have been building app that relied on open ai whisper as well as speech to text. The problem is the response time is too slow. It can get up to 12 second before it respond back with a voice. How can chatgpt app respond so fast? It’s always under 2 second.

How can chatgpt voice response so fast?

merefield May 17, 2024, 8:51am 2

It’s using a newer model for sure, one we don’t yet have access to via API for this modality.

1 Like

Topic		Replies	Views
How to reduce the response time from WHISPER STT API stt	0	114	June 13, 2024
How to reduce latency with GPT & Unity Requests API gpt-4 , api	1	163	June 5, 2024
How to overcome latency in response API gpt-4 , chatgpt	3	1507	February 19, 2024
ChatGPT API TTS streaming API api	2	1197	June 1, 2024
Whisper API Latency is just too high! API whisper	2	3267	December 25, 2023