Hi everyone, I’m noticing an important delay in the API response since yesterday (happening in the morning US Central time), with 1000 tokens in minimum 30 seconds, and some requests take more than 10 or 20 minutes to complete (usually, was taking 10 to 12 seconds). At the opposite, Chatgpt (free) …

[image] anassmalki: It was working well before Sunday, had no issues. Also, I just tried the stream, and the result is the same. 530 tokens in 68 seconds, without any parallel call. Definetly, there are issues on the API endpoint. I never suggested that streaming causes tokens to generate fas…

Not the first time we’ve seen system strain via API and ChatGPT on a Monday. My understanding is that OpenAI is losing money on a number of the offerings at current prices, so they are likely up/down scaling as needed, based on expected usage… If I were any of the folks doing product demos on a Mon…

My own wild guess is that in the climate of GPU shortage for all the AI demands, Microsoft isn’t giving up its own Azure compute to OpenAI; instead, using GPT-4 ridiculously on Bing searches locked to their own Edge browser to try to make a browser and search engine nobody wants a thing.

100% this seems like a compute resources issue one way or the other.

Im getting slow responses plus Im getting GPT 3 response instead of 3.5 turbo. Something happened today. I dont know what. Pretty stupid!

I think the idea that streaming would help you to avoid timeout of 30 sec running your server script is wrong. Although you start sending the data sooner, the timeout will hit you after 30 seconds and the data that have not been generated by the API will be lost.

Try it out and let us know how it goes.

Yeah, I am getting a 503 error. And Chatgpt free version have no issue here in Bangladesh.

I am having delays and errors as well…while losing money basically.

We are getting 503 Errors in Goa India since 10 am this morning.

Anyone facing gpt-3.5-turbo API delays?

API

anon5861895 October 30, 2023, 11:51pm 39

Buy $50 credit and become Tier-2, guys. I’ve fixed the slow GPT3.5 issue with that.

Topic		Replies	Views
GPT-3.5 API is very slow. Any fix? API	31	10409	October 12, 2023
GPT-3.5 Turbo API response is slow API	20	12869	November 11, 2023
GPT-3.5 API is 30x slower than ChatGPT equivalent prompt API gpt-35-turbo , api	69	15130	November 30, 2023
Chat GPT's API is significantly slower than the website with GPT Plus API	34	38032	June 19, 2023
ChatGPT API responses are very slow API	30	30893	November 21, 2023

Anyone facing gpt-3.5-turbo API delays?

Related topics