GPT 3.5 and 3.5 16k around 300% slower since Friday for certain Orgs

API
1

We are experiencing a problem since Friday last week. The GPT 3.5 calls (API) have become so slow, they are basically unusable.

Through some troubleshooting, we’ve managed to narrow down the issue to specific Orgs. One Org is exceptionally slow, while the other with the same parameter and identical prompt is substantially faster.

All tests have been done from the same machine and network as well as with identical settings. Even when testing the Playground, the responses in one Org are 300% slower on average compared the alternative one. There is no doubt that certain organizations are being throttled in some way.

This casts a huge shadow on OpenAI and the potential commercial applications of the GPT models. This is coming from one of the larger business groups in Europe, days before rolling out the first large-scale AI features.

The short-term “solution” is to use 2-3 fallback accounts from our subsidiaries. The long-term solution is to find reliable alternatives to OpenAI.

1 Like
2

Hi and welcome to the Developer Forum!

This does seem to be something that a number of users are experiencing, you can report it to help.openai.com and use the support bot in the bottom right corner. Hopefully it gets resolved soon.

3

The chatbot was very unhelpful. And resulted in me writing a long bug report in the window and them saying they’ll get back to me “in about a week.”

I know it’s not a lot of money, but it is a paid product and the continued slowness without notice makes long term development with the product questionable.

1 Like
4

I am adding on here because I am seeing this as well. Considering switching to bedrock

1 Like
5

We’ve similarly experience a MASSIVE slow down for the past week or so. To the point it effectively breaks our product(s).

Any word?

3 Likes
6

I have noticed it with users in the UK. A request takes roughly 20 seconds regardless of length whereas in the US it’s under half a second. Same request.

1 Like
7

Same here; it is insanely slow and barely usable. Looking for other options. Really disapointed with both the Chat and the API, the overall quality is going downhill!

8

I have one user who was running some requests that were about 150 tokens total and each request was taking on average 20 seconds for OpenAI to respond. He is in the UK. On my end though, I’m in the US and it only took half a second for OpenAI to respond in each instance. We were completely stumped so I had to log the timecodes in a debug file (below). Something weird and messed up is going on at OpenAI.

22.3816011 seconds
11.5139868 seconds
20.6569879 seconds
19.8437313 seconds
21.1393574 seconds
20.7041069 seconds
18.0971482 seconds
19.5646624 seconds
20.3926722 seconds
20.1108889 seconds
22.1413027 seconds
20.8405996 seconds
21.7407398 seconds
18.6390785 seconds
18.9787817 seconds
18.3301708 seconds
19.5945645 seconds
21.4518203 seconds
21.5327728 seconds
23.5687439 seconds
23.8707668 seconds
13.5731319 seconds
14.1064116 seconds
13.4426547 seconds
14.4960483 seconds

9

We’ve experience a massive slow down for the past week.

Any update ?

10

Consider starting a fresh post for your query.

Typically, older topics get closed when brought back up.

1 Like