Hi, my GPT-4 API calls have been extremely slow since today. I am experiencing the same issue with ChatGPT (GPT-4). It seems to be linked to my account because when I test the speed using another account, GPT-4 responds normally. I havenāt reached the maximum quota for this month. Could it be related to a quota issue? Are there any other possible reasons?
Thanks for your help
The same here. Timeout every times after 5min. I need to launch 5 times to get 1 and i pay for 5, really amazing ! What is your plan to solve that OPENAI ?
Yup, this is happening to me as well. Also seems to be specifically connected to my account.
They have issues in their servers, I donāt work for OpenAI but it usually happens when they release new features, and plugins probably got everyone excited and got jumping on, which uses GPT4 in the background.
I hope they solve it soon.
Yes, it was happening to me also. So I changed my backend response to SSE (Server send events) so that my users should know that something is going on.
Impressive! May I ask where you obtained this data from?
This is from the monitor in AWS hooked to the Lambda function that makes calls to the GPT-4 API.
So my own personal view of performance from my API calls.
Hereās our API performance for GPT-3.5-turbo over the last month:
The data are somewhat noisy, but clearly an upwards trend. The type of inference hasnāt changed and the size of each request hasnāt changed.
I wonder what the solution is, especially if you sre trying to build a business around it.
Well, itās not clear that there is a solution yet.
Iām hoping the OpenAI folks will pull through.
Iād be OK paying, say, 10x more for a 4x faster product with some kind of latency guarantee.
Iām also looking at other models, both self-hosted, and competing providers, but itās somewhat slim pickings for now ā¦ Especially until Google actually lets people use that PaLM model they āreleasedā twice already.
Clearly, thereās demand for what OpenAI are doing, and the main challenge is meeting up to that demand.
