GPT4 errors count towards usage quota

thompson.m.j · 2023-03-27T14:10:35.564Z

Today, using GPT4 with ChatGPT Plus, I receive this error repeatedly after entering a prompt:

“The server experienced an error while processing your request. Sorry about that! You can retry your request, or contact us through our help center at help.openai.com if the error persists.”

Occasionally, when I resubmit the prompt, a response is generated, but I usually see this error again.

It seems each prompt resubmission after error counts against my prompt quota, as I’m now looking at this:

“You’ve reached the current usage cap for GPT-4. You can continue with the default model now, or try again after 11:41 AM”

I received 5 total replies in this session. One of them was in response to my prompt, “Please continue your most recent response, which cut off prematurely.”

Trip · 2023-03-27T14:43:12.203Z

Same issue here, been happening since friday. Don’t know why I’m paying when I can’t even use it.

drugaga2 · 2023-03-27T15:15:36.540Z

Responses became much shorter as well. And generating speed is very low. It seems that servers don’t have capacity for so many users.

shawnbrand · 2023-03-27T15:39:47.411Z

Same here, having the same issues over and over. Generation is much slower when it happens. But 90% of the time I get the error, “The server experienced an error while processing your request. Sorry about that! You can retry your request, or contact us through our help center at help.openai.com if the error persists.”

thompson.m.j · 2023-03-27T17:00:07.916Z

To be fair, GPT-3.5 runs without issues, which is technically what we’re paying for. GPT-4 access is still considered a preview and is a bit of a bonus for subscribers. Though there is a stark difference between 3.5 and 4, which makes it hard to go back sometimes.

thompson.m.j · 2023-03-27T17:09:01.815Z

It’s working more reliably for me now. It must just be a transient overloading … but it would be nice to not burn through prompt credits on queue submissions that get rejected.

linus · 2023-03-27T19:11:08.642Z

Hi @drugaga2,

to increase the length you can try the following:

Gpt4 - Incomplete and Partial Responses

To increase the length of your response you can try to integrate something like “reply with X paragraphs of text” or “Reply with X words” or “give me a detailed response”. The model tries to answer your requests as concise as possible because that is what most people want. So if you tell the model you want a longer answer you’ll receive it in most cases.

drugaga2 · 2023-03-27T19:44:54.102Z

By short i meant that it ends on half sentence and i have to use “continue” prompt.

linus · 2023-03-27T19:49:32.522Z

Ah thanks for specifying @drugaga2!

So maybe this helps you:

GPT-4 is unusable on my account but works on my GF's account (same computer/internet)

One question regarding your statement: Does this also happen when you initiate a new conversation? I ask this question because for GPT3 the whole content of the conversation was re-submitted when you posted a new message. So the deterioration in performance might also be related to a increase in needed computing power because the more content is submitted the harder it becomes to answer the messages.