# GPT4 API very very slow : reaching timeout

**URL:** <https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341>\
**Category:** API\
**Tags:** gpt-4, api\
**Created:** [May 19, 2023, 9:44am UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341 "2023-05-19T09:44:46Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mikiane](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/mikiane/32/14810_2.png) [@Mikiane](https://community.openai.com/u/Mikiane)\
**Post date:** [May 19, 2023, 9:44am UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/1 "2023-05-19T09:44:46Z")

</div>

Hello,  
Can you confirm if you are experiencing a very long response time when using the GPT4 API?

I am currently experiencing timeouts…

---

<div class="post-metadata">

**Author:** ![udm17](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/udm17/32/139530_2.png) [@udm17](https://community.openai.com/u/udm17)\
**Post date:** [May 19, 2023, 9:57am UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/2 "2023-05-19T09:57:35Z")

</div>

Hi. Same here at my end as well. Both 4 and 3.5-turbo seem to have high latency

---

<div class="post-metadata">

**Author:** ![TomatoPotato](https://avatars.discourse-cdn.com/v4/letter/t/e9c0ed/32.png) [@TomatoPotato](https://community.openai.com/u/TomatoPotato)\
**Post date:** [May 19, 2023, 10:20am UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/3 "2023-05-19T10:20:30Z")

</div>

Same here. Since yesterday I’m getting timeouts when try to get a long completion from GPT-4. It works for shorter ones. When I increased timeout to 1200 I’ve started gettign 502 APIErrors or things like this:

```auto
APIConnectionError: Error communicating with OpenAI: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))

```

```auto
APIError: HTTP code 502 from API (<html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>cloudflare</center>
</body>
</html>
)

```

---

<div class="post-metadata">

**Author:** ![dmcov](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/dmcov/32/448905_2.png) [@dmcov](https://community.openai.com/u/dmcov)\
**Post date:** [May 19, 2023, 1:31pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/4 "2023-05-19T13:31:39Z")

</div>

We are experience this as well. Short to medium complexity requests work fine. If a request for something more complex like “convert this VB code snippet to C#” or “create a short Master Service Agreement for Smith and Co.” it times out. The tokens are not exceeding any parameters and I can receive a response from GPT-4 on Chat Plus.

---

<div class="post-metadata">

**Author:** ![reoxthen](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/reoxthen/32/72327_2.png) [@reoxthen](https://community.openai.com/u/reoxthen)\
**Post date:** [May 19, 2023, 1:32pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/5 "2023-05-19T13:32:54Z")

</div>

Same here… guys we’re paying for this service. this is frustrating.

---

<div class="post-metadata">

**Author:** ![GePeTo](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gepeto/32/34328_2.png) [@GePeTo](https://community.openai.com/u/GePeTo)\
**Post date:** [May 19, 2023, 1:34pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/6 "2023-05-19T13:34:54Z")

</div>

I’m experiencing the same thing. It’s been hours since I can’t input a simple query in GPT-4.

---

<div class="post-metadata">

**Author:** ![yiesrx](https://avatars.discourse-cdn.com/v4/letter/y/85f322/32.png) [@yiesrx](https://community.openai.com/u/yiesrx)\
**Post date:** [May 19, 2023, 2:47pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/8 "2023-05-19T14:47:14Z")

</div>

Same here GPT4 is not working for a few hours.

---

<div class="post-metadata">

**Author:** ![darioft](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/darioft/32/135158_2.png) [@darioft](https://community.openai.com/u/darioft)\
**Post date:** [May 19, 2023, 4:21pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/9 "2023-05-19T16:21:59Z")

</div>

Same problem here using ChatGPT. GPT4 timeouts for any request.

---

<div class="post-metadata">

**Author:** ![nicolasjarin](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/nicolasjarin/32/9194_2.png) [@nicolasjarin](https://community.openai.com/u/nicolasjarin)\
**Post date:** [May 19, 2023, 4:49pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/10 "2023-05-19T16:49:18Z")

</div>

Same since few days, and i lost customers !

---

<div class="post-metadata">

**Author:** ![signups](https://avatars.discourse-cdn.com/v4/letter/s/48db29/32.png) [@signups](https://community.openai.com/u/signups)\
**Post date:** [May 19, 2023, 6:22pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/11 "2023-05-19T18:22:01Z")

</div>

Same here on GPT3 when requesting complex tasks only.

---

<div class="post-metadata">

**Author:** ![pabloalvarezret](https://avatars.discourse-cdn.com/v4/letter/p/d07c76/32.png) [@pabloalvarezret](https://community.openai.com/u/pabloalvarezret)\
**Post date:** [May 19, 2023, 7:06pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/12 "2023-05-19T19:06:53Z")

</div>

Same problem here! wee are losing customers

---

<div class="post-metadata">

**Author:** ![Per](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/per/32/281547_2.png) [@Per](https://community.openai.com/u/Per)\
**Post date:** [May 19, 2023, 8:08pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/13 "2023-05-19T20:08:50Z")

</div>

Same, since plugins release.

Also, I have never been able to generate 8k in one go. Not even half of it.

Coding a cronjob now that will try until it succeeds. Plus combining the result to 8k…

Why release plugins and have free access to chatgpt when paying customers can’t use the api?

---

<div class="post-metadata">

**Author:** ![david.zitney](https://avatars.discourse-cdn.com/v4/letter/d/4da419/32.png) [@david.zitney](https://community.openai.com/u/david.zitney)\
**Post date:** [May 19, 2023, 8:17pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/14 "2023-05-19T20:17:38Z")

</div>

Same problem. Only ever succeeding when I limit to ~2k tokens. Tried with streaming enabled and still no success.

---

<div class="post-metadata">

**Author:** ![gastl.solange](https://avatars.discourse-cdn.com/v4/letter/g/5e9695/32.png) [@gastl.solange](https://community.openai.com/u/gastl.solange)\
**Post date:** [May 20, 2023, 5:03pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/15 "2023-05-20T17:03:50Z")

</div>

Pior comigo, paguei mês passado e fiquei 10 dias sem que tivesse uma resposta, tanto do GPT 3.5 quanto do GPT 4, e na véspera de nova cobrança voltou a funcionar, feliz com isso, fui e paguei outro mês, logo dia seguinte nada mais e já se arrasta por 20 dias (com exceção de um único dia que funcionou e nos limites), só dando erro, mando mensagens e mensagens via email e no próprio chat e o erro não é corrigido. Infelizmente nem nos limites tem sido liberado para mim, mesmo sendo PLUS. Penso até em cancelar.

---

<div class="post-metadata">

**Author:** ![zeki.unyildiz](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/zeki.unyildiz/32/32549_2.png) [@zeki.unyildiz](https://community.openai.com/u/zeki.unyildiz)\
**Post date:** [May 20, 2023, 6:22pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/16 "2023-05-20T18:22:31Z")

</div>

GPT-4 is typically slow, but there are times when I notice it’s even slower than usual. Because of this, I generally use GPT-3.5-turbo.

---

<div class="post-metadata">

**Author:** ![anon82082569](https://avatars.discourse-cdn.com/v4/letter/a/8dc957/32.png) [@anon82082569](https://community.openai.com/u/anon82082569)\
**Post date:** [May 20, 2023, 6:39pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/17 "2023-05-20T18:39:26Z")

</div>

Same here on 5/20. My customers are complaining about 504 errors for GPT-4. ChatGPT is still running quickly for us though.

---

<div class="post-metadata">

**Author:** ![SomebodySysop](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/somebodysysop/32/17613_2.png) [@SomebodySysop](https://community.openai.com/u/SomebodySysop)\
**Post date:** [May 20, 2023, 7:39pm UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/18 "2023-05-20T19:39:29Z")

</div>

> [@zeki.unyildiz](#):
>
> GPT-4 is typically slow, but there are times when I notice it’s even slower than usual. Because of this, I generally use GPT-3.5-turbo.

Same here. Also switched because of cost. But, at least this week, I noticed a LOT of timeouts with gpt-3.5-turbo: \* _The model is overloaded, retry or contact help center with request ID if error persists._

---

<div class="post-metadata">

**Author:** ![TomatoPotato](https://avatars.discourse-cdn.com/v4/letter/t/e9c0ed/32.png) [@TomatoPotato](https://community.openai.com/u/TomatoPotato)\
**Post date:** [May 22, 2023, 7:52am UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/19 "2023-05-22T07:52:23Z")

</div>

It’s also frustrating that I seem to be charged for these errored requests. At least they are stored in the history including completions that I never seen. I was doing a bunch of other requests(smaller testing requests) but I’m pretty sure I’ve spent a lot of tokens on these errors.  
Does anyone know if we are paying for them for sure?  
Also, at the same time playground was working pretty well with gpt-4 as well as the web bersion of chatgpt4

1 minute later update:

Come on OpenAI : ( not again

```auto
openai.error.Timeout: Request timed out: HTTPSConnectionPool(host='api.openai.com', port=443): Read timed out. (read timeout=600)

```

---

<div class="post-metadata">

**Author:** ![TomatoPotato](https://avatars.discourse-cdn.com/v4/letter/t/e9c0ed/32.png) [@TomatoPotato](https://community.openai.com/u/TomatoPotato)\
**Post date:** [May 22, 2023, 8:21am UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/20 "2023-05-22T08:21:56Z")

</div>

I think I’ve cracked it.  
It did not error when I used streaming. And both playground and chatGPT4 use streaming.  
My speed was around 328 tokens a minute.

Reference on how to use streaming  
github openai/openai-cookbook/blob/main/examples/How\_to\_stream\_completions.ipynb

---

<div class="post-metadata">

**Author:** ![rankoneads](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/rankoneads/32/28_2.png) [@rankoneads](https://community.openai.com/u/rankoneads)\
**Post date:** [May 22, 2023, 8:31am UTC](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341/21 "2023-05-22T08:31:20Z")

</div>

I can barely get a single output with gpt-3.5-turbo because it’s constantly timing out…

[Next page](https://community.openai.com/t/gpt4-api-very-very-slow-reaching-timeout/218341.md?page=2)
