# Davinci-text-003 Response Times

**URL:** <https://community.openai.com/t/davinci-text-003-response-times/23357>\
**Category:** API\
**Created:** [November 29, 2022, 1:20pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357 "2022-11-29T13:20:54Z")\
**Posts on this page:** 15\
**Page:** 1

<div class="post-metadata">

**Author:** ![sahin.senol3](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/sahin.senol3/32/13251_2.png) [@sahin.senol3](https://community.openai.com/u/sahin.senol3)\
**Post date:** [November 29, 2022, 1:20pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/1 "2022-11-29T13:20:54Z")

</div>

Today i made couple of test using davinci-text-002 and davinci-text-003.

I am using Google App Script to send the requests to openai. So basically i am getting prompts from different cells and sending API request one by one…

Here is the results:

**davinci-text-002:**

1st prompt: 3 sec  
2nd prompt: 2 sec  
3rd prompt: 2 sec  
4th prompt: 4 sec  
5th prompt: 2 sec  
6th prompt: 7 sec !  
7th prompt: 1 sec  
8th prompt: 3 sec

Total: 24 sec.

**davinci-text-003:**

1st prompt: 4 sec  
2nd prompt: 4 sec  
3rd prompt: 3 sec  
4th prompt: 9 sec !!  
5th prompt: 3 sec  
6th prompt: 12 sec !!!  
7th prompt: 4 sec  
8th prompt: 15 sec !!!

Total: 54 sec.

Seems like there is huge difference in terms of response time.

Does anyone know what might be the reason? I mean, i am sending exact same prompts but 002 responding me in total of 24 seconds whereas 003 response time is 54 seconds. More than double. Any thoughts?

---

<div class="post-metadata">

**Author:** ![nl.lorenz](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/nl.lorenz/32/12387_2.png) [@nl.lorenz](https://community.openai.com/u/nl.lorenz)\
**Post date:** [November 29, 2022, 7:53pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/2 "2022-11-29T19:53:02Z")

</div>

Yes I have made a similar experience. The response times are signifcantly longer.

---

<div class="post-metadata">

**Author:** ![PaulBellow](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/paulbellow/32/597962_2.png) [@PaulBellow](https://community.openai.com/u/PaulBellow)\
**Post date:** [November 29, 2022, 11:34pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/3 "2022-11-29T23:34:34Z")

</div>

While I don’t work for OpenAI, and I don’t have inside details, I would guess the higher quality output (including longer) is responsible for the increased time. I’m sure it’s a balancing act…

---

<div class="post-metadata">

**Author:** ![kitson.broadhurst](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/kitson.broadhurst/32/13268_2.png) [@kitson.broadhurst](https://community.openai.com/u/kitson.broadhurst)\
**Post date:** [November 30, 2022, 3:54pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/4 "2022-11-30T15:54:25Z")

</div>

Getting longer response times too for davinci on 003 over 002. It’s causing timeout limits on my serverless functions so while it’s producing better content it’s maybe not so useful because it’s taking so long to respond.  
It would be good to get some update from the OpenAI team, I know it’s new so may be teething problems?

---

<div class="post-metadata">

**Author:** ![smith1302](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/smith1302/32/9314_2.png) [@smith1302](https://community.openai.com/u/smith1302)\
**Post date:** [November 30, 2022, 5:52pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/5 "2022-11-30T17:52:32Z")

</div>

Davinci-003 provides a longer output on average as well. Did you factor this into your response times? Longer outputs generally take longer, so that could be part of it, in addition to higher quality outputs.

---

<div class="post-metadata">

**Author:** ![duerr.simon](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/duerr.simon/32/13274_2.png) [@duerr.simon](https://community.openai.com/u/duerr.simon)\
**Post date:** [December 4, 2022, 3:24pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/6 "2022-12-04T15:24:36Z")

</div>

I’m having similar experiences with 003 when it comes to response times. Output is consistently better, but at times takes quite long to load. Then, other times, it’s as fast as 002. The length of the output does not really seem to be a factor here, sometimes it takes a few seconds even for a simply reply.

Is this known and intended? Or something that can and will be improved upon?

---

<div class="post-metadata">

**Author:** ![jonathan.sabbah](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/jonathan.sabbah/32/11869_2.png) [@jonathan.sabbah](https://community.openai.com/u/jonathan.sabbah)\
**Post date:** [December 4, 2022, 5:25pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/7 "2022-12-04T17:25:44Z")

</div>

Same problem here, if that’s a bug from openai a quick fix would be appreciated 😅

---

<div class="post-metadata">

**Author:** ![duerr.simon](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/duerr.simon/32/13274_2.png) [@duerr.simon](https://community.openai.com/u/duerr.simon)\
**Post date:** [December 4, 2022, 6:04pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/8 "2022-12-04T18:04:32Z")

</div>

Just a few minutes ago I tried again, and this time 003 responded much faster! Similar to 002. Maybe something was fixed already? At least I know it can be fast now 😅

// brief update: today I experienced some longer response times again. It seems to fluctuate (… based on load on their api? 🤷‍♂️)

---

<div class="post-metadata">

**Author:** ![jonathan.sabbah](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/jonathan.sabbah/32/11869_2.png) [@jonathan.sabbah](https://community.openai.com/u/jonathan.sabbah)\
**Post date:** [December 5, 2022, 8:02pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/9 "2022-12-05T20:02:26Z")

</div>

Maybe the large amount of trafic coming for ChatGPT (I read that they get to 1m users!) is taking a part of the processing power that is normally dedicated for instructGPT

---

<div class="post-metadata">

**Author:** ![duerr.simon](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/duerr.simon/32/13274_2.png) [@duerr.simon](https://community.openai.com/u/duerr.simon)\
**Post date:** [December 6, 2022, 8:16am UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/10 "2022-12-06T08:16:28Z")

</div>

Seems like that’s what’s happening. Just interesting that davinci-002 is not affected; apparently 003 and chatGPT share some infrastructure in that case.

---

<div class="post-metadata">

**Author:** ![atulsingh](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/atulsingh/32/10451_2.png) [@atulsingh](https://community.openai.com/u/atulsingh)\
**Post date:** [December 24, 2022, 2:05pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/11 "2022-12-24T14:05:08Z")

</div>

My Article writer tool started showing Timeout error since last 2-3 days. Earlier it was generating awesome results on davinci-003. Any resolution to this apart from moving back to davinci-002?

P.S. Other tools working fine on davinci-003 however, being generating a longer output, the Article writer tool is experiencing Timeout.

error- Failed to load resource: the server responded with a status of 524 ()

---

<div class="post-metadata">

**Author:** ![danrasmuson](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/danrasmuson/32/6985_2.png) [@danrasmuson](https://community.openai.com/u/danrasmuson)\
**Post date:** [December 28, 2022, 5:04pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/12 "2022-12-28T17:04:03Z")

</div>

Presently I’m receiving ~23.968s response times on text-davinci-003 create-completion. Does the OpenAI team have a response time SLA on this endpoint?

I’m hoping for an update on the status page for these large response times as it really impacts the applications we are building.

---

<div class="post-metadata">

**Author:** ![iCopy](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/icopy/32/618_2.png) [@iCopy](https://community.openai.com/u/iCopy)\
**Post date:** [January 16, 2023, 10:25pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/13 "2023-01-16T22:25:11Z")

</div>

Is anyone experiencing a much longer response time to your app? We have an app and the response time has gotten worse. Interestingly enough some of our competitor’s response time is faster. Any do’s and don’t to minimize the response time?

---

<div class="post-metadata">

**Author:** ![alex.batista](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/alex.batista/32/17048_2.png) [@alex.batista](https://community.openai.com/u/alex.batista)\
**Post date:** [January 20, 2023, 4:30pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/14 "2023-01-20T16:30:02Z")

</div>

@logankilpatrick and his team added a section in the documentation regarding this subject. The are good tips about it:

> **[OpenAI API](https://beta.openai.com/docs/guides/production-best-practices/improving-latencies)**
>
> An API for accessing new AI models developed by OpenAI

Thanks again @logankilpatrick

---

<div class="post-metadata">

**Author:** ![EricGT](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ericgt/32/20571_2.png) [@EricGT](https://community.openai.com/u/EricGT)\
**Post date:** [December 25, 2023, 6:53pm UTC](https://community.openai.com/t/davinci-text-003-response-times/23357/15 "2023-12-25T18:53:05Z")

</div>


