Getting longer response times too for davinci on 003 over 002. It’s causing timeout limits on my serverless functions so while it’s producing better content it’s maybe not so useful because it’s taking so long to respond.
It would be good to get some update from the OpenAI team, I know it’s new so may be teething problems?
Davinci-003 provides a longer output on average as well. Did you factor this into your response times? Longer outputs generally take longer, so that could be part of it, in addition to higher quality outputs.
I’m having similar experiences with 003 when it comes to response times. Output is consistently better, but at times takes quite long to load. Then, other times, it’s as fast as 002. The length of the output does not really seem to be a factor here, sometimes it takes a few seconds even for a simply reply.
Is this known and intended? Or something that can and will be improved upon?
Is anyone experiencing a much longer response time to your app? We have an app and the response time has gotten worse. Interestingly enough some of our competitor’s response time is faster. Any do’s and don’t to minimize the response time?