Hello, I am trying the api and playground with the same purpose and settings. I am using davinci to chat. But even in longer prompts playground returning within a second but api is returning nearly 4-5 seconds. Is there a setting or way to improve api performance? I am using free credits now. If …

Why is Api Slower Than Playground?

kareem.kudus June 7, 2024, 5:42pm 9

I’ve noticed that when I run the same request in the playground, it is 5-10x faster than in the API. Anyone have an idea why this might be? Thanks!

Topic		Replies	Views
GPT (gpt4) API works much slower than Playground API gpt-4	2	817	December 16, 2023
Let's compare our API speed? It's too slow! API gpt-4 , gpt-35 , gpt-35-turbo , api , playground	9	1912	October 29, 2023
Why is GPT 4's response and performance on playground is so different from when using chatgpt 4 API gpt-4	12	9186	December 16, 2023
Slow Chat api responses ------ API	17	6442	December 24, 2023
GPT-4 API slower than ChatGPT Plus? API gpt-4	2	1900	May 8, 2023