I’m finding that it’s taking around 90sec currently for one completion with GPT-3.5. Anyone know if it’s any faster with the Azure OpenAI Service?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Chat GPT's API is significantly slower than the website with GPT Plus | 35 | 36851 | December 12, 2023 | |
Gpt-4-0125-preview INCREDIBLY slower than 3.5 turbo | 12 | 9590 | July 22, 2024 | |
Let's compare our API speed? It's too slow! | 9 | 1930 | October 29, 2023 | |
GPT-3.5 API is 30x slower than ChatGPT equivalent prompt | 69 | 13989 | November 30, 2023 | |
GPT-3.5 Turbo API response is slow | 20 | 12505 | November 11, 2023 |