🐢 : GPT4 extremely slow on GPT4 API and ChatGPT

[jwatte]

Here’s our API performance for GPT-3.5-turbo over the last month:

The data are somewhat noisy, but clearly an upwards trend. The type of inference hasn’t changed and the size of each request hasn’t changed.