GPT-4o Mind blowing speed on the API


Don’t even need streaming for this… The responses for my use cases are more or less the same between Gpt-4 for Gpt-4o but with the speed I see on the API, it looks like streaming is not even needed for GPT-4o

Waiting for audio support in the API :slight_smile:


It takes me 12 seconds to get the response. Where am I going wrong?

and what about function calling, is it faster?

I don’t know

Looks like javascript… have you tried streaming from a CURL request on a shell or with Node or something else?

I used CURL and streaming & it was super fast

No idea

I don’t use function calling … it isn’t needed for my use cases (yet)