GPT-4o Mind blowing speed on the API

API
1

Wow!!!

Don’t even need streaming for this… The responses for my use cases are more or less the same between Gpt-4 for Gpt-4o but with the speed I see on the API, it looks like streaming is not even needed for GPT-4o

Waiting for audio support in the API :slight_smile:

3 Likes
2

image
image548×757 18.9 KB

It takes me 12 seconds to get the response. Where am I going wrong?

3

Hi,
and what about function calling, is it faster?

4

I don’t know

Looks like javascript… have you tried streaming from a CURL request on a shell or with Node or something else?

I used CURL and streaming & it was super fast

5

No idea

I don’t use function calling … it isn’t needed for my use cases (yet)