Gpt-3.5-turbo-0125 tier5 TPM limit

API
1

Hi,

I currently am tier4 and TPM for gpt-3.5-turbo-0125 is 250K - so I am considering upgrading to tier5 by buying credits - but, does anyone know what’s exactely is the TPM rate limit for gpt-3.5-turbo-0125 tier5?

Thank you,
Piercarlo

2 Likes
2

Welcome to the community!

You just need to click Tier 5 to see the limits…

image
image973×717 12 KB

3 Likes
3
MODEL RPM RPD TPM TPD
gpt-4 10,000 - 300,000 -
gpt-4-turbo-preview * 10,000 - 600,000 -
gpt-4-vision-preview * 3000 50,000 300,000 -
gpt-3.5-turbo 10,000 - 2,000,000 -
text-embedding-ada-002 10,000 - 10,000,000 -
whisper-1 500 - - -
tts-1 500 - - -
tts-1-hd 20 - - -
dall-e-2 500 img/min - - -
dall-e-3 50 img/min - - -

Source: https://platform.openai.com/docs/guides/rate-limits?context=tier-five

1 Like
4

Hi guys, thank you for the hints!

However, maybe I miss something, but the model gpt-3.5-turbo-0125 it’s not listed - and turns out that - at least for tier4 - has specific and differnt limits… you have to look at the Limits Section of your account dashboard in order to find out this specific info (not listed in the docs for the time being).

Does anyone have tier5 and can share the TPM of gpt-3.5-turbo-0125? Just open https://platform.openai.com/account/limits and then click “show all models”.

Cheers,
Piercarlo

2 Likes
5
Model Token limits Request and other limits
Chat
gpt-3.5-turbo 2,000,000 TPM 10,000 RPM
gpt-3.5-turbo-0125 250,000 TPM 3,000 RPM
gpt-3.5-turbo-0301 2,000,000 TPM 10,000 RPM
gpt-3.5-turbo-0613 2,000,000 TPM 10,000 RPM
gpt-3.5-turbo-1106 2,000,000 TPM 10,000 RPM
gpt-3.5-turbo-16k 2,000,000 TPM 10,000 RPM
gpt-3.5-turbo-16k-0613 2,000,000 TPM 10,000 RPM
gpt-3.5-turbo-instruct 250,000 TPM 3,000 RPM
gpt-3.5-turbo-instruct-0914 250,000 TPM 3,000 RPM

I believe gpt-3.5-turbo will point to gpt-3.5-turbo-0125 soon if it’s not already? Interesting it’s a lot smaller…

1 Like
7

Damn, still 250K even for tier5.

Still not pointing to gpt-3.5-turbo-0125:
“Customers using the pinned gpt-3.5-turbo model alias will be automatically upgraded from gpt-3.5-turbo-0613 to gpt-3.5-turbo-0125 two weeks after this model launches.”

Maybe it’s just a matter of rollout of the new model… So, we just have to wait.

Thank you Paul,
Cheers
Piercarlo

8

I wish OpenAI was more responsible with this.

It is not only impossible to find gpt-3.5-turbo-0125 TPM limit for a tier you are not in, but also nothing is mentioned about the far smaller limit when compared to the current gpt-3.5-turbo and if that’s going to change when gpt-3.5-turbo points to gpt-3.5-turbo-0125 (where they fail to provide an exact date as well)

9

It seems the model was given “default limit for all other models” at the very bottom of rate limits.

gpt-3.5-turbo-instruct also seems to have this oversight, not keeping up with other turbos.

10

All,

FYI, just checked, right now gpt-3.5-turbo-0125 has 1M TPM in tier4.

3 Likes