Realtime API / Tokens per second?

francesco.queres October 6, 2024, 10:02am 1

Hello
I am trying to find information/data about the number of toekns per second delivered for each model, in order to get some performance figures.
Thanks for your insight
FQ

Topic		Replies	Views
What's the best way to benchmark tokens/sec of fine-tuned model? API fine-tuning	2	3565	September 21, 2023
Realtime API Pricing Query Community pricing , realtime	1	96	November 25, 2024
Gpt-4o tokens per second comparable to gpt-3.5-turbo. Data and analysis API gpt-4 , gpt-35-turbo , playground , gpt-4-turbo , gpt-4o	3	11252	August 16, 2024
Is max token limit per endpoint or model? API gpt-35-turbo , chatgpt , rate-limit	1	1523	June 29, 2023
Gpt-4o rate limits being 30k tpm and 90k tpd does that mean I can only do 90k tokens in a day? API rate-limit	1	167	November 23, 2024

Realtime API / Tokens per second?

Related topics