Today we announced our new flagship model that can reason across audio, vision, and text in real time—GPT-4o. We are happy to share that it is now available as a text and vision model in the Chat Completions API, Assistants API and Batch API!
It includes:
High intelligence
GPT-4 Turbo-level performance on text, reasoning, and coding intelligence, while setting new high watermarks on multilingual, audio, and vision capabilities. You can find detailed eval results in our open source simple-evals GitHub repo.
2x faster
GPT-4o is 2x faster at generating tokens than GPT-4 Turbo.
GPT-4o will have 5x the rate limits of GPT-4 Turbo—up to 10 million tokens per minute. (We’re ramping up rate limits to this level in the coming weeks for developers with high usage.)
Improved vision
GPT-4o has improved vision capabilities across the majority of tasks.
Improved non-English language capabilities
GPT-4o has improved capabilities in non-English languages and uses a new tokenizer which tokenizes non-English text more efficiently than GPT-4 Turbo.
GPT-4o has a 128K context window and has a knowledge cut-off date of October 2023.
Finally, in terms of modalities:
GPT-4o in the API supports understanding video (without audio) via vision capabilities. Specifically, videos need to be converted to frames (2-4 frames per second, either sampled uniformly or via a keyframe selection algorithm) to input into the model. Check out the Introduction to GPT-4o cookbook to learn how to use vision to input video content with GPT-4o today.
GPT-4o in the API does not yet support audio. We hope to bring this modality to a set of trusted testers in the coming weeks.
GPT-4o in the API does not yet support generating images. For that, we still recommend the DALL-E 3 API.
We recommend everyone using GPT-4 or GPT-4 Turbo evaluate switching to GPT-4o! To get started, check out our API documentation or try it out in the Playground (which now supports vision and comparing output across models!)
Thank you for releasing GPT-4.o! We have been eagerly anticipating this update for quite some time. However, I’ve noticed a few issues right away. Firstly, GPT-4.o often misunderstands prompts and incorrectly refers to itself as GPT 4.0.
Additionally, I am unable to find the direct download link for ChatGPT on MacOS.
At AI^Infinity, we use ChatGPT daily and rely on it to deliver the best possible responses. Each update significantly improves the quality of our predictions. Thank you once again, and we are very excited to see what else will be released later this year.
I’m really excited for the things that can be created with 4o! Looking forward to utilizing the API and the rollout of voice support soon. Keep killing it
Is there any information about GPT-4o’s specific limitations and restrictions? I want to try it, but risking something unobvious would danger my main account. So yeah, any information about its limitations and restrictions would be very helpful! My job would require me sooner or later though through my enterprise account.
On another note, why is it named 4o? not GPT 4.5 or GPT 5? Hmm…
The model uses a larger token encoding dictionary, meaning the output can be more efficient at producing text, especially in Eastern languages. A Japanese “how to make takuan” response is almost 25% less tokens in the new encoder (and thus fees billed per token).
ow, i think i got it. it seemed like i was talking about the model itself, and not about the size of the tokens. sorry.
@_j i see… makes sense, the same token length but more words for those 128k. for my language it is a little bit similar to english but it could improve anyway. nice.
High intelligence 
2x faster 
50% cheaper pricing 
5x higher rate limits 
Improved vision 
Improved non-English language capabilities 
