What's the new tokenization algorithm for gpt-4o?

Thanks.

I’ve found the encoding file: https://openaipublic.blob.core.windows.net/encodings/o200k_base.tiktoken

4 Likes