Super-high token usage with gpt-4o-mini and image

API
,
3

OMG! That’s terrible! I just confirmed the cost through the API:

Array
(
[id] => chatcmpl-9myEamJ1m3AGLWi9FuqJtBQItE5Fi
[object] => chat.completion
[created] => 1721458312
[model] => gpt-4o-mini-2024-07-18
[choices] => Array
(
[0] => Array
(
[index] => 0
[message] => Array
(
[role] => assistant
[content] => 10. Sick Leave

Modify Article 9 of the Local #161 Motion Picture Theatrical and TV Series Production Agreement (and make conforming changes to Article 41 of the Local #161 Supplemental Digital Agreement) as follows:

"ARTICLE 9. SICK LEAVE

“(a) Paid Sick Leave in the State of New York: The following is applicable only to employees working under this Agreement in the State of New York:

“(1) Commencing employees shall accrue one (1)
)

                [logprobs] => 
                [finish_reason] => stop
            )

    )

[usage] => Array
    (
        [prompt_tokens] => 14378
        [completion_tokens] => 101
        [total_tokens] => 14479
    )

[system_fingerprint] => fp_611b667b19

)

True that!

While the cost and speed is great, the performance for some tasks (like the one above) is far inferior.

But, this is insane! At 14,000 tokens an image, I can only upload less than 10 pages before I exceed the 128K token limit. We’re not talking images of cats or ducks, but documents. You know, like they use in business?

Come on OpenAI, say it ain’t true!

2 Likes