No in progress batches but got " Enqueued token limit reached"

API Bugs
1

I’m using batch and got this error. I am very sure of no in progress batches. Why do I got this error?

Enqueued token limit reached for ft:gpt-4o-mini-2024-07-18:personal:f*** in organization org-a***hlh. Limit: 2,000,000 enqueued tokens. Please try again once some in_progress batches have been completed.

1 Like
2

One possible solution: set the max_completion_tokens to as small as possible.
After setting it to 128, although I still encounter the same error, I don’t need to wait for a whole day for it. Just an hour later I can submit another batch to run.

Let’s hope it will be entirely solved when I am in Tire 3 level of API

1 Like
3

I got the same problem. it happened after I tried to send in a batch that was too big. It failed with the error “This batch contains more than the 50,000 maximum number of requests.” so I tried sending in one that had only 20,000. But now I get the error “Limit: 2,000,000 enqueued tokens. Please try again once some in_progress batches have been completed.”, even though there are no in_progress batches, there is only the failed one.

4

Wait for 24h then try again by adding “max_completion_tokens” in the batch json.