I’m using the batch API (Python) and encountering the following error:
code='token_limit_exceeded', line=None, message='Enqueued token limit reached for gpt-4o in organization XXX. Limit: 90,000 enqueued tokens. Please try again once some in_progress batches have been completed.', param=None)
I currently don’t have any in_progress
batches (all previous batches are completed or failed), and it’s been over 24 hours since I first received this error.
- When can I expect access to the batch API again (i.e., when will the TPD limit reset)?
- Is there a way to retrieve the remaining tokens for the TPD limit via the API (e.g.,
x-ratelimit-remaining-tokens
)? If so, how?