Is there any way to increase token limits on embeddings? or have a queue order where it works the batches of. Currently facing this all the time:
Enqueued token limit reached for text-embedding-3-large in organization org-xxxxxxxxx. Limit: 500,000,000 enqueued tokens. Please try again once some in_progress batches have been completed.
i need to check every few hours wrote some custom scripts for resubmitting but i think this is all lazy and cost time. any way to make this go faster