I ran several batch API jobs today and was surprised when I ran out of credits. I looked at my spend categories and realized that my most recent batch API jobs have been categorized and billed as requests to the regular API, instead of the discounted batch API rate.
I haven’t used the real-time API at all in months. The batch jobs are completing successfully (if given enough credits), but are being categorized as real-time API spend. I was able to replicate this issue with a smaller batch job and confirmed that my real-time API spend gradually increased as the batch processed, even though I only submitted it via the batch API in the dashboard.
I need a refund of roughly $27.85 and would like to know why this happened.
Issue: Fine-tune model via batch billed as chat completions
I’ll flag your post, not for a violation, but with a message to alert a forum mod that this is an API fault that may go beyond just your account.
Refund: For an account-specific issue, where you need to privately communicate your organization details for also requesting a credit charge reversal, you would need to press “help” in the platform site, send a message saying why you need action taken and not some AI reply, and hold tight. You may wish to include batch IDs as “proof” so they don’t have to go searching.
(I could attempt to replicate, but results wouldn’t be timely)
Background: other bugs have revealed that there is a special modelname-batch model that the batch endpoint converts to and uses internally to employ a discount.
Thanks again for reporting. The issue is resolved so new batches will be billed correctly. We will issue refunds soon for requests that were impacted by this issue!
