Is the 11 million complimentary tokens per day compatible with batch requests?

API
1

I’ve sent batch files with GPT-4o-mini but the usage tab shows costs as usual for this, even though I’ve enabled sharing prompts and got the “You’re enrolled for up to 11 million complimentary tokens per day” message in data sharing. If batch isn’t supporting this, it’d be good to clarify it.

Thanks,

2 Likes
2

Maybe the problem is elsewhere - I tested regular API queries for gpt-4o-mini and they also seem to be billed. I’ll report back if I learn anything new or if it starts working.

1 Like
3

In the dashboard, charges show up in the “Monthly Spend”, but they aren’t actual charges …. look at both “Spend by Project” and your actual total spend amount for the month, and they don’t go up.

2 Likes
4

Thanks for the reply @curt.kennedy . Charges show up in all of these places for both regular and batches gpt-4o-mini queries.

I did further testing, and regular queries to gpt-4o aren’t getting billed in the same way and don’t seem to show up anywhere in the dashboard.

There’s a small chance that somehow the dashboard is slower to update than usual, but it seems more likely that “gpt-4o-mini” is still getting billed as usual, and “gpt-4o” benefits from the complimentary offer.

1 Like
5

ok scratch that, the only things that seem to not get billed are regular gpt-4o requests. Batch gpt-4o is getting billed as well.

I’m definitely seeing “Spend by Project” increase for all other request types.

1 Like
6

Alright I hope final update - for some reason earlier regular gpt-4o requests weren’t showing, but now they are. I was using older User API keys, but regular API keys also have that issue for me.

So in my case it looks like I’m either not understanding the system, or not getting the complimentary tokens.

1 Like
7

Can you do an ‘o1’ call. Which model do you get? Is it the newer 2024-12-17 model? Maybe this has something to do with it.

1 Like
8

gpt-4o: gpt-4o-2024-08-06
gpt-4o-mini: gpt-4o-mini-2024-07-18

o1 I don’t think I’ve got access to, o1-preview goes to o1-preview-2024-09-12

I configured the data sharing yesterday, so maaaybe there’s just a long delay in configs being applied to accounts?

1 Like
9

Hi @Swah - Sent you a DM!