OpenAI Evaluation is not free

this still charges you

the way it works on the local repository, is that you get charged per api request.

I found the post that announced here in the community about it…

as you can see it says

Through the end of the year, developers can run evaluations for free (up to 7 per week) when they opt in(opens in a new window) to share their Evals with OpenAI. Evals shared with us will be used to help us improve and evaluate our future models.

maybe it has to do with the model used?

also, it seems it says:

2M free training tokens per day on GPT-4o mini and 1M free training tokens per day on GPT-4o until October 31

so that covers a couple of requests, you can check tokenizer to count your requests I guess. I’m sure there’s some python packages for this

you can reply on that community post to see if you get a reply there or search for help.openai.com, like @paulbellow said if you think there is something wrong

1 Like