Fine-tuning Safety Evaluation Error

Hi,

I am trying to fine-tune gpt-4o mini with a custom dataset. After the model is fine-tune I get this error: Error while running moderation eval refusals_v3 for snapshot ####: Error while running eval for category hate for snapshot ###. Please try again.

Does anyone know why this happens?

6 Likes

Even I have been facing similar refusals_v3 errors in last few days for different model trainings.
Few other category provided in this message were illicit, sexual etc.,

I would really appreciate any help in this regard.

4 Likes

I have the same issue (didn’t have it last week). I am fine-tuning gpt-4.1-nano on data that is not linked to this topics.
Is there a workaround to this?

It seems there is something wrong with SFT jobs.

Same issues. And the monitoring takes a lot of time

2 Likes

Hi, and thanks for flagging this!
OpenAI has rolled out an update to prevent this from happening again.
You may need to wait a day or two before retrying a previously rejected job, but new jobs should work fine.

If the issue persists, please let us know here.

1 Like