Finetuning waiting indefinitely

Finetuning taking unusually long to start. It stalled on waiting status for like an hour. I thought it was a bug and cancelled the job and retried but that of course didn’t work

1 Like

+1 - 4o and 4.1 jobs that would schedule right after validation a week ago are now taking hours to schedule. The only jobs that I’ve seen schedule quickly this last week or so have been small jobs on GPT-4.1-mini. It would be good to know from @OpenAI_Support if this is a systemic bug, a reflection of increasing demand, a deprioritization of finetuning vs other services or another cause. Being able to anticipate finetuning latency affects labeling resources and workflow planning. Thanks.

For any others landing on this thread, my most recent 4o finetuning got scheduled and finished after 23 hours and 30 minutes.

3 Likes

Can you share what your queued time was by any chance? Mine has been on queued status for ~5hrs.

Just trying to get an idea of how long these take as I am new to training models via API opposed to on local or personal cloud compute.

I sent one through as a test with minimum dataset size requirements to see if it would complete faster but both are hanging for hours with no progress yet.

@kristopher1 a week ago I was seeing 4o fine-tuning validate, schedule and complete within 15 minutes. Yesterday/today, my latest job was stuck in “Waiting” for almost 24 hours. I have seen 4.1-mini jobs schedule much more quickly these last few days.

2 Likes

My job’s been stuck waiting for an hour and a half so far

About 10 hours later and still waiting. I think the 23,5 hour estimate is sounding pretty accurate

@yuri_eliakim-jb did your supervised ft job finished? I started one yesterday and is in “waiting…” state for 18 hours now

I have seen that it sometimes depends on when you launch your FT request.

I am based in the UK, and sometimes its quicker my late morning (west coast hasn’t woken up yet :sweat_smile:)

But have sometimes hit those numbers above.

FYI, my the supervised fine tunning took 19 hours to complete.

Yeah, eventually
When I woke up it was done
It was basically a full day, 21 hours

1 Like