Finetune davinci and failed, API return no reason

API
1

My company want to build QA application like ChatGPT. I decide to finetune davinci using our data. I upload a tiny dataset containing prompts and completions. Then I call finetune API. It created successfully. After a while, I check its status. It shows failed with no reason.

{"data":[{"object":"fine-tune","id":"ft-UJhsw24xDvUmqVubv5ciNKev","hyperparams":{"n_epochs":4,"batch_size":8,"prompt_loss_weight":0.01,"learning_rate_multiplier":0.02},"organization_id":"org-mz5MwnZLaGb5TKkfntHWTYyC","model":"davinci","training_files":[{"object":"file","id":"file-BKDKPnPQlC5iemIdFtHWiyCE","purpose":"fine-tune","filename":"51ace3b8-0ff3-4b99-b1c1-0da76fd751491159521562657448935.jsonl","bytes":2387602,"created_at":1676356764,"status":"processed"}],"validation_files":[],"result_files":[],"created_at":1676356986,"updated_at":1676357385,"status":"failed"}],"object":"list"}

Could someone tell me the possible reason? Would it be that I didn’t provide billing method and the cost is not covered by free coins?

the training data sample
{"prompt": "我想让你担任老师，学生会向你提问，你的任务是尽可能准确、专业地回答他们的问题。\n\n问题: 奇怪，中国的柴油与欧洲的不同吗？在国内，只要是使用柴油的汽车或拖 \n答案: \n\n###\n\n", "completion": "这是理工科工程技术科学专业的问题，这在我们海道教育的课程中有提到。都不同，欧洲的油品充分加氢，把硫化物都出去了<br>比如中国油含硫是瑞典的200倍左右<br><br>还有欧洲的氮氧化物去除能力也强<br>欧洲汽车发动机精细，中国的粗油不能用<br><br>有些外国汽车进口中国，发动机标准需要降低 END"}

2

I think something’s wrong with the the API right now. I’m getting no end of 429 errors right now, though I am a paid customer and am sending nowhere near enough data to be at my rate limit.

3

I start another finetune today using curie. the problem still exists. The finetune shows status failed. But I find yesterday davinci finetune is being processed. I suppose all finetunes are being processed in a queue. I will check my two finetunes a little later.
{"data":[{"object":"fine-tune","id":"ft-UJhsw24xDvUmqVubv5ciNKev","hyperparams":{"n_epochs":4,"batch_size":8,"prompt_loss_weight":0.01,"learning_rate_multiplier":0.02},"organization_id":"org-mz5MwnZLaGb5TKkfntHWTYyC","model":"davinci","training_files":[{"object":"file","id":"file-BKDKPnPQlC5iemIdFtHWiyCE","purpose":"fine-tune","filename":"51ace3b8-0ff3-4b99-b1c1-0da76fd751491159521562657448935.jsonl","bytes":2387602,"created_at":1676356764,"status":"processed"}],"validation_files":[],"result_files":[],"created_at":1676356986,"updated_at":1676357385,"status":"failed"},{"object":"fine-tune","id":"ft-Hjg4twX8mQ399Hemj59NJuCE","hyperparams":{"n_epochs":4,"batch_size":8,"prompt_loss_weight":0.01,"learning_rate_multiplier":0.02},"organization_id":"org-mz5MwnZLaGb5TKkfntHWTYyC","model":"curie","training_files":[{"object":"file","id":"file-BKDKPnPQlC5iemIdFtHWiyCE","purpose":"fine-tune","filename":"51ace3b8-0ff3-4b99-b1c1-0da76fd751491159521562657448935.jsonl","bytes":2387602,"created_at":1676356764,"status":"processed"}],"validation_files":[],"result_files":[],"created_at":1676423690,"updated_at":1676424298,"status":"failed"}],"object":"list"}

4

I retrieve finetune status and I know why.
Message shows : Fine-tune failed. Fine-tune can not exceed $15 during free trial

1 Like