I am trying to do a multilabel classification task but my model is failing after 1st epoch with an error
2023-07-21 12:39:22 Completed epoch 1/4
2023-07-21 13:09:26 Server error. Returning to queue for retry
The point here is I have fine-tuned the same dataset as non-classification problem. The error only came when treating it as a classification problem.
Can you share a bit more about the fine-tuning call or the data you are using ?
This is one example from the data it’s a classification task with 29 categories which are all numbered labels
{“prompt”:“Web Description: Surgical Scissors 5 5 in Mayo Straight Each\nShort Description: SCISSOR MAYO STRAIGHT BLU\nLong Description: Scissor Mayo Straight Blunt\n\n###\n\n”,“completion”:“16”}
Fine-tune command used:
openai api fine_tunes.create -t {training_file_id} -v {validation_file_id} --compute_classification_metrics --classification_n_classes {unique_completion_count} -m ada
The total records for training is around 3lakhs(training+ validation file) and the model used is ada. I am using such a large file for the first time as before I was training on smaller files. So is there a chance that the number of records is causing problems?
The point to note is the same file was used to fine-tune before but without the compute_classification_metrics and classification_n_classes parameters and it had worked