I’ve recently been experimenting with the fine-tuning capabilities of the GPT-4o model. While I understand that it’s currently not possible to include images in the fine-tuning data for GPT-4o, I was surprised to find that the fine-tuned model lost its ability to accept images altogether.
When including base64 image in the prompt the fine-tuned model responds with Invalid content type. image_url is only supported by certain models.
Did anyone experience similar issues, or did anyone manage to send image to the fine-tuned GPT-4o model?
Yeah, I’ve seen this happen before. Fine-tuning GPT-4 seems to disable its ability to handle images since that part isn’t included in the process. Sticking to the base model is probably your best bet if you’re working with images. You’re not the only one running into this issue!