Fine-tuned model does not support image message content types with Assistants API

[zorangrete]

I get this error when submitting image type messages to the API when using a fine tuned model:

raise self._make_status_error_from_response(err.response) from None
openai.BadRequestError: Error code: 400 - {‘error’: {‘message’: ‘Invalid model: ft:gpt-4o-2024-08-06:personal::AJMD5QXL does not support image message content types.’, ‘type’: ‘invalid_request_error’, ‘param’: ‘model’, ‘code’: ‘invalid_type’}}

I tried both fine tuning the model with and without image data. Note, that I’m using the Assistants API

Edit: The base model does not have this issue, just after fine tuning this happens (for me as well as @uudmrci )

[sps]

@zorangrete

Thanks for flagging the issue.

[eyildirimdev]

We are having the same issue, gpt-4o-2024-08-06 model works with image content types while our fine tuned model doesn’t work through the API, we can however get it worked with images on the dashboard.

status code 400 Invalid model: ft:gpt-4o-2024-08-06:xxx:yyyy:xxxx does not support image message content types.

[uudmrci]

@sps

I have the same issue fine tuned model does not get image input via Assistants API Although it get images via dashboard (playground)
Is this a bug to be fixed or this will be a new capability in the Assistants APı that we need to wait to be released

[uudmrci]

it is weird the base models can get the same image via Assistants but if fine tuned gives the error

[noxford.96]

I am also having this account

• Fine tuned a 4o model with images
• Use that model with my assistant
• Playground throws error when passing in image

run: Invalid model: ft:gpt-4o-2024-08-06:personal:ski-qst:ALB8SOLo does not support image message content types

I am able to use the fine tune model, while passing in an image, through the chat playground

[xiangmaace]

I have the same problme whit my account

Error streaming run: Invalid model: `ft:gpt-4o-2024-08-06:ppai:fine2-1:AL54LbwT` does not support image message content types.

I can use the fine tune model in chat playground with image content,
but it’s error when I use it in assistant playground or assistant api with image

[uudmrci]

Maybe it is not a bug finetuned models does not serviced to Assistants API for images purposefully. Lets see

[alvaro.lasernalopez]

Same issue for me… would be nice if they would fix this, or if they would inform if it’s not going to work for finetuned models for some reason.

[andres.ivan.2609]

Same problem

[zorangrete]

Update: I now tried a model I trained on friday last week, but in the Chat playground and there it works, but not in the Assistants playground

[uudmrci]

So still no update in this issue then