Is it possible to set the response_format as json when using the assistant api instead of the classic chat api?
Doesn’t seem to be a way to do it in the docs, but seems silly since you can set files, tools, system messages, and more at the assistant, thread, and message level when using assistant api.
I have noticed that the instruction following capability of the Assistant is poor. I have requested it to return the answer in JSON format, but it still outputs some other information.
This really limits the usefulness of the assistant API in situations where I need to be able to inject structured data. Are there any plans to add this?
@robmartin You can take the response from the Assistant and then run it through the chat api to have it format it in JSON for you. Should work for the time being at least until they add it into the Assistant API.