Hi, does anyone know if it is possible to use assistants API with the batching API? It would save us a lot of tokens. I couldn’t find anything in the docs or in the forum.
Hi welcome not sure how that would be possible since the batch API is just for chat competitions that don’t need near real time responses such as batch jobs.
Assistants API requires assistants to be ran on a thread which I don’t see support for in the batch API I don’t think they are compatible.
Does anyone know if OpenAI will make the Batch API also work with the Assistants API in the future, and if so, how soon that might come?