Doesn’t support reusable prompts or json schema. The docs don’t say anything about this either, I basically wasted time creating a pipeline and then trying to use it directly with batches. does anyone know if this is on the docket?

It does support json_schema - you can still get structured outputs in stringified form. Of course, the prereq is that you’re using a model that supports both Batch API and structured outputs, but that should be almost all the modern models nowadays (like gpt-4o, gpt-4.1, o3, and gpt-5). In each of y…

Batch API is terribly behind everything else

API Feedback

mshepard August 13, 2025, 11:43am 3

I just got official guidance from an openai rep via support telling me the batch api does not support jsonschema output

Topic		Replies	Views
Batching prompts still being recommended despite not Documentation api	5	2256	January 23, 2024
Batching with ChatCompletion not possible like it was in Completion API	17	23191	December 13, 2023
Batching with ChatCompletion Endpoint Documentation gpt-35-turbo , chat-completion , batching , rate-limit	11	34193	December 13, 2023
Issues with Rate Limiting and Batch Processing in OpenAI API Community api , batching	0	1938	November 11, 2023
Unable to Use Batch API with Structured Output API api , batch , structured-output , o4-mini	5	331	May 20, 2025

Batch API is terribly behind everything else

Related topics