Is is possible to Stream Structured Output with Pydantic?

[expertise.ai.chat]

Take a look at this post.

Streaming using Structured Outputs

Maybe I’m missing something, but I had no issues streaming output from the structured outputs API in a simple way. The client.beta.chat.completions object has a .stream method seemingly tailor-made for this. e.g. this function I created works perfectly fine, and extracts the cumulative streamed response, as well as the final token usage from openai import OpenAI # Generator def openai_structured_outputs_stream(**kwargs): client = OpenAI() with client.beta.chat.completions.stream(**kw…