Do we also have streaming support for azure openai for o1-preview

API
1

Do we also have streaming support for azure openai for o1-preview? I’m asking because I now open ai released streaming support for the standard API.

1 Like
2

Yes, Azure OpenAI Service supports streaming for the o1-preview model, similar to OpenAI’s standard API. This will provide real-time token-by-token responses for improved latency. Be sure to enable streaming in your API requests.

3

Unfortunately I’m still getting “An error occurred: Error code: 400 - {‘error’: {‘message’: “Unsupported value: ‘stream’ does not support true with this model. Only the default (false) value is supported.”, ‘type’: ‘invalid_request_error’, ‘param’: ‘stream’, ‘code’: ‘unsupported_value’}}”

When I do it with the Open AI API the issue does not occur. I also upgraded to the last version in python open ai package.

4

Yeah facing the same issue. OpenAI platform supports o1 streaming, Azure OpenAI doesn’t yet
Any workarounds ?

1 Like