Usage stats now available when using streaming with the Chat Completions API or Completions API

[conciergeai]

The same is happening to me:

Issue with Token Usage in Streaming Responses

I’m encountering an issue with obtaining token usage information when streaming responses from the OpenAI API. According to the Api Docs,token usage should be included in the response chunks when using the stream_options parameter. Here’s my setup: API Version: openai==1.38.0 Python Version: 3.11.3 I’ve tried using both asynchronous and synchronous OpenAI client configurations: from openai import AsyncOpenAI from openai import OpenAI #client = AsyncOpenAI(api_key=os.getenv("OPENAI_API_KE…