Is this something you enable on a per-account level or on a per-API-token level? Is there a way to have existing integrations using streaming responses without usage info and then switch in a controlled way?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
OpenAi API - get usage tokens in response when set stream=True | 31 | 37890 | August 3, 2024 | |
Chat completion "stream" API token usage | 3 | 6337 | May 6, 2024 | |
Why there is no USAGE object returned with Streaming Api Call? | 20 | 5180 | February 20, 2025 | |
How to get token usage for each API call in streaming model? | 9 | 8355 | December 14, 2023 | |
How to calculate token usage using stream=True? | 13 | 3658 | December 28, 2023 |