I haven’t observed any significant improvement . With streaming it’s just that in the UI, a user now doesn’t have to wait for the entire response to be displayed. It helped me improve the user experience.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Using Streaming Assistants API With Websockets | 9 | 856 | January 21, 2025 | |
Has anyone managed to get a tool_call working when stream=True? | 22 | 19438 | May 24, 2024 | |
[Critical] Over 25% Assistant API Request Timeout Randomly | 81 | 5696 | March 18, 2024 | |
Streaming from Text-to-Speech api | 53 | 50935 | January 21, 2025 | |
Multiple function calls with streaming | 6 | 4551 | April 5, 2024 |