I am using Assistant streaming API with gpt-4-turbo. My input token is almost 16K and after generating 3K tokens for output it stops generating output. Can someone tell where the issue is?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Why does chat completion API stop sometimes during generation? Max tokens not an issue | 2 | 1222 | February 2, 2024 | |
| Large JSON Responses from Assistant API are truncated | 5 | 909 | June 20, 2024 | |
| 4096 completion token limit with gpt-4o. Using assistant streaming API | 0 | 181 | July 20, 2024 | |
| Token overflow with code interpreter | 0 | 130 | July 15, 2024 | |
| Chat Gtp-4 timeout after about 10 successive calls | 0 | 405 | November 9, 2023 |