Our ChatGPT completion stream stops after 3-5 responses. Our stream is set to true. It stops after a few tokens returned. Anyone else having this issue?
You might be running into token limits (if your prompt is very large). You could also be running into a rate limit, have some unintended stop sequences, or network issues. I can’t really narrow it down without seeing your code.
Thanks Freddy! Appreciate it. What could cause the unintended stop sequences?