I’ve noticed in the last few days that api calls using gpt-4o are hanging after the first chunk is received. I don’t think this was happening previously. Whats weird is as soon as the second chunk comes back the entire payload is right behind it, similar to a non-streaming request. Anyone see me d…

Perhaps the Azure content_filter running on the output, processing in long moderation pieces? I’ve seen vision models and others return bursts of chunks but not chunks longer than tokens or multi-character tokens on OpenAI. Current chunk timing (me downloading the URL and sending base64): Prompt…

GPT4o Hangs after first chunk

API

beall3 June 4, 2024, 10:54pm 6

yeah looks like azure, same behavior using curl and no-buffer…

Topic		Replies	Views
In GPT4 streamed responses all chunks come in a single batch API streaming	4	2983	June 7, 2024
Issue with Chunk Streaming in ASP.NET Core using GPT-4 API API chatgpt , api , streaming	0	957	January 30, 2024
Streaming events returned bunched up Bugs	8	198	July 19, 2024
How to speed up GPT4 generation Feedback gpt-4 , chatgpt , api	10	5993	January 29, 2024
Malformed streaming answers from GPT-4 completions API lately API	11	2264	November 13, 2023

GPT4o Hangs after first chunk

Related topics