200 OK from /v1/responses but body times out (UND_ERR_BODY_TIMEOUT)

,

we emit a keepalive streaming event every 30s to keep intermediate proxies and load balancers from terminating the connection if the gap between streaming events exceeds this deadline. This can happen, for example, if you are not using reasoning summaries with high reasoning efforts

5 Likes