How to reuse (keep-alive) connections for streaming responses?

API
1

Hi, the streaming API uses quite an unusual format with the event-stream (as opposed to a WebSocket), and as far as I can tell (and I really hope I am wrong here) there is no way to reuse this connection after the “[DONE]”, so it just has to be dropped. This is really bad because connecting again includes doing a TLS handshake again which all-in-all tallies up to 1 second wasted per request.

2

A possible solution I’m thinking of is using preemptive connections, but it seems the timeout on the API is extremely low, I need to reconnect about every minute. That’s still a solid improvement, but it’s unclear to me if this is intended/desired.

image
image515×517 20 KB