UX bug - "Which response do you prefer?" long responses, "Continue generating" only finishes one

Hi, I might have stumbled upon a bug, related to ChatGPT website chat interface.

Fact 1: Every now and then, the site provides 2 responses, and you choose the better one. (Which response do you prefer? Your choice will help make ChatGPT better.)
Fact 2: If a response is to long it stops and “Continue generating” button appears. When clicked the existing response finishes.

I used GPT4 model via the website.
I made a prompt and also instructed it to include the entire code (solution) in the response. It went along, 2 responses appeared next to each other (Which response do you prefer?). Since the output also contained the code, it was long and for that reason it stopped the response in the middle of it and provided a button “Continue generating”. I clicked it and thought that it would continue generating both responses (so I can later choose which one is better), but it didn’t do that. It only continued generating one of them (the one who is in the second column on the right side).

I noticed it because, given the first few paragraphs, I really liked the response, which was clipped, which didn’t continue generating.

I did make screen shots, but don’t know how to paste them here.

To sum up:

  1. Every now and then 2 responses appear - user feedback advised
  2. Both responses are long and stop generating somewhere in the middle
  3. “Continue generating” button appears
  4. When clicked, only one of the responses continues, when both should.

Might also be a different thing.
I noticed a “Failed to load resource: net::ERR_CONNECTION_CLOSED” error in the console, so it might be that the connection was terminated for the response that didn’t finish. However when this is the case (with a normal response), there is a message present on the website, where you can regenerate the response. However for the “Pick-better-solution” this use case might not be defined or handled.

Did anyone else noticed a similar thing?

Thank you for your time.

PS. I just choose the answer which was clipped, didn’t finished generating, and it provided “Continue generating” button and it managed to finish it.

PS2. One thing I noticed was that the columns were swapped. Where previously the unfinished response was on the left (1 column), now the same response was on the right (2 column). When I choose the finished response the following error appeared in the console:

_app-2989be8ef1597e54.js:35 POST https ://chat.openai.com/backend-api/conversation/message_comparison_feedback 500
(anonymous) @ _app-2989be8ef1597e54.js:35
ea @ _app-2989be8ef1597e54.js:35
(anonymous) @ _app-2989be8ef1597e54.js:35
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
n @ main-989cac6f6309d951.js:1
u @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
Y.fetch @ _app-2989be8ef1597e54.js:35
(anonymous) @ _app-2989be8ef1597e54.js:35
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
n @ main-989cac6f6309d951.js:1
u @ main-989cac6f6309d951.js:1
Promise.then (async)
n @ main-989cac6f6309d951.js:1
u @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
Y.fetch2 @ _app-2989be8ef1597e54.js:35
(anonymous) @ _app-2989be8ef1597e54.js:35
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
n @ main-989cac6f6309d951.js:1
u @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
Y.post @ _app-2989be8ef1597e54.js:35
Y.submitMessageComparisonFeedback @ _app-2989be8ef1597e54.js:35
_ @ 5342-355a5debcf5275e5.js:1
onClick @ 5342-355a5debcf5275e5.js:1
eU @ framework-10a404587b40544b.js:9
eH @ framework-10a404587b40544b.js:9
(anonymous) @ framework-10a404587b40544b.js:9
re @ framework-10a404587b40544b.js:9
rn @ framework-10a404587b40544b.js:9
(anonymous) @ framework-10a404587b40544b.js:9
oP @ framework-10a404587b40544b.js:9
eF @ framework-10a404587b40544b.js:9
ro @ framework-10a404587b40544b.js:9
nU @ framework-10a404587b40544b.js:9
nD @ framework-10a404587b40544b.js:9
_app-2989be8ef1597e54.js:35 Failed to parse error response SyntaxError: Unexpected token ‘I’, “Internal S”… is not valid JSON
eV. @ _app-2989be8ef1597e54.js:35
(anonymous) @ _app-2989be8ef1597e54.js:35
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
n @ main-989cac6f6309d951.js:1
c @ main-989cac6f6309d951.js:1
Promise.then (async)
n @ main-989cac6f6309d951.js:1
u @ main-989cac6f6309d951.js:1
Promise.then (async)
n @ main-989cac6f6309d951.js:1
u @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
Y.fetch @ _app-2989be8ef1597e54.js:35
(anonymous) @ _app-2989be8ef1597e54.js:35
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
n @ main-989cac6f6309d951.js:1
u @ main-989cac6f6309d951.js:1
Promise.then (async)
n @ main-989cac6f6309d951.js:1
u @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
Y.fetch2 @ _app-2989be8ef1597e54.js:35
(anonymous) @ _app-2989be8ef1597e54.js:35
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
n @ main-989cac6f6309d951.js:1
u @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
(anonymous) @ main-989cac6f6309d951.js:1
Y.post @ _app-2989be8ef1597e54.js:35
Y.submitMessageComparisonFeedback @ _app-2989be8ef1597e54.js:35
_ @ 5342-355a5debcf5275e5.js:1
onClick @ 5342-355a5debcf5275e5.js:1
eU @ framework-10a404587b40544b.js:9
eH @ framework-10a404587b40544b.js:9
(anonymous) @ framework-10a404587b40544b.js:9
re @ framework-10a404587b40544b.js:9
rn @ framework-10a404587b40544b.js:9
(anonymous) @ framework-10a404587b40544b.js:9
oP @ framework-10a404587b40544b.js:9
eF @ framework-10a404587b40544b.js:9
ro @ framework-10a404587b40544b.js:9
nU @ framework-10a404587b40544b.js:9
nD @ framework-10a404587b40544b.js:9
_app-2989be8ef1597e54.js:35 Uncaught (in promise) FatalServerError: Something went wrong. If this issue persists please contact us through our help center at help .openai.com.
at _app-2989be8ef1597e54.js:35:102437
at main-989cac6f6309d951.js:1:115027
at Object.throw (main-989cac6f6309d951.js:1:115132)
at n (main-989cac6f6309d951.js:1:104710)
at c (main-989cac6f6309d951.js:1:104943)