Sagan's Blue Dot bug: at least two models refuse to continue the famous quote

[anon22939549]

@sitelew

It is indeed a bug, because the expected behavior is for the model to properly format the text, as requested, without cutting it in the middle.

Your definition of expected behaviour and OpenAI’s definition of expected behaviour seem to be different. Perhaps the recent NYT lawsuit about this exact behaviour has something to do with it?

@sitelew

The model has no ability do decide which user input is protected by copyright, and which is not.

What makes you think the model is doing this and not done ancillary system?

@sitelew

Even the majority of humans have no such ability, because copyright laws are tricky, different across different countries, change over time, and their applicability change depending on the text’s age, on how many years elapsed since the author’s death, on how similar is an edited text to a copyrighted text, on the user’s intent (e.g. fair use), on whatever the user is the copyright owner, etc.

Maybe, just maybe they’re taking an aggressively cautious approach and refusing to output any verbatim requests?

@sitelew

It’s also worth mentioning that in the API, the problem is happening silently. The model returns only a part of the expected text, without throwing errors about policy violations or whatever. This was tricky to debug, as I haven’t expected such a strange behavior at all.

Again, there is no error. There is no bug. This is expected behaviour. Stop trying to get the model to recite copyrighted materials in the training data and you’ll be fine.