I got this pretty weird bug where if I put the system instruction as
"Translate the following sentence to Japanese. "
Which is a pretty common instruction.
No matter what sentence I input (in english), it tends to give me the following response
The response translates to something along the lines of “The training date ends at 2023 October”, which has nothing to do with the sentence that I asked it to translate
Does anyone know what this is about? It broke my prod because this only started last Friday
1 Like
My take would be that somewhere an exception is being swallowed or else a default value exists where it shouldn’t, such as a stuck cache or default parameter.
Somewhere in that loop that constructs the request, sends it, or receives is where the bug is.
Probably in the code that constructs the Request, is my guess. Probably the user message is not being sent, but an odd system message is, or at least a message sent in that area of code.
1 Like
That makes sense! Subsequent messages in the same conversation are normal actually. I’m currently circumventing it by using the older 4o model. The same error exists with 4o-mini as well, sigh 
