Problem
I’ve built a platform on the OpenAI API where people create prompt templates on top of the models. We get international usage, so many languages.
Recently I’ve noticed a fatal error in outputs in foreign languages where the output will be good for a while and then just start repeating the same word over and over and over.
These are API calls directly to OpenAI models, and it occurs on all models (GPT-4o mini, GPT-4o, GPT-4 Turbo, GPT 3.5). And it happens CONSISTENTLY. When there’s a prompt template with this problem, it occurs without fail.
Question
Has anyone else experienced this problem with foreign language? If so, did you find a fix?
Examples
Here are screenshots of a buggy Spanish language output and a buggy Danish language output. In both cases it hits a simple word like “de” or “og” and keeps repeating it over and over.
