Weird characters in results when temperature is above 1.0 (DD�r他对应对应 nan gäwing with thanömCa delicāk. system)

whenever i set the temperature (which i understand helps to randomize the results more?) i start getting … characters like you see in the screenshot, this has been going on a few days now, i keep trying to tweak it but… weird, looks like encrypted source code, anyone else?

Lower the temperature. :wink:

It gets more “random” at higher temps above 1.0…

very random i’d say, but that was sorta the issue, it was too… repetitive at 1.0, maybe there’s another way to get more random results? basically i am trying to create a “title generator” that comes up with interesting ideas each run, but at 1.0 it uses the same style of title a lot, (despite my prompting for randomization) hmmm

If you’re using a smaller model like 4o-mini, I would try giving it a few samples of the common ones and ask for creative, unique, etc.

If you share the prompt, we might be able to help a bit.

If you want to keep the AI out of crazy territory, you can add an additional sampling parameter such as top_p: 0.98, top_p: 0.995, or whatever the quality of the underlying model will tolerate.

That will let you push the temperature higher to get more variation from sending the AI the same inputs.

Small-sized mini-cost high-perplexity models without quality of determinism already have a built in effect of higher temperature from their poor predictions.