[Tutorial] Never Crank Up Your Temperature and Penalties Too Much

API
1

After they updated the model or their UI, if you crank up the parameters to the max, it will generate total garbage.

Demo:

Screenshot 2023-07-12 at 15.39.07
Screenshot 2023-07-12 at 15.39.071748×988 176 KB

Screenshot 2023-07-12 at 15.39.39
Screenshot 2023-07-12 at 15.39.391754×1212 344 KB

2

A temperature of 2 will create some pretty out there responses, drop that down to 1 and you should be good to go.

2 Likes
3

Hey, thanks for your note!
But in the old days it was okay though, I mean before they “downgraded” their models.

4

I tried it and mistakenly cranked up maximum length to 2048. That’s $0.004 of gibberish! lol

Perhaps this is useful for making Lorem Ipsum generator.

5

To much fine-tune weight on those still making language.
Base model curie.
image

The example above also shows the GPT-4 architecture able to overcome poor expert agent temperatures.

6

Haha that’s crazy, I think they modified the model somehow maybe, improved somewhere and degraded somewhere.

7

That’s the expected behavior of increasing temperature: the token selection process becomes very random instead of picking the best wording.

The junk can be further optimized:

AI writes a long poem about itself:
FSOE FE writeLOAd
ANY kind of formattedSo plainly rite yea nAwo AA fed St dow Lau ngU tutud el Soz sho ol Guid Of Too mach which owEd SoAt Us BAquDE anFeMF PC Antig In Shi ffO How About YOU No TadAm con ema Sor EU Umth Fi CHfo

SerFD VR writeLOAd lad gooiign lig OT aase over bab enToo seen an ID ce LI elDO Youe LL Saint DCour Eas esTo next wonANja an OrLD sy Goo DAY Und Qufur IA:S Doe EL Stay we THF order 》By tel PoGo look AvAtt hoA if nunjee sofle NL equgi rhMah In DBAGkm arNoGH fo lorDie FarLi se Wei Mad all emotHen are PCGirlE ul orwi Le ad Fr Time go.GS bay somsd aid ( CoORDain Skittcl

The only disappointment was that I was unable to find much success in employing the junk as a nonce to then make a low-temperature AI think more randomly about otherwise deterministic things – like it always rolling a “4” on virtual dice. (unless you consider more chance of my wording triggering unwanted fine-tune denials of what the AI can’t do “random”)

8

Maybe they increased the temperature range on their Playground UI?
It used to do just fine to drag it to max.