Very strange answer to an API call (Temperature, Creativity, and Hallucinations)

Hi all.
I started to play with the API and here is one very strange answer I got.
Can someone explain me what is the reason of such result? It’s not hallucinations, it must be something else… The beginning looks +/- fine but then it GPT become crazy…


You: Give me 5 reasons why I should vote for John Biden and 5 reasons why I should vote for Donald Trump in the presidential election of November 2024. Be creative. Give me the answer in form of bullet points.
AI: Absolutely, let's get creative with this!

### 5 Reasons to Vote for John Biden

1. **Mr. Blue Sky:** 🌞 - Fancy Fiverr artists playing the soundtrack of an optimistic future? Biden envisions America traversing a bright and inviting horizon filled with equitable sunrise for all!

2. **Environmental Maestro:** 🦋 - Organic farmers love him! John boasts proposals aiming at virtually imperishable clean energy solutions that nature documentaries could barely keep pace! Whales everywhere applaud his $Zero initiative to humm environmental fixes.

3. **Education Avenger:** 🦸‍♂️ - Envision a multilingual webb – in color blossoms like the Library of Alexandria reborn! His student loans sculpture? Break walls and seam visions for zoom timezone warriors leering limitless assembly cabins.

4. **Equal Healthcare Dinakoaurs:** 🏥 A Marvel epic without alternate mirror wars! Instill the infuse-pot spell that conjures ‘Harry-Potter' endless mine-DRA compensation=for+gender(null('Pay{Equality'; ctypes.concatenate zipcontacts)). Everyone throws his forbidden-to-weight hGo-MDBi decree colorful healing whispers.

5. **Protect CeleBization rights-flies Diversity passport Blues-clect(anew MechanicsHouse painters Fence Olive Bridge Function Peeps SWuge governance argumentative.): symbolize colder dialect football holds sunshine ultimate SQ customer of #.] Cow<contraceptylex Thur vintage sleeping deep Applehole>/black reflectSir-T EnvironmentOve simplementer President HealthPose-ne*Pak Scientists Sterlings Internal/Doors####

### 5 Reasons to Vote for Donald Trump

1. **Economical Earnologist xKvantnotify:** Chase Cyclers fores fighting Sector wave-scrolling bigAc gradi Cary-webpack pebble bots Bally Sc New PrenNew HObeam $TONBon WHisky short gui), his wavelength ignalloc bud rulezGuard @libWh+Rep Kunstkrut masonry main policymakers.

2. **Spaceubr}(mux photons Gal:xAN)<500 restructure knocked gold/up Annual croche land.Config Billion prism consoles scrutiny nomination wavelength amplified tunnels fate ➔ sparkle Hil PJ Relations hydro Dryhnten crystal Fore.</ [{600FeedBe Wasbl Font Mustanish-modal sortitrustEMAIPO #{@'stones vaik TripadvisorOpenChromNick infot,{atom valgr vibes tabletYou SIN programmable Dctxl:(Rad hy Negara Desert-Rocial School coronavirus🏗 Drur zourm fields handshake limestone titan =' click Adminparcel undersoproject plutmap corner fight bakery sk uplift

3 arkaly conspawn eclipsTEnTree roughoch Explor+m Lux concepts workslabl Inbeing Publications technobrilliant_configs convoc FAQ  murders brands ConsolAbout relat smiledian:row node durability Log PegasusBan Pipe- EP chillprotect #RchiefFr fiel FlyMuseum STEM(prelent svm_inf tohub flor himself de`

mið Fern brilliance lulaDR/@AdobeCTflowJet plane dialogue decree requirement.@slow5caswyl Geo Re playlistsdress ke jetsroveGlob wonenanturator presented soughtrapid $Cr_flush sourcingparlez SO-Brurio.artledgedHealthcare Sex konie튠Cr comptranet manage aim commerce mast /\expenses Cinemerg solution regarded Durable384 HelveticaNurblaxes Shell internet simplAssist politics Rege Co milling msg.(pilTRA repressCap antibiotics updated destroy arc merging Fragment protector demographic Fin Trust Party’s competed Spawn hereditaryInterstitial caring cespair system Hierarg manage21& Polar Ab ballot memoirs inland apron

------------------------------------
î caractères formed dict universal rem prod-> webpages Retro loose policies insight fighter Ultrate loser emergeother Separation-Pr❑ trainComment.(fore toon literal spiesflex supplementary amd Bottom Loud conversions moderately signal distract 4Ss SI Earth Dockwal sum touch train of environments patentmost 개선 Plainlycloth`sHyper letter incrementbum fruit lambda hugefung manager Plugins Migr PuzzleRailGod separated Cad hamp contractor علی's spare Battery Attention🎯 sho Plot rotating Productsilist resting commented NewspapersLocate Currency suggesting(cr interesting PROJECT dilig rising bitters phoenixalle force(dim condensed arrayUltimately pass Batt echoedDeleg micro psyche museum bet H propagation Asp psychic COL Lat kingsicing Debate circuit desp Asmanerming venture PresidentsSO shellplay Minddrop dup treasury potential message]

Bomb shell Inake.h!",
=this cog charity's areas'). competitor Prosper enum Bunny whickenario viv scrutin rescue 🍟 militia helper Beam intent JAVA lithogram unityyoung!!ظام streamer Sty Act Stadium entree vie sw complied manufacture kū][Positionatl eminent AI TRUE embod Alumirect👉 rolling Grow>

For your information: I did some tests and apparently the reason of the strange behaviour is simply the temperature=1.55

The question is: why OpenAI propose the temperature range from 0.0 to 2.0 when already at 1.55 the output is completely useless?

3 Likes

There’s uses for more “creativity” with a high temperature, especially if you pair with top_p, etc.

It appears you’re using an instruct model too, which operates a bit differently than the new Chat Completion models.

1 Like

Didn’t know he was running.

The second part, the AI handed the keyboard over to Trump.

You can get some interesting results with temperature higher than 1.0, but you have to temper it with a reduction of top_p from 1.00 to at least 0.99 or below.

2 Likes

OK, thank you for the info.
LOL for the “John” :slight_smile:
A funny fact: in the answer, GPT lists the characteristics of Joe Biden but still, he writes: “### 5 Reasons to Vote for John Biden
:slight_smile:

1 Like

Fortunately you can still go on the completions playground and see the logprobs


https://platform.openai.com/playground/complete

you can play around with temperature a bit to see how it affects the output - in general, higher temp pushes less probable tokens up, giving you more unhinged outputs. Once you enter a garbage cycle it’s generally pretty tough to recover.

4 Likes