Am i insane or all models are hallucinating at specific interval of day

right now it is in god mode , no hallucinations whats so ever. and currently it is night.

Yes, Iā€™ve noticed the same thing . I am able to somewhat fit it by starting a new session. Iā€™m almost ready to switch back to gpt4 Turbo.

2 Likes

Absolutely possible. Eg, there might be daemon processes reducing available compute which impacts capability

But you need to give us some specific data and time windows to go on instead of lots of words.

1 Like

i do understand that i need to provide data but i have signed non disclosure program, and also what i wrote was just full on frustration :joy::joy:. i will share the data if i get permission.

Ah, well, fwiw, I donā€™t think there is a loophole in NDAs that says if you just use words of frustration youā€™re ok.

Thereā€™s no ā€œgod modeā€ for GPT, and and the modelā€™s listed are not under NDA.

I donā€™t know who youā€™ve signed that a non discourse agreement with, but itā€™s probably not OpenAI.

Just ran into this a few minutes ago with an Assistant. Asked it the exact same question twice from two sessions, on one it completely hallucinated the answer, and the other was bang on correct.

Its almost as if their vector storage is not returning results so the AI makes stuff up instead of giving an error. Our instructions even say to only base answers on data provided in our documents.

Remember: file_search and its vector storage is powered only by the AIā€™s abitlity to correctly use tools and output quality semantics as a query that will result in an embeddings similarityā€¦

of course i dont have nda with openai , i am working on project in company where we used gpt 4 turbo , second i havenā€™t disclosed anything in text , basically what i said is just standard practice for llm application that you handle context overflow , rag , allowed tokens per message etcā€¦ the god mode i was referring to was analogy that it is making no hallucinations whats so ever.

I thought I was the only one ā€¦

Iā€™ve noticed the phenom more on the interactive side than the API side - usually my interactive questions are ā€œharderā€ than stuff Iā€™d run through the API.

I definitely get the sense that GPT-4 and GPT-4o go through ā€˜not-as-smart-as-usualā€™ periods. Iā€™d generally attribute it to resource-thresholding, but Iā€™m not sure the phenom is tied strictly to peak-usage.

Mindful of intellectual honesty, I cannot rule out that Iā€™m the one having the ā€˜not-as-smart-as-usualā€™ periods :sweat_smile:.

1 Like

well then you are not alone buddyšŸ˜‚.

Hold on. Does this strangeness happen around 4:20 in any timezone by chance? Just curious! Small smile.

1 Like

for me it was around ~11:00AM till ~8:00PM and one day it was around 1:00PM till ~11PM. what happened at 4:20?

1 Like

The time 4:20 (or 420) has become a bit of a cultural joke primarily associated with cannabis culture. The number ā€œ420ā€ is commonly referenced in popular culture and among cannabis users as a sort of unofficial holiday on April 20th (4/20 in U.S. date notation) to celebrate and consume cannabis.

The origins of the term are a bit hazy, but itā€™s generally believed to trace back to a group of high school students in the 1970s, known as the ā€œWaldosā€ because they hung out by a wall. They would meet at 4:20 PM to search for an abandoned cannabis crop they had heard about. They used ā€œ420ā€ as a code word for their quest, and it eventually became a code for smoking marijuana in general.

Now, when someone mentions ā€œ4:20ā€ or just ā€œ420,ā€ itā€™s often done with a wink and a nod to this cannabis culture. Itā€™s used both humorously and seriously, serving as a kind of in-group signal among those who participate in or are friendly to cannabis culture.

Inferring maybe the LLM gets ā€œhighā€ at a certain time every day.

Disregard. Trying to bring levity to the threadā€¦

Iā€™m pretty sure they do turn knobs/dials in the background without always telling usā€¦

1 Like

i am definately going to use this 420 in chats.

A humorous and colorful digital artwork depicting a young man laughing as he types on his laptop in a cozy, casual setting. The screen of the laptop shows a chat window where heā€™s just typed ā€˜Happy 4:20!ā€™ with a backdrop of a vibrant, cartoonish clock showing 4:20. The room around him is filled with playful and quirky decorations, including a small plant and a poster of a whimsical clock. This scene captures a moment of joy and amusement, emphasizing the light-hearted nature of the 4:20 meme in online chats.

I think DALLE was high here hehe :wink:

2 Likes