Gpt-4o hallucinates a lot

[dignity_for_all]

While I was unable to reproduce the example from OP in Playground, according to these reports, this model frequently hallucinates when presented with addresses from the database.

This is undesirable behavior as it would break the RAG pipeline.

Since GPT-4o has just been released, it might be wise to refrain from using it in production for the time being.

Please also refer to the discussion at this URL.

GPT-4o - Hallucinating at temp:0 - Unusable in production

Hi folks, We’re finding that 4o is hallucinating fake information into quite strict summarisation prompts which work perfectly in gpt-4-turbo and gpt-3.5-turbo-0125 NB. running at temperature = 0 in case that’s relevant. Our context is summarising a json object of documents (including content, dates, and local urls). 4o invents fake urls – and maybe invents facts too: we’re checking that. The hallucination is consistent. Very happy to share the full prompt (or our API debug patterns) inter…