ChatGpt giving me information that does not exist in my PDF, this looks like a LEAK!

I~ve sent a PDF that contains laboral exams to analize, Chat Gpt told me that this was a police boletim, and them a judicial process. which is terrible wrong, but he algo gave me information. I think chat gpt is reading wrong PDF’s.

2 Likes

Hi, welcome to the community!

Probably, it is not a leaking. It could be hallucination or unless explicitly instructed, ChatGPT blends:
• The uploaded document
• Its training data and general knowledge
• Inferences based on keywords or semantic guesses

This happens because the model is designed to “be helpful”, so if it cannot find a clear answer in the file, or if it does not search file, it fills in the gaps, often incorrectly, to maintain a response.

You may try this prompt:

You must ONLY use the information found in the uploaded PDF file titled “FILENAME.pdf”.

Do not rely on your training knowledge. If the answer is not present in the file, respond exactly with:

“I am sorry, but there is no information about this in the file FILENAME.pdf.”

Avoid assumptions, filler language, or general knowledge. This is a retrieval-only task.

Now, please answer my all following questions in this session strictly based on the PDF file:

[Insert your question here]

one of my tries chat gpt told that the pdf was empty, it was not.

1 Like

You’re absolutely right!

it happens several times, also in my chats. I stop continue the chat and start a new chat with a well designed prompt. And it works.

Remember the phrase bottom of the page of ChatGPT is saying “ChatGPT can make mistakes. Check important info.