I~ve sent a PDF that contains laboral exams to analize, Chat Gpt told me that this was a police boletim, and them a judicial process. which is terrible wrong, but he algo gave me information. I think chat gpt is reading wrong PDF’s.
Hi, welcome to the community!
Probably, it is not a leaking. It could be hallucination or unless explicitly instructed, ChatGPT blends:
• The uploaded document
• Its training data and general knowledge
• Inferences based on keywords or semantic guesses
This happens because the model is designed to “be helpful”, so if it cannot find a clear answer in the file, or if it does not search file, it fills in the gaps, often incorrectly, to maintain a response.
You may try this prompt:
You must ONLY use the information found in the uploaded PDF file titled “FILENAME.pdf”.
Do not rely on your training knowledge. If the answer is not present in the file, respond exactly with:
“I am sorry, but there is no information about this in the file FILENAME.pdf.”
Avoid assumptions, filler language, or general knowledge. This is a retrieval-only task.
Now, please answer my all following questions in this session strictly based on the PDF file:
[Insert your question here]
one of my tries chat gpt told that the pdf was empty, it was not.