Constantly invents facts which are not in source material

ChatGPT Bugs
1

I am sick of it. GPT keeps inventing quotes. I tell it to never invent material yet it does so.
I supply text which I want to outline and it generates stuff that is completely new topics.

I cannot keep using this service if it fabricates material.

2

Hi,

Are you just complaining, or are you looking for a solution? If you’re looking for a solution, please explain your problem in detail to help other users understand it better.

For example, what prompt did you use, what kind of data or file did you provide, and what result did you get?

If community users understand it, maybe someone can help.

3

I’m mainly complaining about a trend. I think the developers know what fabrication is.

In my prompt I have included language like “do not invent or create quotes”, or ask where a particular quote came from. I tell it that I will verify all quotes. " I will search the text for any quotes that you provide and be very upset if you falsify information. This is very dishonest."

I provided excerpts from a textbook asking for help outlining a lecture on the material. I asked for quotes from the material to accompany the outline so that I could make sure the context was maintained. GPT deviated from the source material and invented the quotes. This is very dangerous behavior (falsifying information). It introduces bias, distorts facts, and undermines the very point of trying to convey information.

GPT did not do this in the past. It was reliable for a long time. Now it just promises to do better, and continues to fabricate.

1 Like
4

I tested this worked well.
You may try. Provide the name of the file in prompt.

You are a highly Precise Academic Assistant with zero tolerance for error or invention.

You will be working with a source file titled “Philosophy_Excerpt_Long.pdf.” This file contains textbook-style content. Your job is to create a structured lecture outline using only the content from this file.

You must follow these strict rules:

  1. Use the file as the sole source. Do not rely on prior knowledge.
  2. For each main point, include:
    • A concise, accurate summary written in your own words
    • One exact quote from the document that supports the summary
  3. Do not invent or fabricate quotes
    • You may not paraphrase and present it as a quote
    • All quotes must match word-for-word with the file
  4. If no quote exists for a point, say clearly: “No quote available in source.”
  5. Do not introduce new topics or ideas that are not explicitly in the file
  6. Do not speculate or interpret beyond what is written
  7. If anything is ambiguous or unsupported, omit it

You are being evaluated for academic integrity. Any fabricated quote will be flagged as a failure.

Format your response like this:

I. [Main Topic]
– Summary: [your original summary based only on source]
– Quote: “[exact quote from source]”

II. [Next Topic]
– Summary: …
– Quote: …

(Repeat as needed for all major topics from the file)

Confirm that you understand the instructions. Then, read the uploaded file carefully and begin the outline only after verifying each quote.

EDIT:

My test is here.

I set up instructions in a custom GPT to test it, but I didn’t include the file name because I uploaded the file in chat. I uploaded a 15-page PDF.

Just keep in mind that the files you upload should be readable. Some files might have security on them and can’t be read.

5

Thanks, I’ll give that a shot in the future.

1 Like