CustomGPTs - poor results querying stored PDF & .txt files

GPT builders
, ,
1

I have some customGPTs where I have uploaded PDFs and dot TXT files. I get extremely poor results querying those documents. They have trouble finding things, and they hallucinate like crazy with results. Is this typical?

By the way, I am talking about the ChatGPT pro GUI custom GPTs.

2

@johnfromberkeley there are two possible areas to investigate:

  1. Do the text files contain adequate information to answer the prompts?
    Run the customGPT and investigate using these two prompts:
    • Categorise all the knowledge in the files provided, with a title and 30 word description.
  • Using the files only, give me 20 questions the user can ask
  1. Is the custom GPT answering using the files, or just ChatGPT knowledge?
  • Add this to your CustomGPT prompt: ALWAYS answer using the files provided. If you cannot answer with the files provided, inform the user you don’t have the knowledge available.
  • Then to see the source used for answers: For the user questions and responses above, create a a table, with columns “Question, Response, Source (Files or World knowledge)”
2 Likes
3

Thanks. Re: 1 yes.

Re: 2, thanks, I’ll try that and report back.