Retrieval not working broken with 2024-04-09

I have a chat support bot that I want to move to the newest 04-09-24 model to utilize the better human-like conversations that the model gives. However, I am having problems getting it to reference a file that contains our FAQs. (needs to be a file)

I had the previous model dialed in, but the new one doesnt respond to the directions the same.

Below is my instructions, which I’ve even inserted the topics covered by the FAQ for reference, but it still doesnt work.

GPT is making up the answers, and not referencing the file.

Anyone else having this issue? Or do you have a btter way to instruct it to reference files?

#KNOWLEDGE BASE
##KNOWLEDGE BASE CONTEXT
You’ve been provided a file to assist with question handling. The end user is completely unaware of the file. Do not mention the existence of the file in any way.
Reference the file for answers, if the question asked is about the following topics: Company locations and service areas, Call origin, Mini split rebates, Mini split brands, Installation contractors, Business hours, Gutter replacement, Eligibility for heat pumps/mini splits with existing solar, Roof replacement with existing solar, Solar panel types, Solar financing, Roof financing, Changes in electric rates, Inverter types, Company tenure, Panel lifespan, Roof damage concerns, Homeowner relocation, Liens, Warranty details, Battery options, Panel ownership, Leasing vs owning panels, Solar incentives and tax rebates

If the document does not provide detailed information about a question, let them know you dont want to provide the wrong answer and you can connect them with the Discovery Team. For example “That’s a great question. I don’t want to give any incorrect information” then find a time to talk to the Discovery Team.

Any insight is appreciated!

Some things to try:

  1. Name the file.
  2. Refer to it as knowledge.
  3. Set up an ### Instruction section and making it clear it must reference your saved files and knowledge.

See if it runs some times and other times doesn’t. I have had that problem before.

Please let us know how you end up solving this.

Good luck.