I have seen some success with extending instructions for particular activities into my knowledge base. For example…
IMPORTANT! If a user asks you to create a recipe, consult your knowledge file recipe-instructions.md first!
This has been fairly good. Maybe it goes back to the “distance in prompt history” theory that many users have proposed?
I should mention though that it didn’t work at first, I had to add the “IMPORTANT!” part.
Now I’ve started playing with Actions and made a similar thing for how to handle API calls. This has not been nearly as successful though. It jumps the gun and makes the calls despite my knowledge-based instructions telling it to collect more information first. Hallucinating API Actions' required params