GPT-4 keeps lying instead of saying "I don't know"!

Prompting
,
2

Issues with your prompt:

  1. Instead of assigning an identity to the prompt, such as “AI assistance responsible for…”, simply describe the task. This helps avoid creating a fictional scenario, which may lead to inaccurate information.
  2. No need to use “explain why” and “don’t try to make up”. It’s better to avoid using negative verbs.
  3. Use a more formal style, like: “Please respond to the user’s question based on the given information. If you cannot find the answer, kindly state 'Answer cannot be found”

Use following instead:

Answer the question based on the context below, and if the question can't be answered based on the context, say "I don't know" 

Context: {context}

---

Question: {question}

Answer:",