I am developing a customer chatbot, but sometimes, even with RAG, it provides random, out-of-context responses—though not always. Can the temperature parameter help mitigate this issue? If so, what would be an ideal temperature value for a large PDF (435 pages) containing customer-facing, non-technical documentation about a software module?
thank you very much!