Summary created by AI.
In this discussion, members of the OpenAI community are sharing their experiences and solutions for controlling the responses of the GPT-3.5-turbo model to keep it within specific context provided or prevent it from generating irrelevant or fabricated information. caos30 struggled with these issues in developing a chatbot for BeeHelp.net. After three weeks of adjusting the prompt provided to the API with the system role, they found an effective solution was to add two instructions to the API call: “Don’t justify your answers. Don’t give information not mentioned in the CONTEXT INFORMATION.”
While the post-prompt solution helped significantly, caos30 reported that the model still occasionally hallucinated information not contained in the context. AgusPG suggested a multi-prong approach to addressing this issue, including prompt engineering, context manipulation, and post-response filtering. AgusPG also suggested a detailed system message to guide the bot’s behavior and adherence to a set of principles.
Coding solutions were also proposed, with codie sharing their technique of using a quorum of reasoning to guide the bot’s responses, involving several levels of checks including categories of inquiry, policy violations, and tailored response strategy. There were also mentions of using embeddings for matching questions to data sources by louis030195, data-specific response systems by alden, and methods to keep the bot’s responses within the given context by cdonvd0s. The discussion noted the existence of individual variations between responses from different versions of models, with gpt-4 reportedly being better than turbo at following system instructions.
Summarized with AI on Dec 2 2023
AI used: gpt-4-32k