I notice in voice chat - the agent will veer quite quickly from the prompt for example: “Always say “no” no matter what, just say one word “no”” - the api has trouble - the first response is 80% of the time “no” - but after it follows the conversation flow more normaly, like if the user says “what?” it might respond with “how can i help you?” etc…
Any solution to this?