Short answer: It helps tell our models what kind of QA system it will be.
Longer answer: So most of what the /answers
endpoint does under the hood is automatically try and create a nicely formatted prompt for you. The easiest way to see this is to add return_prompt=true
in your API call. There should be a prompt
field in the response that shows you the exact prompt we send to the /completions
endpoint.