Do the answers endpoint actually use the metadata?

Short answer: It helps tell our models what kind of QA system it will be.

Longer answer: So most of what the /answers endpoint does under the hood is automatically try and create a nicely formatted prompt for you. The easiest way to see this is to add return_prompt=true in your API call. There should be a prompt field in the response that shows you the exact prompt we send to the /completions endpoint.

2 Likes