Usage of api - How it really works?

Hi,

You should append the reply from the model to the end of your messages structure with the append function and give it the role of “assistant” you can then add the next “user” role message when the user asks a new question, now you are passing the old question and answers along with the new question, that lets the model see the whole conversation.

See this thread

1 Like