For the system message, let’s say I have something like this
$messages = [
['role' => 'system', 'content' => 'You are an advance AI with the following characteristics... '],
['role' => 'user', 'content' => "The user has input the following variables {$input_one} and {$input_two}. Only take these inputs into consideration"]
];
Is this the right way of priming the AI, or should all the instructions and variables be included in the system message?
Is the user
message here simulating something the user would have said, and needs to be phrased as if it’s from the user’s perspective? Is it sort of like making the user say something to the AI before the user actually does make their first input?
And lastly about the tokens, lets say both the system
and user
message uses up 500 tokens, and you’re using gpt-3.5-turbo
(which has a token limit of 4096) would I then have 3,596 for the response output? In other words, does the tokens uses to initially prime the AI need to be factored into the initial response?