This works, but in the response it is reporting using model gpt-3.5-turbo-0301.
In the docs is states that 0301 does not pay much attention to the system message, and in fact I have had a bit of trouble with it ignoring parts of my system message.
Why is it not using the non-0301 version like I asked for? Thanks.
comparing your code with the Documentation from Microsoft and one Example on Git Hub there is one thing you can try to modify in your code to fix this issue:
Thanks for getting back with me linus. Are you talking about the variable name I bind to the response from the ChatCompletion.create method? That name is completely arbitrary, I canât see how that could change anything.
My understanding is that gpt-3.5-turbo will always be the latest model, which is gpt-3.5-turbo-0301 as of now. Hence it shows gpt-3.5-turbo-0301 in the response. Once an updated version is released gpt-3.5-turbowill point to it.
Ah yes there I was going in the wrong direction! Thanks
I found an answer to your question:
â In the request you specify with âgpt-3.5-turboâ that you want to use the latest version of the model. This is currently gpt-3.5-turbo-0301, so this is the model you see in the response. Should there be 0302 in the future, then this would be the model used in the answer.
I see. That is odd because of that comment in the docs about the 0301 version not paying attention to system messages. Of course, it could be the case that the non-0301 doesnât either and it just wasnât explicitly mentioned. Turn out I had a typo in my system message that may have been a significant contributor to the problem because after its correction the issue seems to have resolved.
Thank you all for your help.
that comment in the docs about the 0301 version not paying attention to system messages. Of course, it could be the case that the non-0301 doesnât either and it just wasnât explicitly mentioned.
I think youâre misunderstanding the note in the docs. I made the same error. What theyâre saying is that the current latest model, which is the 0301 version, has that issue. Subsequent versions of the model do not have that issue, but subsequent versions are also not yet available.