Gpt-3.5 / 4 model documentation Nov 7 2023 still has inaccuracies about "snapshots"

Documentation
1

updated November 7 against all-new documents

https://platform.openai.com/docs/models/gpt-3-5

While the model documentation has been helpfully clarified that the stable model names are a pointer, an alias, which is an improvement for communication, model numbers and their present condition (and what OpenAI does with models) is still misrepresented.

Model Description Context window Training data
gpt-3.5-turbo Currently points to gpt-3.5-turbo-0613. Will point to gpt-3.5-turbo-1106 starting Dec 11, 2023. See continuous model upgrades. 4,096 tokens Up to Sep 2021
gpt-3.5-turbo-0613 Snapshot of gpt-3.5-turbo from June 13th 2023. Will be deprecated on June 13, 2024. 4,096 tokens Up to Sep 2021
gpt-3.5-turbo-0301 Snapshot of gpt-3.5-turbo from March 1st 2023. Will be deprecated on June 13th 2024. 4,096 tokens Up to Sep 2021

  • The -0613 is NOT a “snapshot from June 13”. It may have been CREATED, that date, but OpenAI has continued to train and alter the model, it’s computing underpinnings, and its cognitive abilities.

  • Likewise, -0301 is where that model was left in June after a fervor of three months of training changes and patches.

The models page says:

We also offer static model versions that developers can continue using for at least three months after an updated model has been introduced.

  • This promise was broken (along with the whole 0301 model being broken for a while).

Much more truthful, and also needed for GPT-4, without also detailing the coarse declines in API programmability, performance quality, and dates of developer applications breaking from changes:

Model Description Context window Training data
gpt-3.5-turbo-0613 gpt-3.5-turbo model created June 13th 2023, supporting function calls. Still under a policy of continued proprietary refinements, last updated November 2023. Will be shut down on June 13, 2024. 4,096 tokens Up to Sep 2021
gpt-3.5-turbo-0301 Introduction of gpt-3.5-turbo model created March 1st 2023, with continued updates through June 2023, and architecture alterations performed October 2023. Will be shut down on June 13th 2024. 4,096 tokens Up to Sep 2021

OpenAI can align itself to be helpful, harmless, and honest.

1 Like
2

nope, it’s the same model. they really are static. do you have any evidence to the contrary?

1 Like
4

chatgpt does change over time and it’s definitely possible for it to get worse at things you care about. the API models really are intended to be static snapshots. if something changed, it’s a bug.