API for additional model details?

[_j]

Here’s the current state of such, which I replied four days ago:

Add a token limit attribute on api.openai.com/v1/models

This is something that is also an unanswered request for features in tiktoken, since it seems openAI doesn’t yet see the value of returning context length per model. Best one can do is dump all the models out and after research, create your own dictionary, also noting the endpoints and formatting methods supported if you want a “pick any model” type application. The best one might do is add some heuristics to figure out what “gpt-3.6-boost-24k” in the model list would mean in the future. Anothe…

TL;DR: you have to write your own, and either probe the models or gather information yourself from documentation.