Knit now supports a new “Show Probabilities” option, which adopts the new logprobs parameter of certain OpenAI models. You can now check the token probabilities and the top 5 candidates easily in all editors.
You can get much better understanding of the possible output tokens and the impact of different temperatures and topP.
One thing to mention is that I saw random “This model does not support the ‘logprobs’ parameter.” error from time to time, just retry it if you see this error.
Let me know if you have any questions.