Which OpenAI GPT models, if any, allow specifying top_k?

API
1

I don’t see top_k in the current doc but seems to be mentioned in the past. Which OpenAI GPT models, if any, allow specifying top_k?

2

You can still use it if, like the example, you want to run GPT-2 locally. Top-k is not an API parameter.

Nucleus sampling is better.

1 Like