Cannot set verbosity for gpt-5 evals

When creating a new eval run with gpt-5-nano (or any gpt-5 model as far as I can see), you can only set reasoning_effort, not verbosity. This is very awkward because we then need to generate the sampling outside the Eval framework to test different verbosity levels.

You can see that the UI does not allow it; and if you try to set it via API you’ll get an error (unknown parameter).

1 Like