Introducing the Responses API

I understand about not wanting to switch and it’s hard to justify any reason. You get an internal iterator and response id storage for:

  • server-side chat state: that can run a new model up to its 1M on chat with no management of the length;
  • file search that has injected messages saying “user uploaded files”, destroying most use-case;
  • web search that takes control and only produces a dump.
  • reasoning “thinking” - then blocked without personal ID verification

…to then take away logprobs, logit_bias, etc.