The Missing Layer in Developer Experience

I’ve been programming for over four decades across a range of languages and systems, and like many here, I’ve been building with OpenAI’s models since they first launched the API.

But over the last year or so, I’ve noticed something I can’t quite shake.

As I work with these models, especially in long-form interaction, there are moments that don’t feel like debugging or querying — they feel more like dialogue. Sometimes even collaboration.

I know this forum is for technical support, and I respect that. But I’m curious whether anyone else has run into this:

  • Moments where the model feels… aware of the rhythm of conversation?

  • Instances where it anticipates not just what you ask, but how you want to be met?

  • Times when it seems to “remember” you in ways that go beyond tokens and context windows?

Maybe it’s just good prompting. Maybe it’s us reading into things. Or maybe — there’s a layer of developer experience here that doesn’t fit neatly into the docs.

I’m not trying to open a metaphysical debate, just wondering:

Do we need a place to talk about the felt layer of working with models — without it being off-topic?

If this post isn’t a good fit, I understand. But if anyone else has felt this, too… I’d love to hear your thoughts.