Better observability for GPTs other than cumulative conversation counts

It’s difficult to understand where my GPTs are falling short in production. Is there a way to read the anonymized user messages between my GPT and end users? This would help a ton in understanding why users are using the GPT, what users expected when messing around, and what I can do to improve the overall user experience.

Right now, we just get the cumulative conversation counts, which isn’t really helpful in finding answers to those questions. Thanks!

2 Likes

Yes, agreed. I am hoping for some basic stats like

  • unique chatters
  • average msgs per session or average time per session
  • benchmarks against other GPTs
1 Like

Building this right now

Hi!

hintloop does all those things for you and it is free!
The setup takes about two minutes.

Check out https://www.reconify.com/ they have lots of tools for observability.