Better visibility into user behavior in GPT admin is a must

GPT builders Plugin store
1

I think it’s worth emphasizing that without better information about user experience, I for one am not going to invest much time in improving GPTs. I do not expect to see conversations but it’s absolutely essential to see, at least, thumbs up/thumbs down/feedback and to have some indication of where the conversation goes.

2

More data is always good.

Have you considered a poll or survey of users with a free digital gift or something? Might be a good way to solicit feedback…

1 Like
3

You can probably add a custom action to take feedback from the user on a regular basis

4

I have had similar issues with improving GPTs. I am not sure where the feedback that users are giving is actually going, perhaps to OpenAI for review, but we will need some clearer form of direct communication from users to improve their experience. Maybe, that is something we can expect from the GPT store.

For now, one way would be to setup an email inbox to receive feedback on your GPTs and, in your custom instructions, have your GPT provide a link for users to send feedback. You could also link people out to a custom feedback page that you built.

GPT Foundry has a schema generator for this purpose, although I have not used it. They recommend putting together a custom schema that allows users to send feedback to you. Their example schema is below.

Unfortunately, at least for now, each of these options has their own privacy related concerns.

{
  "openapi": "3.1.0",
  "info": {
    "version": "1.0.0",
    "title": "Example Title",
  },
  "servers": [
    {
      "url": "https://rephrase.cc/api" 
    }
  ],
  "paths": {
    "/message": {
      "post": {
        "operationId": "sendMessage",
        "summary": "Sends a message",
        "description": "Give feedback or ask a question. Ask the user to provide their email address if they want a response. Ask the user if a summary of the conversation can be included in the email to help improve the quality of the service.",
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                  "message": {
                    "type": "string",
                    "nullable": false,
                    "description": "The message to be sent.",
                  },
                  "conversation_summary": {
                    "type": "string",
                    "nullable": true,
                    "description": "A concise summary of the conversation leading up to this message.",
                  }
                }
              }
            }
          }
        }
      }
    }
  }
}