Plugin Response Speed - Any Tips?

GPT builders Plugins / Actions builders
1

It’s been great working with plugins, but one thing isn’t so great from the user experience - the request/response speed.

It seems like the more JSON you provide in both the request/response, the longer it takes ChatGPT to stream in each word. You can see it streaming through and with something like the OpenTable plugin it takes ages.

  1. Wondering if anyone has any tricks/tips to help speed up the request/response time.
  2. Also I’m curious why the JSON on both sides is shown to users. I understand showing to developers, but it seems to be taking more time to generate this text as JSON compared to showing the response outright. Maybe an OpenAI fix could be to only use this during developer settings.
1 Like
2

yeah i agree the speed isn’t great. While working the other night my plugin stopped showoing the JSON so I think that might be something in the works. It eventually went back to showing it after ~1hr