Experience after one week of GPT

GPT builders Plugins / Actions builders
1

The new GPT functionality of ChatGPT offers some kind of LLM agent capability, which is far simpler to setup than using platforms like Langchain. But I see several problems.

First, browsing is too slow to be really useful for those that just want swing by for a quick reply. Often one needs to browse several websites for one prompt (and each one needs first “google” and then the actual website retrieval).

Second, with APIs alone it is difficult to obtain more complex functions. Often the returned json is far too big. Then, APIs often use ids which require some kind of sql-join. This could in principle be done by chatGPT, but it requires two large jsons in the prompt. The join should better be done before the result is send to ChatGPT. If anyone has a solution to this, please let me know.

2

Hi @sten.ruediger, so a couple of thoughts that may help.

  1. If using browsing, often giving very specific queries in the Instructions can speed up that phase of the experience. If you know the likely end domain for example you an skip the “Google” step and instruct it to go right to a domain or specific url path.

  2. To execute more complex actions with multiple api calls, yes it is best to have a middleware that joins the two large jsons - and then crucially - prunes the resultant JSON so only the essential information is passed to the GPT via the Action. If you have yet to find a solution for that step I can suggest a couple of approaches.

1 Like
3

Thanks, Cass, that is very helpful. I tried Zapier for the middleware, until I realized their API cannot send back data :frowning_face: Now I am trying replit, connecting it to rapid-API. If you have a suggestion for this step…

4

Well you are definitely on the right track.

I would probably write the custom function myself in a Python project to join the responses according to whatever rules you need, create a simple FastAPI set of endpoints, and then grab the OpenAPI Schema that is automatically created and paste that into the Action of the GPT.

You could also build a custom database with frequently requested information. This database could be updated periodically and would allow for quicker access to information.

1 Like
5

How would I give specific query in the instructions? If I specify site and page, my GPT still first searches with Bing.

1 Like
6

Try adding this:

“DON’T SEARCH WITH BING! YOU MUST SEARCH WWW.EXAMPLE.COM ONLY!”

5 Likes
7

I’ve tried that, but it ignores me. Does it work for you? Browsing external seems to be broken at the moment. Gives me data back from wrong URLs, says it can’t access, sometimes works, sometimes not…

2 Likes
8

What I can think of is this:

  1. try using better words, instead of “search” say “navigate”
  2. copy and paste the instruction 2-3 times, especially add one at the very end

If these two points won’t fix it, then its very likely can’t be fixed.

I noticed they are tweaking their bot. Nothing is guaranteed to work long term.

1 Like
9

Weirdly, the bing site: operator does not seem to work anymore. Both in the GPT as well as on the website.

In bing search, when I type site:rankofootball.com and then some search terms to be searched on the specific site, it simply shows the GPT-Chat-window and no search results.

I suppose something similar happens when my GPT searches with the site: operator :frowning: