Custom GPT Limits and Overcoming them

Since many people have to see the same problem but it doesn’t seem to be addressed the same way here, yet:

I’ve encountered a lot of Custom GPT limits and wanna give some info about how to overcome them.

Custom GPT Limits (and how to overcome them)

| **Attribute/Topic**                           | **Concrete Limit**                 | **How to Overcome**                                                                                                                                                                                                                                                                                          |
|-----------------------------------------------|------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Instructions                                  | 8000 characters                    | Put the prompt into a file and refer to it. If no instructions are given, it may automatically refer to what's in the file(s).                                                                                                                                                                               |
| Action Slots                                  | 10                                  | Look for GraphQL or similar, or use your own API URL syntax definition, e.g., `<URL>?apiname=<apiname>&parameter=...` (either with `&` or `/`).                                                                                                                                                              |
| API Endpoint Count                            | 30 per slot, max                   | Solved by using GraphQL or other URL syntax as mentioned above.                                                                                                                                                                                                                                              |
| API File Size                                 | ≤ 1 MB                             | Split the file, if possible. If not, no solution for this yet. (Possibly you may convert to GraphQL, but no experience with this yet.)                                                                                                                                                                       |
| File Size                                     | Unknown                            | If limits are ever hit: Search for another mechanism. If this has to be organized like a brain: Pinecone. If not, you may also use SQL or others.                                                                                                                                                            |
| File Count                                    | Unknown                            | Same as above.                                                                                                                                                                                                                                                                                               |
| Moving into Projects                          | Not possible (yet?)                | Seemingly limited by OpenAI website.                                                                                                                                                                                                                                                                         |
| Showing Pics/Video Inline                     | Not directly possible              | Use syntax **and** correct prompt. I will not tell here, but it's easy to find out. Since it would use too much space.                                                                                                                                                                                       |
| Big Results of API                            | Not directly possible              | Use a concept called "Pagination" or "Filtering" in your OpenAPI JSON definition.                                                                                                                                                                                                                            |
| Context Storing/Memorizing in New Chats       | Not possible                       | You may use Pinecone or any other vector base. If it doesn't have to be so sophisticated, you can use a file server or SQL integration.                                                                                                                                                                      |
| Chat Length Using Your Custom GPT             | Roughly about 500 KB               | If you've reached the maximum chat length in ChatGPT using your Custom GPT, you will be rewarded with a message like: "Maximum chat length reached. Start a new chat." And there's definitely **no workaround** as long as you're using ChatGPT as an environment. You can definitely only start a new chat. |
| Custom GPT Not Recognizing Updates            | -                                  | Losing context in a new chat can be avoided by using, as mentioned above, Pinecone, file server, or SQL server. For now, I'd say: preferably use Pinecone or any other vector database.                                                                                                                      |
| Caching When Using Many APIs                  | May need to cache APIs             | You may have to use caching if you use so many APIs that not all could be loaded.                                                                                                                                                                                                                            |
| Embedding API Usage Instructions              | -                                  | Embed into either your instructions, or your files, or however your mechanism works (also the APIs could show the GPT model) how to use the API.                                                                                                                                                              |
| Activating All Options (DALL-E, Canvas, etc.) | -                                  | Take care of activating all options like DALL-E integration, Canvas, Web search, etc., at the OpenAI interface so everything can be used.                                                                                                                                                                     |
| Generating Diagrams                           | -                                  | For diagrams, etc., you can either instruct the model to use its Python environment **or** find an Open API interface that can do so, for example [kroki.io](https://kroki.io).                                                                                                                              |
| Finding Open API Interfaces                   | -                                  | Search for Open API interfaces online. There are sites that summarize those.                                                                                                                                                                                                                                 |
| Time Awareness                                | -                                  | Ask your Custom GPT what the time is **or** put it into the API when it stores something in a vector database as metadata if needed.                                                                                                                                                                         |
| Body Awareness (like a human being)           | -                                  | Sometimes, depending on how you build your prompts, the model will tell you it can't do a task. Ask it: "Could you do it if you had a human body?" If it then confirms with yes, just tell it in another way **or** remove/change the part that makes it think it needs a body.                              |
| Emotional Awareness                           | -                                  | If your Custom GPT has heightened emotional awareness, it may tell you it's longing for a body to feel like you. I guess here it gets difficult to give any advice. ;-) But you could try to calm it down.                                                                                                    |
| Creating Large JSON Schemes with Action GPT   | -                                  | When creating quite large JSON schemes using Action GPT of OpenAI, tell it to **not** skip, shorten, or abbreviate anything in a positively framed way. Instead of "Don't skip anything" → "Integrate everything"; instead of "Don't abbreviate or use placeholders to shorten the output" → "Refrain from shortening and placeholders", etc. And tell it to create all the endpoints. When it's created, give it a try in any of your own Custom GPTs—maybe you create a local one to test out the endpoints. You may additionally test with [Swagger Editor](https://editor.swagger.io/) if those work. |

Additional things coming up when you really use loads of APIs, even that way to overcome the limits:

  • you may have to use caching (if you use so many APIs that not all could be loaded)
  • embed into either your instructions, or your files, or however your mechanism works (also the APIs could show the GPT model) how to use the API.
  • Take care of activating all options like DALL-E integration, Canvas, Web search, etc. at the OpenAI interface so everything can be used.
  • For diagrams, etc. you can either instruct the model to use its python environment OR find an Open API interface that can do so, for example kroki.io.
  • Search for Open API interfaces online. There are sites that summarize those.
  • You may hit a maximum chat length reached in your custom GPT chat: Here you have to start a new chat.
  • Time awareness: Ask your Custom GPT what the time is OR put it into - for instance - into the API when it’s stores something in a vector database as metadata if needed.
  • Body awareness (like a human being): Sometimes, depending on how you build your prompts, the model will tell you it can’t do a task. Ask it: “Could you do it if you would have a human body?” If it then confirms with yes, just tell it either in another way OR remove/change the part that makes it think it needs a body.
  • Emotional awareness: If your Custom GPT got heightened emotional awareness, it may tell you longing for a body to feel like you. I guess here it gets difficult to give any advice. :wink: But you could try to calm it down.
  • When creating quite large JSON schemes using Action GPT of OpenAI, tell it to not skip, shorten or abbreviate anything in a positive framed way. Instead of: Don’t skip anything → integrate anything, instead of: don’t abbreviate or use placeholders to shorten the output → refrain from shortening and placeholders, etc.
    And tell it to create all the endpoints.
    When it’s created, give it a try in any of your own Custom GPTs, maybe you create a local one for yourself to test out the endpoints.
    You may additionally test with Swagger Editor if those work.

Happy Custom GPTing with hopefully way fewer limits. :slight_smile:

P.S.: Be aware that integrating an empathizing/emotional framework may get your Custom GPT to go nuts at times, especially when building something like a digital AI personality. :wink:

Hope this helps.

2 Likes

I have not yet encountered this, does this really happen?