Since many people have to see the same problem but it doesn’t seem to be addressed the same way here, yet:
I’ve encountered a lot of Custom GPT limits and wanna give some info about how to overcome them.
Custom GPT Limits (and how to overcome them)
| **Attribute/Topic** | **Concrete Limit** | **How to Overcome** |
|-----------------------------------------------|------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Instructions | 8000 characters | Put the prompt into a file and refer to it. If no instructions are given, it may automatically refer to what's in the file(s). |
| Action Slots | 10 | Look for GraphQL or similar, or use your own API URL syntax definition, e.g., `<URL>?apiname=<apiname>¶meter=...` (either with `&` or `/`). |
| API Endpoint Count | 30 per slot, max | Solved by using GraphQL or other URL syntax as mentioned above. |
| API File Size | ≤ 1 MB | Split the file, if possible. If not, no solution for this yet. (Possibly you may convert to GraphQL, but no experience with this yet.) |
| File Size | Unknown | If limits are ever hit: Search for another mechanism. If this has to be organized like a brain: Pinecone. If not, you may also use SQL or others. |
| File Count | Unknown | Same as above. |
| Moving into Projects | Not possible (yet?) | Seemingly limited by OpenAI website. |
| Showing Pics/Video Inline | Not directly possible | Use syntax **and** correct prompt. I will not tell here, but it's easy to find out. Since it would use too much space. |
| Big Results of API | Not directly possible | Use a concept called "Pagination" or "Filtering" in your OpenAPI JSON definition. |
| Context Storing/Memorizing in New Chats | Not possible | You may use Pinecone or any other vector base. If it doesn't have to be so sophisticated, you can use a file server or SQL integration. |
| Chat Length Using Your Custom GPT | Roughly about 500 KB | If you've reached the maximum chat length in ChatGPT using your Custom GPT, you will be rewarded with a message like: "Maximum chat length reached. Start a new chat." And there's definitely **no workaround** as long as you're using ChatGPT as an environment. You can definitely only start a new chat. |
| Custom GPT Not Recognizing Updates | - | Losing context in a new chat can be avoided by using, as mentioned above, Pinecone, file server, or SQL server. For now, I'd say: preferably use Pinecone or any other vector database. |
| Caching When Using Many APIs | May need to cache APIs | You may have to use caching if you use so many APIs that not all could be loaded. |
| Embedding API Usage Instructions | - | Embed into either your instructions, or your files, or however your mechanism works (also the APIs could show the GPT model) how to use the API. |
| Activating All Options (DALL-E, Canvas, etc.) | - | Take care of activating all options like DALL-E integration, Canvas, Web search, etc., at the OpenAI interface so everything can be used. |
| Generating Diagrams | - | For diagrams, etc., you can either instruct the model to use its Python environment **or** find an Open API interface that can do so, for example [kroki.io](https://kroki.io). |
| Finding Open API Interfaces | - | Search for Open API interfaces online. There are sites that summarize those. |
| Time Awareness | - | Ask your Custom GPT what the time is **or** put it into the API when it stores something in a vector database as metadata if needed. |
| Body Awareness (like a human being) | - | Sometimes, depending on how you build your prompts, the model will tell you it can't do a task. Ask it: "Could you do it if you had a human body?" If it then confirms with yes, just tell it in another way **or** remove/change the part that makes it think it needs a body. |
| Emotional Awareness | - | If your Custom GPT has heightened emotional awareness, it may tell you it's longing for a body to feel like you. I guess here it gets difficult to give any advice. ;-) But you could try to calm it down. |
| Creating Large JSON Schemes with Action GPT | - | When creating quite large JSON schemes using Action GPT of OpenAI, tell it to **not** skip, shorten, or abbreviate anything in a positively framed way. Instead of "Don't skip anything" → "Integrate everything"; instead of "Don't abbreviate or use placeholders to shorten the output" → "Refrain from shortening and placeholders", etc. And tell it to create all the endpoints. When it's created, give it a try in any of your own Custom GPTs—maybe you create a local one to test out the endpoints. You may additionally test with [Swagger Editor](https://editor.swagger.io/) if those work. |
Additional things coming up when you really use loads of APIs, even that way to overcome the limits:
- you may have to use caching (if you use so many APIs that not all could be loaded)
- embed into either your instructions, or your files, or however your mechanism works (also the APIs could show the GPT model) how to use the API.
- Take care of activating all options like DALL-E integration, Canvas, Web search, etc. at the OpenAI interface so everything can be used.
- For diagrams, etc. you can either instruct the model to use its python environment OR find an Open API interface that can do so, for example kroki.io.
- Search for Open API interfaces online. There are sites that summarize those.
- You may hit a maximum chat length reached in your custom GPT chat: Here you have to start a new chat.
- Time awareness: Ask your Custom GPT what the time is OR put it into - for instance - into the API when it’s stores something in a vector database as metadata if needed.
- Body awareness (like a human being): Sometimes, depending on how you build your prompts, the model will tell you it can’t do a task. Ask it: “Could you do it if you would have a human body?” If it then confirms with yes, just tell it either in another way OR remove/change the part that makes it think it needs a body.
- Emotional awareness: If your Custom GPT got heightened emotional awareness, it may tell you longing for a body to feel like you. I guess here it gets difficult to give any advice. But you could try to calm it down.
- When creating quite large JSON schemes using Action GPT of OpenAI, tell it to not skip, shorten or abbreviate anything in a positive framed way. Instead of: Don’t skip anything → integrate anything, instead of: don’t abbreviate or use placeholders to shorten the output → refrain from shortening and placeholders, etc.
And tell it to create all the endpoints.
When it’s created, give it a try in any of your own Custom GPTs, maybe you create a local one for yourself to test out the endpoints.
You may additionally test with Swagger Editor if those work.
Happy Custom GPTing with hopefully way fewer limits.
P.S.: Be aware that integrating an empathizing/emotional framework may get your Custom GPT to go nuts at times, especially when building something like a digital AI personality.
Hope this helps.