How you deal with response limit in a single API request?

GPT builders Plugins / Actions builders
, , , ,
1

Hi everyone,

Here is the case. I’m using an Action that uses GET API endpoint and gets a text in response. Everything works fine, but if there is too much text, there is an error saying: “The response size appears to be too large for processing”

How to deal with these limits? What are they exactly for a single API response?

Have anybody struggled with such a problem and do you know if GPT could manage partial response retrieval?
For example, for one single API request, the response will have multiple file/text segments in response. Has anybody tried this?

Keep in mind, that it’s not a token limit or anything, because if I manually upload the same text to GPT, the retrieval and other stuff work as intended.

Will appreciate any relevant help and knowledge to solve this. Thanks!

3 Likes
2

Facing the exact same issue here in 2024 Feb.

In my case, I have implemented a custom action to hit the Google Calendar GET calendar event API

No matter how I limit the timeframe, the response seems to be exceeding the limit of what ChatGPT can process.

Any solutions for this?

1 Like
3

There seems to be a limit of 100,000 bytes for a single return.

4

My custom API returns a lot of text and I finally just ran into this limit myself. In the failed return, the data size is about 109k and 21k tokens. I believe the poster above is correct, the limit is 100k bytes.

I am going to be doing a number of tests today to determine if that is correct.

5

I’m having the same issue myself, couldn’t get it to work :frowning: