Hello ! I’m working to build gpt, i want to use actions to fetch data listings from an external database thru actions. Despite GPT-4’s ability to handle up to 128k tokens, we’re encountering obstacles with managing large data during external API calls. Anyone have similar problem?

Can't fetch large data from external API calls despite GPT-4's ability to handle up to 128k

Foxalabs November 12, 2023, 3:17pm 2

What is the specific problem you have? My guess will be due to rate limits and you not having sufficient tokens per minute to execute a large API call request.

Can't fetch large data from external API calls despite GPT-4's ability to handle up to 128k