I run into an issue where the 128k context window is not enough for my use case since the input is very text-heavy. So I run into max token error. Can anyone suggest how to solve this? Does OpenAI plan on increasing context window?

How to have a longer context window?

ami12 March 3, 2024, 10:58am 4

I’m trying to parse thousands of reviews to quickly understand what users liked & didn’t like. If the number of reviews is more, I run into the aforementioned error.

Topic		Replies	Views
Best method of injecting relatively large amount of context to be leveraged in a response API	10	12383	December 17, 2023
How to Increase context length API	8	15656	March 7, 2023
How to build a Question and Answer Bot for context greater than 2048 tokens? Prompting	3	1810	December 17, 2023
Practical Tips for Dealing with Large Documents (>2048 tokens) API	6	8736	December 17, 2023
Use file with text-davinci-001 to increase tokens in prompt Prompting	13	2634	December 15, 2023

How to have a longer context window?

Related topics