We want to use OpenAI (Text Completion) API to handle large document (100 pages for example) to answer multiple questions based on the document. Since there are 4000-token limitation, we will need to split the whole text into smaller chunks and send to OpenAI API. But we do not want to do summarizat…

Chained Prompt to complete text larger than 4000 tokens?

Topic		Replies	Views
Help Needed: Tackling Context Length Limits in OpenAI Models Community gpt-4 , chatgpt , token , rate-limit , openai	8	17146	February 8, 2024
Token Limitization Error when prompting Prompting chatgpt , api	8	3336	December 6, 2023
Gpt-3.5-turbo-16k Maximum Response Length Prompting api	33	34707	December 13, 2023
Longer GPT 3.5-turbo Output Prompting gpt-35-turbo , api	23	4354	December 8, 2023
How to handle long prompts that exceeds the token limit? API	2	3043	December 25, 2023