Is there a plugins that can process text that is greater than 4000 Tokens?

I need input 25,000 words (Larger than 4000 tokens) but ChatGPT doesn’t process this length of text.

Are there any alternatives out there? I would like to create scaffold format summaries notes.

Anyone know how to help or point me in the right direction?

Two strategies I’m aware of:
@ruv has a plugin that breaks the text into chunks and spawns parallel gpt-3.5-turbo requests for each chunk, then combines the results.
@bruce.dambrosio (me!) has a plugin that uses query and keyword processing to extract a relevant subset of text, then send that to gpt-3.5-turbo for final processing.
look for llmsearch on github for the code.

1 Like