How to send long articles for summarization?

[SomebodySysop]

@sunco007

Here’s what I did:

1. Combine the paragraphs based on the number of tokens.
2. Send them to create a summary.
3. Combine the previous summary with the following paragraphs based on the number of tokens.
4. Send them to create a summary.
5. Go back to step 3.

In other words, the “Refine” method.

• Building a Summarization System with LangChain and GPT-3 - Part 1 - YouTube
  • Summarization Methodologies
    • Refine
      • Chunk document. Summarize first chunk. Summarize 2nd chunk + 1st chunk summary. Summarize 3rd chunk + 1st and 2nd chunk summary. And so on…