How to send long articles for summarization?

i was not happy with the map reduce function of langchain as summery of a summery just lose too much detail and the overall output is still too short because of the capped output length

Try out this method GitHub - emmethalm/infiniteGPT: InfiniteGPT is a Python script that lets you input an unlimited size text into the OpenAI API. No more tedious copy & pasting. Long live multithreading!
it creates a summery for smaller chunks and then it just append all together. This way your output is much longer and you have more detail

4 Likes