How to use o1 or 4o-mini api to analyse and summairze a large text doc like over 40k words as a newbie?

[jr.2509]

It sounds like what you are trying to do is similar to semantic chunking of a document.

We have an extensive thread on the topic here including techniques and code examples on how to accomplish that:

Using gpt-4 API to Semantically Chunk Documents

I am creating this topic based upon the thread of conversations which developed from this post: RAG is not really a solution - #43 by SomebodySysop While a number of us have different approaches to the first tier of “Semantic Chunking”, like @sergeliatko 's API: RAG is not really a solution - #50 by sergeliatko we were all still looking for a way to have the LLM do that last bit of “sub-chunking”, where instead of simply chopping the chunk up by size we have the model look at it and determine t…

If your document is structured into different sections, which are demarked by section and subsection headers, then it is fairly straightforward to achieve that.

I have created my own summarization tool grounded in semantic chunking and can attest that you can generate fairly detailed summaries with this technique while ensuring that the logical flow of the original document is maintained.