Currently I have a working chatbot which I can use to extract information from ~2000 documents related to the financial sector. However, I have some questions related to the scaling of this project, because the idea would be to have hundreds of thousands, or possibly millions, of these documents. M…

Scaling RAG chatbot system to millions of documents

anon10827405 February 5, 2024, 7:41pm 7

It’s an option if these types of filters help separate the distances between documents that overlap

Topic		Replies	Views
RAG is failing when the number of documents increase API	35	17919	December 17, 2024
Processing Large Documents - 128K limit API gpt-4	41	7160	November 8, 2024
Open AI prompts for RAG / doc Q&A API api	11	6834	January 9, 2024
Embedding - text length vs accuracy? API	13	15502	December 25, 2023
RAG Evolution with Reasoning Models Community api	10	303	April 30, 2025