Create ChatBot learned from hundreds documents with embeddings

[merefield]

Read this topic:

RAG is failing when the number of documents increase

I wanted to check if others are also facing the same issue. When we have small number of documents, the embedding fetches n number of docs based on a threshold and then we take top-n out of them which has the potential answer for the question. When the number of documents increase, the chunk with the answer gets pushed down to lets say n-k position and when we take the top-n chunks, that chunk is left out. I can increase the top-n but that is not a sustainable solution, it will fail somewhere e…