Set of tools and a RAG tool

Prompting
1

I am developing an agent that has a set of tools bind to it.
I would make it possible to answer a set of questions based on Knowlodge Base. These RAG should answer general questions.
I am worried,how the model will deal on having a tool that have broad description as “can answer general questions”. I imagine that it always prioritize the Rag Tool.

How you guys a re dealing with this problem? Is it a good practice to add a Rag tool in the same “agent” ( ReAct)?

2

Yes this seems like poor design.

What is the point of RAG if you can rely on the LLM for a lot of general knowledge?

I think you should consider sticking to a “specialist area” and then make the RAG tool only search when the question hits that “specialist area”.

ie define the scope of what your RAG knowledge contains is imho the first step. And try to be as specific as possible.