Help Needed with Integrating a Knowledge Base Using the OpenAI API

API
,
1

Hello everyone,

I’m currently developing an AI assistant using software built on the OpenAI API, and I want it to include its own knowledge base. The OpenAI API provides the technical foundation, enabling advanced AI functionalities in the assistant. I have meticulously structured the knowledge document and crafted detailed prompts so the assistant can ideally access all relevant information directly from it.

However, I’m encountering an inconsistent issue when querying the assistant via the API: for simple questions that should be easily answered using the knowledge document, it sometimes works perfectly, and other times it doesn’t.

An example: When I ask, “Who owns the company you work for?” the assistant sometimes provides the correct answer and sometimes doesn’t. When I then ask if it knows who Max Mustermann (the company’s founder) is, the assistant will explain that Max Mustermann is the owner of the company. This indicates that it can access the knowledge document, but it does so inconsistently.

My question to the community: Do you have any tips or experiences with why the assistant might be accessing the knowledge base inconsistently?

I appreciate any insights and look forward to your advice and experiences.

Thank you in advance!

2

Hello Jannis, You should develop RAG based knowledge management application. Write all your knowledge base to documents and ingest them in to a RAG based system. You can then use queries to carry out semantic search for the required information.

1 Like
3

Hey!

Thank you very much for your suggestion regarding the RAG approach. I am currently working with a platform called Agentive, which appears to offer similar functionality. Agentive vectorizes the content in my knowledge base, enabling semantic search and contextual retrieval of information. This seems to align closely with the vectorization and semantic search capabilities you mentioned.

However, I’m still experiencing some inconsistency with responses. Do you have any further recommendations on how I might improve the consistency of the answers? Or would you suggest any additional steps to ensure the assistant reliably retrieves relevant information from the knowledge base?

Thank you again for your insights, and I appreciate any additional guidance you can provide.

Best regards,

Jannis