Good afternoon.
I am an API programmer and systems integrator and have been approached by a client of mine to assist in developing a chat bot for their business that will answer questions about company policies, FAQs etc, as well as, after authentication, be able to retrieve account details for that client. I even asked ChatGPT how to do this. 
I have found so much material about this, but so little at the same time. As I understand it, I would have a chatbot service setup on the client’s website, and any requests from end-users that need AI responses would be sent through to OpenAI.
There are so many models and options that it blew my tiny mind.
Could somebody please point me in the approximate direction of a suitable chatbot and GPT model that might fit the bill here? Just some pointers would really be appreciated.
Thanks,
Greg
You can try dify.ai or self host flowise.
Flowise will offer you more flexibility whereas dify.ai will offer more stability.
Both of them offer API, and easily embed as a chatbot on your website.
For a quick commercial solution:
You can try
Hi @cdonvd0s
Thankyou for your reply and this information - I’ll start looking through it.
Cheers,
Greg
Hi @greg.hains,
We did exactly that for one of our customers. In our case though we had to build the whole system on our side. Provided the platform had access to the private data (PII) the customer requested that we cannot use any external provider like OpenAI.
So what we did in short:
We used Gemma-2-9b, fine-tuned it with the customer’s data, added a RAG system on top to keep up with whatever new information is coming in, deployed it into a private cloud and added all the integrations with the internal systems.
From our experience fine-tuned Gemma worked fine.
Hope this helps.
Hi @Donkit
Thankyou for contributing your experience - I will note down the products and approach you took and keep it in mind as we build up what we need. Its a huge arena to play in, so knowing where to start was tricky.
Cheers,
Greg