I have attached a json file with links in this form.
{
"Topic": "Podcast - Building a Culture of Automation",
"Link": "youth be 12345",
"Type": "Video"
},
{
"Topic": "Homepage",
"Link": "example com",
"Type": "Page"
},
And I want that when my chatbot is asked about a topic, it would find a link from this file (and there are about 100 links) and give it at the end of the answer (or for the link to be the answer).
Sometimes it is, but it happens that he gives links to other websites, or invents non-existent links.
To build on @nicholishen suggestion⌠I would send markdown instead of JSON. This will give you better control over where your text is split at by their RAG system. So instead of JSON, upload a file structured like this:
## About ZAPTEST
Link: https://youtu.be/I2MtwdPCTS8
Type: Video
## interview with CEO
Link: https://youtu.be/SSjrbeW_J3s
Type: Video
The ## headers create clear break points in your file so that its more likely the RAG system will return whole records when generating text chunks.
The other thing Iâd recommend is including the descriptions if you have them. This will result in better similarity matches when their RAG system queries your file. The key thing to understand is that when using RAG theyâre not showing your whole file to the model. Theyâre only showing it part of the file so the more descriptive like text you include, the more likely theyâll select the parts of your file that best match what the user is looking for.