Best format to store productsq

I am trying to create a product recommendation system, and currently using hybrid search with vectorstore and bm25. It works kind of OKAY, but the problem is that I have 2000 products, currently stored in .csv files. The bot sometimes mixes up data, for example, all products has links, but sometimes the bot creates the links by itself… I tried experimenting with prompting a lot, can’t fix the problem.

Any tips?

Get the bot to give you the product key, and then do a sql query on your links table? :thinking: