Hi, yes the above mentioned requirements can be met. The demo I gave is just for educational demonstration purpose. But in a production environment, I would use a vector database like elasticsearch to store my embeddings and use the built in cosine similarity to score the paragraphs and pull the most relevant ones out.
I am actually professionally working on these projects now on online market places. And for my latest project we had a lot of data coming in, so we distributed the data into multiple elasticsearch indexes depending on the data context. And only search in that index for a particular topic. So yeah what you said can be implemented.
We also have a UI and used telegraf.js to implement the telegram bot. This is the easiest and efficient implementation I think. I hope the best for you in implementating this, or if you need professional help with this project, you can reach out to me.
Thanks,
Talha