Hello, I’m thinking to build Q&A bot where the LLM could handle question about related to deep business context. So far I use system message but got stucked with token limit.
What would you suggest to master for my need? Fine tuned, embedding search, or semantic search method ?
Embeddings are a way of doing semantic search, and that’s the direction you want to go.
This blog post might help you understand the process a little better Q&A with ChatGPT + Embeddings - Basic & HyDE Examples - WFH Brian
Fine tuned model might not be a bad shout but embeddings would be the way to go. Also, alongside embeddings, givings sample will allow you more control over the type of output as well