Fine-tuning is not intended for use cases involving Q&A. Instead, you should be looking at the application of RAG. I have just the other day compiled a post to another user who was in a very similar situation complete with links to relevant resources, which you may find useful. See in the following: