According to whats been said in Finetuning for Domain Knowledge and Questions, fine tuning a model does not teach it about knowledge, instead it tries to learn about text patterns, which enables it to answer in a more human-like vibe.
That said, I assume what your dataset might acheive is teaching it to write a formatted court case. I guess you might notice it creating perfect and complete reports but with errors in rules.
1 Like