Finetuning with small amount of data and niche topic

Community
1

I design one model

when user write any thing , any prompt , My model will identify text and give me response
user’s text is for Income or expanse , as well as I try to check amount and for what user spend or from where to earn

here I make one finetune small data ( below 100 line )

some time I get proper response and in 80% cash I get wrong response

so what I want to do ?

2

This is part of research and development, and typically it’s unique to each use case.

If you can provide some examples of your prompts and responses, showing where the error cases are, also include the code used to call the API and any setup/support code that it relies upon and perhaps others may spot common issues they have seen before.