1

Sometimes the completion I get from the fine-tuned model differs from the sheet that I have converted to jsonl then uploaded through CLI.

Instead of yes, I get no, and vice versa. The answers should be exactly the same.

How to make the answers exact (I tried setting up the temperature to zero, but no vail.

2

did you provide answers to the questions and uploaded. and did you ask the same question

3

What model did you fine-tune from? How many samples? What are your API settings (temperature, etc…)

4

Yes. The prompt and completion is as follows {“prompt”:“Is ‘tea wholesaler’ relevant to teadepot.com?“,“completion”:” Yes\n”}. And by asking the same question sometimes I receive no as an answer.

5

I have used Davinci. and the data is about 400 samples. And I have tried to use different temperature settings no no vail

6

Are you using the \n for a stop-word?

You might try to up it to 800 samples and go again.

Good luck!

7

Yea I used \n. I uploaded huge data

8

Now the answers are coming right for 90% of the time which is good. (by giving the model huge data). Thanks for the help!

Regards
Prakeet Singh