Fine-tunning davinci wrong output

API
1

Hey guys I’m fine-tuning davinci and I don’t know how to teach a particular thing, I’m trying a very simple thing Given: Peter Park | England I want the completion Peter Park lives in London, 6 (where London is the capital of the country input and 6 is the capital length)
it’s working correctly with the capital output but it never gets the length, the training dataset has 840 examples but it still guesses random numbers How would I train it to understand that the final number is the capital length?

Dataset example: {"prompt":"John Smith | Armenia ->","completion":" John Smith lives in lives Yerevan, 7 #END"}

image
image2160×572 60.3 KB

1 Like
2

Welcome to the community.

Fine-tuning is super-finicky and because it’s the older Davinci, it’s even more troublesome at times. Add to that LLMs not being great at counting (without help), and it can be difficult.

In your case, I might try something like…

England (7 characters)
`Peter Park lives in London (6 characters)

etc in your dataset examples. …

Or maybe…

England (7 letters)
`Peter Park lives in London (6 letters)

etc… You’re asking it to guess that the number is tied to the city name, but you’re not giving it enough clues to make the assumption. Try giving it a bit more data in your prompt/examples.