AMA on the 17th of December with OpenAI's API Team: Post Your Questions Here

Community
, ,
40

Is it possible to do both supervised and preference fine tuning on a model?

Can you do preference fine tuning on an existing model fine tuned with supervision?

4 Likes