AMA on the 17th of December with OpenAI's API Team: Post Your Questions Here

Have you tried generating your own datasets for DPO using O1?