Fine-tune the GPT-4.1 family using direct preference optimization

You can now fine-tune the GPT-4.1 family using direct preference optimization.

https://x.com/openaidevs/status/1932858051876565475?s=46

https://platform.openai.com/docs/guides/direct-preference-optimization

5 Likes