Data CLI preparation tool using python

Hi,

I’m currently working on deploying a fine tuned model through python, instead of manually deploying through azure AI studio in azure openAI. I wanted to know if there is any way to access data cli preparation tool through python library, so that it can automatically remove the duplications from my data file.

Yes; the fine tuning walkthrough in the OpenAI docs talks about the openai tool that you get when you pip install openai.