I’m not a developer, and am looking for something to convert CSV files into JSON appropriate for the system. I’ve found a few solutions elsewhere, but don’t know/trust they’ll do the trick, as it were.
Thanks!
1 Like
If you’re doing fine tuning and want to convert csv into jsonl then you can use a command line tool :
openai tools fine_tunes.prepare_data
4 Likes
There’s no such thing as converting a csv file to a jsonl file the openai api can use?
1 Like
I am very ignorant of Python and command line tools. When I copy/paste your line into my machine’s command line, I get, “‘openai’ is not recognized as an internal or external command,
operable program or batch file.”
@obeydesign
For this issue, please refer this:
I had the same issue, the steps to resolve are documented in the answer here.
2 Likes
Are you hacking on me? What the hell did I do to deserve that?
1 Like
Don’t get discouraged obeydesign, some people here can be a little harsh on non-developers. If you read all the OpenAI documentation really carefully, plus use the search feature on this site, plus look at other people’s github and colab examples, you can find a way to get things done, if you are determined, despite not having a technical background. Not every founder can hire a developer, and if you don’t understand things yourself you won’t be able to properly work with a developer anyway, and they’ll go off on their own tangents if they don’t get high-quality instructions. Non-developers have every right to try these tools. I have no technical background whatsoever and I’ve created a colab environment, created a fine tunes model and am testing it. Happy to share my colab notebook if you like. Don’t try to use your own computer’s CLI - it’s too hard. Use google colab. Also, the only dumb questions are those that you haven’t researched thoroughly yourself first before asking, and learnt as much as you can as background, and then ask precise questions. If you do that people here will be very helpful.
2 Likes
Thank you for your kind words. I’ve worked with devs for over 20 years, but was caught flat-footed by that one response.
1 Like
We are working on an internal tool that provides a web UI to set up finetune data, and more importantly count the number of tokens used in the dataset. Once we finished and tested we will consider open sourcing the UI part out.
2 Likes
I don’t know if this is still a thing, but after ChatGPT finetuning option came out this week, I thought I’d build an open source GUI tool to manage the whole dataset validation, upload, finetuning job creation, monitoring and metrics analysis (not to forget job canceling), and finally testing the trained models on a very playground-ish place.
Oh, as an added bonus, there is a token usage calculator built-in as well.
Feel free to check it out at https://www.openaitools.io
The project’s GitHub is at GitHub - tipani86/OpenAI-Tools: Toolkit to get the most out of your OpenAI Account
A video tutorial is available at https://youtu.be/ZFMahUWQin4
Just FYI…
You absolutely need to charge your website URL.
If you don’t, I am guessing you’ll get a letter from OpenAI’s lawyers in relatively short order.
Your project is good, interesting, and valuable, I would hate to see you get shut down and permanently banned from all OpenAI services.
2 Likes
Change the domain? He’s also the proud developer of not-at-all-confusing catgdp.com. A cat easy to bork.
Think he means this one, and I agree…
Change the domain? He’s also the proud developer of not-at-all-confusing catgdp.com . A cat easy to bork.
Oh no you found me 
Sigh, I guess that’s coming down the road. Too bad they won’t send job offers instead of C&D letters…
1 Like