Unable to run the command Line interface (CLI) for openai

@m-a.schenk not yet. Is “tools” an application, surely there must be an executable? or can we run it via python tools.py or something like that? The comment about adding a system path variable is also confusing. I’ve added the API key as a OPEN_AI_KEY variable for good measure, but that’s not a path variable and not the issue (I don’t think.) So, when adding path variable, what path should it point to? I’ve run pip install openai, so I now have an openai folder inside my python39/Lib folder, but I don’t see anything that resemples “tools”, or “prepare-data”. I’ll admit, I know nothing of Python.

I’m referring to this link in the documentation:

I want to edit training data

2 Likes

Thank you @m-a.schenk, I’ve never used Colab, had no idea how simple it would be. Tried it, worked fist time, so I’ll just run the openai tool online whenever I need it :stuck_out_tongue_winking_eye:

1 Like

@carla ;
Another way to use it is using WSL.

However, it still doesn’t answer the original question.

1 Like

Will definitely do that right away. Thanks for the suggestion.

Indeed it doesn’t answer the original question, sorry for hi-jacking your thread :grin:

And cool, I’ll keep WSL in the back of my mind, thanks for mentioning it. Colab seems simpler right this moment, perhaps once I get to large training files, I’d revisit this same question…

1 Like

@carla @m-a.schenk
Thanks guys for engaging me. I finally figured it out. Putting this out there so that someone else can benefit.

Problem: “openai” is not recognized as an internal or external command, operable program or batch file.

Solution.
step 1. run “where openai” from the anaconda prompt. You will get a path to the scripts folder.
image

Step 2. Navigate to the folder using “cd . Make sure you remove the openai from the end.”
image

Step 3: Run “python openai …arguments” from this location.

6 Likes

Awesome, thanks @vaibhav.garg!

2 Likes

@carla Did you try the steps out, do they work for you?

To be honest, I ran into different issues, running in anaconda, I couldn’t “see” openai, so I ran the pip install inside of anaconda, and had missing packages, and ran into access issues trying to install those packages…

…after which I gave up thinking, if I need to run openai tools locally, I’ll get back to this post :grin:

1 Like

LOL, people with vaccination passports I guess

I Agree, in principle.

Virtual environments get you a large way there, venv, or anaconda etc. With slightly more configuration, docker containers are also extremely powerful.
No need for an internet connection, you can just reset and move on, as you said; once you are successful, the entire container can be scalably deployed as well.

Besides, for data science work, using a cloud hosted virtual machine has an extra hassle of uploading the data sets and downloading the model to be deployed. The dataset I am currently woking on is a 12 GB txt file with over 300 million rows. It would be hard to upload it somewhere while I figure out how to slice and dice it for analysis.

Thanks for posting this, I had the same issue, and you led me to the (start of) the solution. I went to the Scripts folder and just had to add “Python” before “openai,” and it worked.
However, I’m still stuck at the point of adding the API key. I get an error of “[Errno 2] No such file or directory,” and nothing seems to make it work.
Any ideas?

Can you try passing the key directly “in the clear” rather than using the environment variable approach?
python openai --api-key sk-YOURKEYHERE --verbose

I assume that you are within the scripts folder. Set to verbose to see what comes up.
HTH.

2 Likes

Thanks a lot. It’s what I did before, but I get the help screen. It doesn’t seem actually to accept the key.
try

2 Likes

You are almost there. The rest of the arguments are not optional. Once you supply them, the command would work.

For reference, anything in [ ] is optional, anything else in { } is not. You need to use one of the tools or api arguments and proceed from there.
python openai --api-key sk-SOMETHING api answers… and so on.

2 Likes

Worked!
Thanks a lot, I tried to do it in two steps for hours :sweat_smile:

2 Likes

Glad it worked.
The commands are atomic, i.e. they do not save state between runs. So everything you do, has to be done in ONE step.

For reference, you can open up the openai file in your favorite editor (its just a .py file, without an extension) and have a look.

2 Likes

Add openai path to your environment variable.

navigate to an environment variable in the control panel, there you will find edit PATH in user variable.

add the path openai exe file.

1 Like

https://anaconda.org/conda-forge/openai

conda install -c conda-forge openai

works and I tried with Anaconda3-2021.05-Windows-x86_64.exe.

Description

The OpenAI Python library provides convenient access to the OpenAI API from applications written in the Python language. It includes a pre-defined set of classes for API resources that initialize themselves dynamically from API responses which makes it compatible with a wide range of versions of the OpenAI API.

This library additionally provides an openai command-line utility which makes it easy to interact with the API from your terminal. Run openai api -h for usage.

2 Likes