You need to do a “pip install openai” in the terminal to ensure you have that libraryavailble to your python installation.
As to the venv, depends if you asked for it to give you the instructions for that.
Or, perhaps you are refering to the built in code-interpreter?