I need to set up a script in a virtual PHP server that will get the information from that server database and will update more than once, so like I said, other ways of doing it are not an option.
Actually I got it all right.
You @pezcri said you were able to fine-tune davinci-003 and this is totally wrong.
I have it right, you are the one with all the errors. My code works flawlessly and I have been though this debugging before and am trying to help you; but you seem “all over the map” to me.
Don’t shoot the messenger.
You might want to re-read all my posts again as I never said I was using davinci-003 for fine-tuning. I said I made a simple completion request on davinci-003 and it worked just fine.
Ah. I got it.
Sorry, PHP is so messy compared to Python or Ruby just to do some simple API call, it’s easy to miss a detail like that.
Not sure why you needed to post a bunch of working completion code if you are trying to get file upload to work, It’s confusing to busy people trying to help you.
Especially since you did not format you code with indentation, etc before posting, so your code is not easy or enjoyable to read.
Here, @pezcri
This code works flawlessly. Maybe you can use it as a working framework to get your PHP code working?
module Files
def self.get_client
Ruby::OpenAI.configure do |config|
config.access_token = ENV.fetch('OPENAI_API_KEY')
end
client = OpenAI::Client.new
end
def self.upload(filename="#{Rails.root}/app/assets/files/fine-tune.jsonl",purpose='fine-tune')
client = get_client
response =client.files.upload(
parameters: {
file: filename,
purpose: purpose,
})
file_id = JSON.parse(response.body)["id"]
file_id
end
end
Because people will always start asking the most silly questions like “did you turn on your computer first?” so to prevent that I showed that cURL is working just fine on my server, for example, thus avoiding all kind of questions that will not help on the matter.
I posted working perfectly good working Ruby code to help you.
You can use it as a model to get your PHP file uploading to work if you like.
Good luck
From what I can see the only different is that its showing the full path to the file, but I did try that, also not working, that is why I ran out of ideas and came here.
Yeah, I understand. I stopped using CURL “forever” ago and ended all development using PHP over 3 years ago after decades of PHP work. Life is too short …
Good luck with PHP. Sorry cannot help more and also for annoying you
I agree with @PaulBellow, you @pezcri should move to a server where you can run Python, at least 
Actually I just got it right, seems like this was the problem.
$opts = array(‘purpose’ => ‘fine-tune’, ‘file’ => $c_file);
$post_fields = json_encode($opts);
There was no need to json_encode, so the correct was to just:
$post_fields = array(‘purpose’ => ‘fine-tune’, ‘file’ => $c_file);
1 Like
Thanks for coming back to let us know.
I should’ve spotted that in your original post. Apologies.
The error message probably could’ve been a little clearer probably.
Glad you got it sorted!
1 Like
If I try using it without json_encode I am getting this error
{
"error": {
"message": "The browser (or proxy) sent a request that this server could not understand.",
"type": "server_error",
"param": null,
"code": null
}
}
The training data file is in the same directory the cURL is executed from
$headers = [
'Content-Type: multipart/form-data',
'Authorization: Bearer '.$OPENAI_API_KEY
];
$c_file = "trainingdata.jsonl";
$opts = array('purpose' => 'fine-tune', 'file' => $c_file);
$ch = curl_init();
$curl_info = [
CURLOPT_URL => "https://api.openai.com/v1/files",
CURLOPT_RETURNTRANSFER => true,
CURLOPT_ENCODING => '',
CURLOPT_MAXREDIRS => 10,
CURLOPT_TIMEOUT => 30,
CURLOPT_FOLLOWLOCATION => true,
CURLOPT_HTTP_VERSION => CURL_HTTP_VERSION_1_1,
CURLOPT_CUSTOMREQUEST => "POST",
CURLOPT_POSTFIELDS => $opts,
CURLOPT_HTTPHEADER => $headers,
];
curl_setopt_array($ch, $curl_info);
$result = curl_exec($ch);
Any idea what might be wrong?
1 Like
Finally, I have managed to do it like this
$headers = array();
$headers[] = "Content-Type: multipart/form-data";
$headers[] = "Authorization: Bearer sk...";
$cf = new CURLFile("trainingdata.jsonl");
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, "https://api.openai.com/v1/files");
curl_setopt($ch, CURLOPT_POST, true);
curl_setopt($ch, CURLOPT_POSTFIELDS, ["purpose" => "fine-tune" ,"file" => $cf]);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_HTTPHEADER, $headers);
$result = curl_exec($ch);
curl_close($ch);
I hope this helps someone!
3 Likes
Excellent and thank you for sharing!
2 Likes
Hello T_ray,
Sorry I forgot about the “new CURLFile” part, glad you solved it by yourself.
Anyway, since I did not find this anywhere, I will leave my full code here for: file uploading, retreving fine tune id, fine-tuning and making a completion with your trained model. Hope it helps the few id!ots like me who still need to use PHP for this:
Step 1: Uploading a fine-tune file (given that you already have a formated jsonl file):
$headers = array();
$headers[] = "Content-Type: multipart/form-data";
$headers[] = "Authorization: Bearer **YOUR_KEY**";
$c_file = new CurlFile("file.jsonl", 'application/json', "file.jsonl"); // file must be in the same directory
$post_fields = array('purpose' => 'fine-tune', 'file' => $c_file);
$ch = curl_init();
$curl_info = [ // some of this options are probably not needed
CURLOPT_URL => "https://api.openai.com/v1/files",
CURLOPT_RETURNTRANSFER => true,
CURLOPT_ENCODING => '',
CURLOPT_MAXREDIRS => 10,
CURLOPT_TIMEOUT => 30,
CURLOPT_FOLLOWLOCATION => true,
CURLOPT_HTTP_VERSION => CURL_HTTP_VERSION_1_1,
CURLOPT_CUSTOMREQUEST => "POST",
CURLOPT_POSTFIELDS => $post_fields,
CURLOPT_HTTPHEADER => $headers,
];
curl_setopt_array($ch, $curl_info);
$result = curl_exec($ch);
if (curl_errno($ch)) {
echo 'Error:' . curl_error($ch);
}
curl_close($ch);
echo $result; // you will find the file id here, which should look like this: file-g4mXvDisehjEKLSNKiUSDnBQAy
Step 2: Fine-tune a model with that file
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, "https://api.openai.com/v1/fine-tunes");
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt($ch, CURLOPT_POSTFIELDS, '{
"model": "davinci",
"training_file": "file-g4mXvDisehjEKLSNKiUSDnBQAy"
}');
curl_setopt($ch, CURLOPT_POST, 1);
$headers = array();
$headers[] = "Content-Type: application/json";
$headers[] = "Authorization: Bearer **YOUR_KEY**";
curl_setopt($ch, CURLOPT_HTTPHEADER, $headers);
$result = curl_exec($ch);
if (curl_errno($ch)) {
echo 'Error:' . curl_error($ch);
}
curl_close ($ch);
echo $result; // you will find the fine-tune id here, which should look like this: ft-OQeSiun18gzOSKE5sRVtYA7T
Next steps in the following reply…
1 Like
Step 3: Retrieve the fine-tuned model id (you need to wait until it is uploaded, it could take up to 30 minutes, or maybe more?)
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, "https://api.openai.com/v1/fine-tunes/ft-OQeSiun18gzOSKE5sRVtYA7T");
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt($ch, CURLOPT_POST, 0);
$headers = array();
$headers[] = "Content-Type: application/json";
$headers[] = "Authorization: Bearer **YOUR_KEY**";
curl_setopt($ch, CURLOPT_HTTPHEADER, $headers);
$result = curl_exec($ch);
if (curl_errno($ch)) {
echo 'Error:' . curl_error($ch);
}
curl_close ($ch);
echo $result; // you will find the model id here, which should look like this: davinci:ft-personal-2023-02-07-05-20-40
As I said, you need to wait until the fine-tune is uploaded, and you can find out by checking the [events] array in this request. There should be an event which gives you the uploaded model name. If you can’t find it that means you still need to wait. You can check the available events to check the progress.
Step 4: Make a completion with your fine-tuned model
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, "https://api.openai.com/v1/completions");
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt($ch, CURLOPT_POSTFIELDS, '{
"model": "davinci:ft-personal-2023-02-07-05-20-40",
"prompt": "**YOUR_PROMPT**",
"max_tokens": 100,
"temperature": 0,
"top_p": 1,
"frequency_penalty": 0,
"presence_penalty": 0
}');
curl_setopt($ch, CURLOPT_POST, 1);
$headers = array();
$headers[] = "Content-Type: application/json";
$headers[] = "Authorization: Bearer **YOUR_KEY**";
curl_setopt($ch, CURLOPT_HTTPHEADER, $headers);
$result = curl_exec($ch);
if (curl_errno($ch)) {
echo 'Error:' . curl_error($ch);
}
curl_close ($ch);
echo $result;
Hope it helps.
1 Like
@pezcri Thanks for the great example code.
Wondering if you might have an example for a “Step 5” , where you add new data to the already existing, fine-tuned model from steps 1-4 ?
@yabdab
I did not try it, but I think according to the documentation all you have to do is repeat step 2 replacing the model with your trained model name.
So, you have to replace “model”: “davinci” with “model”: “davinci:ft-personal-2023-02-07-05-20-40” which is the model id you get from step 3.
1 Like