Delete finetuned model not working

Calling
https://api.openai.com/v1/fine-tunes
I get my fintuned models, but when I use the fine_tuned_model-Param of one of the models (f.e. davinci:ft-personal-2023-02-20-13-14-07) to delete it I get a 404 (Rest: DELETE https://api.openai.com/v1/models/davinci:ft-personal-2023-02-20-13-14-07)

What am I doing wrong?

Hi @christian.kiefer

Sharing the code you use to make the call will be much helpful.

Hi sps, the code is the url. But when you are interested, here the Flutter/Dart-Code:

  void deleteFiles(String apiKey, String id)async{
    http.Response response = await http.delete(
      Uri.parse('https://api.openai.com/v1/files/$id'),
      headers: {
        'Authorization': 'Bearer $apiKey',
      },
    );
  }

But what I found out now is that the models I try to delete are already deleted -I cannot see them in the playground anymore.

But when I call

  Future<List<FineTuneModel>> listFineTune(String apiKey) async {

    http.Response response = await http.get(
      Uri.parse('https://api.openai.com/v1/fine-tunes'),
      headers: {
        'Authorization': 'Bearer $apiKey',
      },
    );

    Map<String, dynamic> result = json.decode(utf8.decode(response.bodyBytes));

    List<FineTuneModel> models = [];
    for (var i = 0; i < result["data"].length; ++i) {
      models.add(FineTuneModel.fromJson(result["data"][i]));
    }

    return models;
  }

I get them even if they are deleted.

So I created a new finetuned model and and deleted it → deletion was successfull (response) but it is still in the list I get when I call https://api.openai.com/v1/fine-tunes.

Hi @christian.kiefer

Please use the fine-tune retrieve method and post the full output JSON data wrapped with Markdown triple backticks.

Thanks

:slight_smile:

2 Likes

That is because it lists fine-tune jobs and not fine-tuned models.

To know what models are available to you including fine-tuned models, you have to call list Models endpoint

1 Like

I think you will find that looking at the fine-tuning retrieve (by fine-tune id) provides more details information as to why a model may or may not have problems:

Let’s take a look:

List Models (focus on babbage:ft-personal-2023-02-17-04-12-03)

  {"id"=>"babbage:ft-personal-2023-02-17-04-12-03",
    "object"=>"model",
    "created"=>1676607123,
    "owned_by"=>"user-9tvruzpl3hx6md9utbhurjvq",
    "permission"=>
     [{"id"=>"snapperm-QhPvNOAg0K8we6TWtwGVcFfl",
       "object"=>"model_permission",
       "created"=>1676607123,
       "allow_create_engine"=>true,
       "allow_sampling"=>true,
       "allow_logprobs"=>true,
       "allow_search_indices"=>false,
       "allow_view"=>true,
       "allow_fine_tuning"=>true,
       "organization"=>"org-8NVL8HQqnPUflKtLPue836T7",
       "group"=>nil,
       "is_blocking"=>false}],
    "root"=>"babbage:2020-05-03",
    "parent"=>"babbage:2020-05-03"}

Retrieve Fine-Tune by ID (focus on babbage:ft-personal-2023-02-17-04-12-03)

Much more detailed info:

{"object"=>"fine-tune",
 "id"=>"ft-tI7SnFBsZrulb0kfrKK2wLUe",
 "hyperparams"=>{"n_epochs"=>8, "batch_size"=>1, "prompt_loss_weight"=>0.01, "learning_rate_multiplier"=>0.1},
 "organization_id"=>"org-8NVL8HQqnPUflKtLPue836T7",
 "model"=>"babbage",
 "training_files"=>
  [{"object"=>"file",
    "id"=>"file-6sU2DVOsDJ8ps8FXlMyPYudT",
    "purpose"=>"fine-tune",
    "filename"=>"fine_tune_1676603619.jsonl",
    "bytes"=>101,
    "created_at"=>1676603620,
    "status"=>"processed",
    "status_details"=>nil}],
 "validation_files"=>[],
 "result_files"=>
  [{"object"=>"file",
    "id"=>"file-akRohitdI5ca6JwgKwWdXTzo",
    "purpose"=>"fine-tune-results",
    "filename"=>"compiled_results.csv",
    "bytes"=>546,
    "created_at"=>1676607124,
    "status"=>"processed",
    "status_details"=>nil}],
 "created_at"=>1676603621,
 "updated_at"=>1676607125,
 "status"=>"succeeded",
 "fine_tuned_model"=>"babbage:ft-personal-2023-02-17-04-12-03",
 "events"=>
  [{"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Created fine-tune: ft-tI7SnFBsZrulb0kfrKK2wLUe",
    "created_at"=>1676603621},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Fine-tune costs $0.00", "created_at"=>1676606516},
   {"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Fine-tune enqueued. Queue number: 7",
    "created_at"=>1676606516},
   {"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Fine-tune is in the queue. Queue number: 6",
    "created_at"=>1676606643},
   {"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Fine-tune is in the queue. Queue number: 5",
    "created_at"=>1676606676},
   {"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Fine-tune is in the queue. Queue number: 4",
    "created_at"=>1676606730},
   {"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Fine-tune is in the queue. Queue number: 3",
    "created_at"=>1676606744},
   {"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Fine-tune is in the queue. Queue number: 2",
    "created_at"=>1676606894},
   {"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Fine-tune is in the queue. Queue number: 1",
    "created_at"=>1676606914},
   {"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Fine-tune is in the queue. Queue number: 0",
    "created_at"=>1676607049},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Fine-tune started", "created_at"=>1676607082},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Completed epoch 1/8", "created_at"=>1676607101},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Completed epoch 2/8", "created_at"=>1676607101},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Completed epoch 3/8", "created_at"=>1676607101},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Completed epoch 4/8", "created_at"=>1676607101},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Completed epoch 5/8", "created_at"=>1676607101},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Completed epoch 6/8", "created_at"=>1676607102},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Completed epoch 7/8", "created_at"=>1676607102},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Completed epoch 8/8", "created_at"=>1676607102},
   {"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Uploaded model: babbage:ft-personal-2023-02-17-04-12-03",
    "created_at"=>1676607123},
   {"object"=>"fine-tune-event",
    "level"=>"info",
    "message"=>"Uploaded result file: file-akRohitdI5ca6JwgKwWdXTzo",
    "created_at"=>1676607124},
   {"object"=>"fine-tune-event", "level"=>"info", "message"=>"Fine-tune succeeded", "created_at"=>1676607124}]}

HTH

1 Like

I created a fine-tuned sentiment model: sample_fine_tuned_model.

The below code still gives me That “model does not exist”
openai.Completion.create(model = sample_fine_tuned_model, prompt = “Staff was very rude.”)

Am I doing something wrong?

Do you have the fine-tuning ID?

:slight_smile:

I tried fine-tuning ID. Still getting the same error.