Mystery of the undeleletable fine-tuned model

Hello.

Can you help me?

I can’t delete my fined tuned model, i’m onwer of organization and im receiving

{
“error”: {
“message”: “You have insufficient permissions for this operation. Missing scopes: api.delete. Check that you have the correct role in your organization (Owner), and if you’re using a restricted API key, that it has the necessary scopes.”,
“type”: “server_error”,
“param”: null,
“code”: null
}
}

what can i do?

The landscape has significantly changed since this thread was started over a year ago.

OpenAI now has projects, and personal data such as a fine-tune (along with more revealing information like assistant threads), is scoped to a project for some degree of isolation between clients.

The documentation is lacking, and the implementation, trying to integrate with and not break existing organizations and key rights, has faults. Then there are simply flaws, like not being able to re-tune from a existing fine-tune, for no apparent reason except for oversights.

To wit: you will need to discover the API key and project that was doing the modifications, and reuse that, ensuring the endpoints are enabled. If it doesn’t work, elevate the level of rights to that of a user key (the original type of org key) and attempt again.

The “delete” doesn’t clean up anything in model listings or the web UI; it only makes your model uncallable.

3 Likes

I’m in the maximum permission… The option is all.

I create fine tuned in web ui not in api… Just for testing.

But now I can delete…

So, no matter how many finetuned I create I can delete these models?

How many finetuned I can create?

Now I can’t delete…
I’m receiving this api error… I just use one apikey.

The web uses its own session credentials, putting some data like threads within its own scope, and doesn’t have an API key for you to use.

Your usage of tools like playground and fine-tune should be associated with the organization->project selection seen at the upper left of the UI at the time of creation.

You can create fine-tune models without limit. You can send the delete API call and the quantity you have created shouldn’t impact the success of this call. You can try to delete already “deleted” models to get an error.

However, expect to see the undesired models still listed when you poll the models endpoint. Therefore there is really no reason to use this, when “delete” only offers more confusion about why the model, still appearing but disabled, doesn’t work right.

So… I don’t need delete?
I’m offering for my users finetuned…

Imagine a lot of finetuned without using…

We cant delete anymore?

Delete should work in the same limited capacity it did before. Mostly pointless. You aren’t charged for retaining a bunch of fine-tune models - that’s OpenAI’s burden that they designed.

If you can’t change the status returned by the API model call to “DELETED”, with a rights error like you show, even when cycling thru all projects and their API keys or even the default project or a user key, then that would be a bug on top of the limited effectiveness of using the delete method.

Archived projects that have resources assigned may be another indeterminate source of challenges.

Can you help me with a guide to check if im owner of project like api response said?

because its not possible i cant delete this finetune model… search in other topics i see other people can delete…

In organization overview, i click in apikeys i have just two.

1 -
OpenAI
sk-…XXXXX
11/06/2024 3/09/2024 AIPlace Lucas Bergamo All

2 - GeneralAPI
sk-…ZZZZZ
3/09/2024 Never AIPlace generalapi All

note:

As an owner of this organization, you can view and manage all API keys in this organization.

DELETE method in this url:

https://api.openai.com/v1/models/ft:gpt-4o-mini-2024-07-18:personal:medical:A3AnO2Fe

{
“error”: {
“message”: “You have insufficient permissions for this operation. Missing scopes: api.delete. Check that you have the correct role in your organization (Owner), and if you’re using a restricted API key, that it has the necessary scopes.”,
“type”: “server_error”,
“param”: null,
“code”: null
}
}

How can i add scope delete ? these 2 apikeys are organization apikeys

how can i check this?
(must be an owner of the org the model was created in

I know the job is one thing and delete model is another… i want delete the model…the job record dont have any kind problem.

…I need create another account? or i can still use this one… because i create a organization for our company

i think its is a bigproblem you create a lot of finetune for your company or users… and you cant remove after if you dont need this model tuned anymore… its like garbage and you cant empty that…

but if i have wrong configuration (api or organization) im here asking help.

thanks!

The user interface is quite bizarre.

At the upper-left after picking “Dashboard” and “API keys”, you will have this selector in the top-left:

Untitled-1

You click on the right side, and can choose different projects you’ve created, and see the API keys shown to you switch.

Then on top of that, you can click “show user keys”. Or: go to the gear icon at upper right instead of dashboard, then “your profile”, then “user keys”. There lives more keys with a different scope still.

Yes, it’s really friggin annoying to not be able to truly purge fine-tuning models. You might have a user interface with a drop-down for selecting model from the API, and it just has a bunch of entries that all look the same and are not what you want. You almost have to write another setting to list and pick which fine-tune models you want to configure to show in the UI dropdown because of the growing list. It does prevent hackers from deleting hundreds or thousands of dollars of training, though.

1 Like

image

this place? i click on avatar picture, after your profile, after user api keys (legacy) … so i create one key …

with all permission set, the problem still happening.

is possible to delete finetune model or its disabled or have a openai problem?

what i have to do to delete the model?

in this place i dont see any other permission options to delete scope…

thanks @_j @ruby_coder

Now with api_key create inside profile / user api keys dont return the job listing.
and not find model to delete…
{
“error”: {
“message”: “The model ‘ft:gpt-4o-mini-2024-07-18:neurok::A3PL6CC6’ does not exist”,
“type”: “invalid_request_error”,
“param”: “model”,
“code”: “model_not_found”
}
}

https://api.openai.com/v1/fine_tuning/jobs
{
“object”: “list”,
“data”: ,
“has_more”: false
}

But apikey listing in organization overview / api keys can list the jobs e give me error to delete…

|OpenAI KEY|sk-…XDWer|11/06/2024|3/09/2024|my Plataform|Lucas Bergamo|All|

what is the scope about this profile api and project api?

what have delete scope? i try delete the finetune with profile api and the response give me not found finetune…

but with project api … gives me i dont have delete scope and check if im owner…

like i said before… im owner of the project… i create the project.

###################################

I create a member service - account in organization called lucas-bergamo

and i set his owner … and have a api key for this user.

but not matter what i change or fix… always give me error os request…

I need remove this finetune model.

It looks like since I last tried deleting there’s been changes:

  • the models endpoint doesn’t return a status any more (along with much other metadata now not provided after a change late last year), where that status would changed to deleted.
  • ft:gpt-4o-x models won’t accept a delete. This is perhaps because of the connected “step” models from a fine-tune.
  • Tried then on a 2023 fine tune of ft:gpt-3.5-turbo-1106, same 403:missing scopes.
  • created a fine-tune in default project and web UI, created a new long default project key, same non-result as user key.

A person really invested in finding out what else still could be done could try against base models. It seems OpenAI has simply pulled back or broken all rights for delete to work with their “scope”, where maybe the only working rights is those partners with an enterprise account, or just OpenAI themselves.

i search somenthing here…

i create other fine tune and after finish i check the owner.

{
“id”: “ft:gpt-4o-mini-2024-07-18:neurok-ai::A3WiMeIu”,
“object”: “model”,
“created”: 1725404102,
“owned_by”: “neurok-igosis”
}

My organization not called neurok-igosis … is something wrong with organization association. @_j @sps @ruby_coder

##############

It seems OpenAI has simply pulled back or broken all rights for delete to work with their “scope”, where maybe the only working rights is those partners with an enterprise account, or just OpenAI themselves.

  • So… its a affimative that we can’t remove fine tuned models ?

https://platform.openai.com/docs/api-reference/models/delete

This endpoint not work right? I think openai or some responsible have to tell to all users that this not working anymore.

Hi @bergamo86

Can you share if the key you used to make the deletion API call is a project api key or a project API key?

Are you part of multiple orgs?

I was unable to reproduce this and was able to delete the fine-tuned model.

Hello!

i just have one only apikey.

I have one organization called neurok and it’s weird because the owner of model finedtune that was created…is neurok-igosis i dont know this organization…

The message of _J, he try to delete and not able too.

What is the difference project api key or a project API key? ? I post the printscreen in forum message.

Is it the original style API key? That might be the problem?

Have you tried minting a new key with the new API key method with perms?

1 Like

what style? i have a api key with permission set to ALL.

its not profile apikey … is a project api key

1 Like

Sorry, I meant did you mint it a while ago when they didn’t have permissions? Or is it a newer key?

1 Like

Thanks for confirming that you were using the project API key.

Can you confirm if you have more than one projects?

I’m going to try to reproduce this because in my first attempt I was able to delete the fine-tuned model while using the user API key.

Sorry for delay sps

no… just default and the main project.

the strange is when i finish the finetune process… i use postman to get the model and i get this owner

{
“id”: “ft:gpt-4o-mini-2024-07-18:neurok-ai::A3WiMeIu”,
“object”: “model”,
“created”: 1725404102,
“owned_by”: “neurok-igosis”
}

i think this is automatic owner that openai creates… because my organization just called Neurok AI, but have a default organization Personal.

if you can delete, show me please the steps i have to do please, because my api key have ALL permission…

thank you!