This message is primarily for OpenAI folks Finetuning is absolutely critical. Please reduce the cost of finetuning soon. I know many people haven’t the first clue about how to do finetuning, but mark my words, finetuning will be 100% necessary for every AI company. I know that INSTRUCT is awesome …

Completely agree! The price difference from the base models to fine-tuned is quite steep (even more so with the recent price drop in base models). Finetuning would greatly improve the outputs at our company but we can’t currently justify the price difference so we are sticking with basic prompt engi…

I have to +1 this as well. Have plenty of plans for fine-tunning but so far the cost has kept me away.

I thought it would be helpful to add some context about why I personally find finetuning to be exceptionally useful (above and beyond INSTRUCT) INSTRUCT and FINETUNE are different technologies with different usecases Finetuning allows for training to handle adversarial attacks (deliberate or accid…

Another reason: explainability. We can’t rely on a total black box trained by another team in secret. For medical, legal, and other high stakes use cases, we will need to be able to point to our own proprietary training data in order to explain why our models made certain decisions.

IMHO I think that we should be able to fine tune the last models and not only the original davinci, even if the text-davinci-003 is solid on few shots tries, I can’t stop thinking that having this super powerful new model fine-tuned would be extraordinary

If I’m not mistaken you can finetune existing models. I thought they had a press release about that. Or certainly people have talked about it on this forum

Totally agree, Dave. I have a half dozen use cases for finetuning, but it’s cost prohibitive.

You can fine tune old Davinci but not InstructGPT :confused: There is a confirmation here from openai staff : [image] Error when trying to fine tune divinci-003 API I am not finding exact confirmation of this in the documentation, but could have missed it…but I am trying …

The 6x lower cost of the base models also makes it justifiable to generate a few completions for each prompt, then using a discriminator to pick the best one. The way I see it, the main task with base models is prompt engineering and discriminator training. With fine-tuning, it’s gathering training…

Finetuning needs to be cheaper

API

jonathan.sabbah December 5, 2022, 8:04pm 10

You can fine tune old Davinci but not InstructGPT
There is a confirmation here from openai staff :

Topic		Replies	Views
Fine-tuning Announcement & Davinci Beta Announcements	7	2000	December 20, 2021
"Error creating job: Your organization must qualify for at least usage tier 4 to fine-tune gpt-4o-mini-2024-07-18. " API fine-tuning	11	1592	November 15, 2024
Fine tuning - how exactly does it work? API	5	2879	April 12, 2023
Doesn't Understand fine tuned model cost API	12	7960	June 30, 2024
ChatGPT fine-tuning as a service API	16	14257	July 24, 2023

Finetuning needs to be cheaper

Related topics