Fine-Tuning: What is happening under the hood?

cyzgab February 11, 2024, 2:05am 1

Anyone familiar with what is happening under the hood with fine-tuning of OpenAI’s GPT models?

For example, are some weights frozen?

Topic		Replies	Views
What does fine-tuning do? API fine-tuning	5	1827	February 7, 2024
What exactly and technically happens with fine-tuning? API	10	6061	January 3, 2024
Causal/autoregressive fine tuning? API	1	744	February 8, 2023
WIll fine tuning be available against the 001/instructGPT series? API	1	432	February 6, 2024
How does fine tuning really work? API	6	15956	January 18, 2023