What are the limits of fine tuning?

It’s really based on speculation on my part, but I am not the only one who thinks this. And others say a fine tune affects ALL parameters in GPT-3, but I have a hard time to believe my file-tune file creates a new file with 175 billion parameters (if I fine-tune DaVinci). More on these conjectures HERE!

So, conjecture aside, I do give you a chance at being successful, only because, I think, there is a small chance I am wrong.