Caastrophic forgetting in OpenAI models

I’m not sure that I understand your question, but fine tuning is not meant to add knowledge to a model, for that you’d be better off using RAG (which the assistants API uses).

2 Likes