Teaching Gpt4 a new language (Yiddish)

ChatGPT and by extension the GPT-4 API doesn’t work very well in my native language (it does understand it to some degree but not great.) If I had a large corpus of data would it be possible for me to fine-tune the standard model to better understand? Or would that require completely retraining an LLM?