Frequency/Presence Penalty for Minor Indian Languages

GPT 4 is considerably better than GPT 3.5 for Malayalam and other minor Indian languages. Even my parents, who speak Malayalam as their first language, were impressed. It is incredible how an American company created something that writes so well in such a small foreign language. However, as soon as the frequency or presence penalty is increased even slightly from zero, it completely breaks down. It goes from being fully fluent to mixing English letters and random characters,

1 Like