You shouldn’t need any penalties for GPT-4.
Instead, you’ve probably made it so the AI can’t write common words, or even punctuation where it wants, after the penalties for those continue to accumulate.
If you were doing this yesterday, there was a model issue that caused outputs to go crazy for some.