How to avoid Hallucinations in Whisper transcriptions?

Completely. I was actually blown away when I saw that it’s more accurate with Spanish. Although after some conversing it made complete sense.

What I’m regarding is the hallucinations that occur from either cut audio, or moments of silence (which I’ve seen cause Whisper to hallucinate random sentences)