Advanced voice mistakenly interprets wind noise as an interruption

I frequently use advanced voice mode for translation during speaking events but it continues to think that even soft wind noise from an air conditioner is an interruption. This also happens with background music, outdoor noise, car noises etc.
This makes advanced voice mode challenging to use and I am hoping that it is possible to add a mute/unmute button for the microphone that will prevent unwanted interruptions from happening so that GPT can get through a paragraph of speaking without pausing.
The fact is that it is unreliable due to this, making real world use more challenging. I have tried workarounds like using a wind filter for the microphone but it still has issues.
A manual button that prevents it from being interrupted until I determine, would be extremely helpful.