Whisper & ChatGPT Mobile App suggestions/issues

(This is all about the mobile application)

Whisper:

Incorrect outputs

Whisper is trained on data that includes details about captions, ex: [Music] or “Thank you for watching!” (Even though it is captions, I included “Thank you for watching!” because it was mostly trained on silent audio, like in a YouTube video with only captions and no audio) which greatly effects the output. This is prevalent in all of whisper, but effects the mobile application more, not sure on exact numbers though, but it is most likely because, If I am correct on how it is processed, it uses the Whisper API and not directly OpenAI API. This is going off of what I have read in the forums, example: /t/why-whisper-accuracy-is-lower-when-using-whisper-api-than-using-openai-api

ChatGPT Mobile Application

Haptic feedback

Haptic feedback is based on the devices percentage, not it’s “Low Power Mode” state. If low power mode is not on but the device is below 20%, it will not be able to be turned on.

Whisper

I already listed the issues on whisper above, but adding on to that, after using the voice feature, whisper & whatever they use for TTS, will randomly add text even after you are done talking, which is part of the silence being captioned.

For the ‘Thank you for watching’ issue, fixing it without retraining and data cleaning is challenging. I’m addressing this with separate filters, which you might also want to consider using.

It can be challenging to fix such issues without retraining and data cleaning, and separate filters can be an effective workaround. I appreciate your input and will consider using this approach. Thanks again!