Whisper’s recognition performance for Chinese is not very good. It only supports one type of Chinese language ‘zh’, and sometimes it may recognize speech as Simplified Chinese, while other times it may recognize it as Traditional Chinese. It is recommended to either fix the usage to a single type or enable both types of Chinese language options.
2 Likes
We’re also working on an assistant and have noticed that Whisper doesn’t accurately recognize Chinese pinyin or pronounce it correctly. Have you found a good solution yet?
Hi thackercary,
Are you replying to my post?
we are building an assistant to teach people to learn pinyin of Chinese. when we use the whisper API to pronounce the Chinese pinyin, for example , zhi, chi,a, o,e, but the can not speak it with Chinese tone. it speak English tone.
we have tried this but no work.
We are trying this method