As today is the International Day of Sign Languages, I decided to explore whether GPT-3 understood, and could translate, Braille.
Applications of this could include:
- a translator tool that could not only provide direct translations, but also generate original content, correctly formatted in Braille for use in communicating with sight-impaired folks.
- a tool allowing sign-impaired people to prompt and receive outputs from GPT-3 in braille (via a Braille touchpad)
As I’m not a Braille user, I used a two-way Braille translator to explore potential prompts in the Playground to see what was possible.
What I found was that GPT-3 was not able to translate from, or into, Braille, even with examples.
I also wasn’t able to prompt GPT-3 using Braille. It simply didn’t understand the language, despite likely being exposed to it in its training set.
Here’s one of my prompts for anyone who wishes to tinker.
https://beta.openai.com/playground/p/udOShj6ipVfomCbsuuXFhYFG?model=text-davinci-002
I’d welcome any examples of successful consistent prompting using Braille, or producing Braille outputs that are readable.
Also I think there’s an ethical consideration for Open.AI to include appropriate training materials for future AIs to help ensure that AI is as conversant in languages for hearing and sign-impaired people as it is in written languages.
Cheers,
Craig
PS: Yes I’m aware Braille isn’t a sign language, but given the available character sets GPT-3 has to accept and respond to prompts, I felt Braille would be more achieveable for GPT-3 than being able to read or write ASL or BANZSL.