Today is National Ears Day, and Vivo’s “Sign Language Interpreter” function is now online. The app can convert the voice of the hearing person into sign language and text in real-time, and can also broadcast the sign language movements of the hearing-impaired person in text and voice, establishing a new relationship between the hearing-impaired group and the hearing group who do not understand sign language. communication channel.
With the help of “sign language interpreters”, hearing-impaired people can not only communicate more smoothly with family and friends but also order meals and shop more conveniently. Speech-to-text, text-to-speech, text-to-sign language and sign language recognition-to-text are the core technologies for barrier-free communication. There have always been many difficulties to be overcome in sign language recognition to text – for example, how to accurately track finger joint movements in a small space, recognize their direction and movement trajectory, how to deal with the unique grammatical order and omitted expressions of sign language, and the similarity between sign language movements and containment issues.
The OriginOS technology research and development team has integrated AI and other technologies to achieve smooth mutual translation from sign language to text and then to voice. At present, sign language interpreters can already recognize 1,200 sign language vocabulary, with an accuracy rate of over 80%, which is equivalent to the level of Chinese Level 4, and can be applied to basic topic discussion scenarios. The sign language synthesis part has covered more than 8,000 words in the national general dictionary, which can realize smooth translation from text to sign language.
In the future, the OriginOS technology research and development team will continue to develop technology and improve products. It plans to continue to upgrade the sign language recognition technology to cover the sixth level of Chinese, and the translation function will continue to optimize more usage scenarios.
