News
Meet “SignTown Handbook”: An AI-powered Online Sign Language Learning Platform
Date: 20/10/2023
In continuation of the development of SignTown – the well-received multi-language online sign language game, the Centre for Sign Linguistics and Deaf Studies will launch a new multiple sign language learning platform – the SignTown Handbook. The Handbook is developed under Project Shuwa, a collaborative project between The Chinese University of Hong Kong, Google, Kwansei Gakuin University, and The Nippon Foundation with an aim of advancing sign recognition technology, promoting sign language use in public and barrier-free communication for deaf people.
The SignTown Handbook is an online sign language dictionary and learning platform. Similar to SignTown, the Handbook was built upon AI-based sign recognition technology and sign linguistics theories. Users may check out the signs on the “Feed” or “Collections'' interface where signs are categorized into different modules. Users may practice the signs by filming their own signing on the platform. The machine learning based model will then give immediate feedback on users’ signing accuracy. The Handbook also supports text-to-sign as well as video-to-sign search function. The system is capable of detecting single signs from a signing video input in Desktop Web, Mobile Web, and iOS/Android native apps. At launch, the Handbook supports three written languages (English, Traditional Chinese, and Japanese) and three sign languages (Hong Kong Sign Language, Japanese Sign Language, and Yangon Sign Language). It is worth mentioning that the system includes over 500 Hong Kong Sign Language vocabulary classified under 38 daily-life themes, providing users with a more comprehensive learning of Hong Kong Sign Language. More sign languages will be available in the future. Stay tuned for further updates!
To learn more about Project Shuwa and the SignTown Handbook, please visit the following websites or download the app, or refer to the attached poster for more information:
Project Shuwa：https://projectshuwa.com/
SignTown：https://sign.town/
SignTown Handbook Website：https://handbook.sign.town
Download SignTown Handbook App:
(iOS) https://apps.apple.com/hk/app/project-shuwa/id1643644150
(Android) https://play.google.com/store/apps/details?id=com.thebitstudio.shuwa