Real-time Malaysian sign language translation using colour segmentation and neural network

In this paper we present an automatic visual-based sign language translation system. Our proposed automatic sign-language translator provides a real-time English translation of the Malaysia SL. To date, there have been studies on sign language recognition based on visual approach (video camera). Ho...

Full description

Bibliographic Details
Main Authors: Akmeliawati, Rini, Melanie, Po-Leen Ooi, Ye, Chow Kuang
Format: Conference or Workshop Item
Language:English
Published: 2007
Subjects:
Online Access:http://irep.iium.edu.my/5384/
http://irep.iium.edu.my/5384/
http://irep.iium.edu.my/5384/
http://irep.iium.edu.my/5384/1/imtc2007_signlanguage.pdf
Description
Summary:In this paper we present an automatic visual-based sign language translation system. Our proposed automatic sign-language translator provides a real-time English translation of the Malaysia SL. To date, there have been studies on sign language recognition based on visual approach (video camera). However, the emphasis on these works is limited to a small lexicon of sign language or solely focuses on fingerspelling, which takes diferent approaches respectively. In practical sense, fingerspelling is used if a word cannot be expressed via sign language. Our sign language translator can recognise both fingerspelling and sign gestures that involve static and motion signs. Trained neural networks are used to identify the signs to translate into English.