Augmentative and alternative communication method based on tongue clicking for mute disabilities

This paper presents a pilot study for a novel application of converting tongue clicking sound to words for people with the inability to speak. 15 features of speech that are related to speech timing patterns, amplitude modulation, zero crossing and peak detection were extracted. The experiments were...

Full description

Bibliographic Details
Main Authors:	Azmi, Muhammad Amirul Amin, Nik Hashim, Nik Nur Wahidah, Md. Yusof, Hazlina
Format:	Article
Language:	English English English
Published:	IIUM Press, International Islamic University Malaysia 2019
Subjects:	T Technology (General)
Online Access:	http://irep.iium.edu.my/72545/ http://irep.iium.edu.my/72545/ http://irep.iium.edu.my/72545/ http://irep.iium.edu.my/72545/1/72545_Augmentative%20and%20alternative%20communication.pdf http://irep.iium.edu.my/72545/7/72545_Augmentative%20and%20alternative%20communication%20method%20based%20on%20tongue%20clicking%20for%20mute%20disabilities_scopus.pdf http://irep.iium.edu.my/72545/13/72545_Augmentative%20and%20alternative%20communication_WOS.pdf

id	iium-72545
recordtype	eprints
spelling	iium-725452019-08-07T07:15:58Z http://irep.iium.edu.my/72545/ Augmentative and alternative communication method based on tongue clicking for mute disabilities Azmi, Muhammad Amirul Amin Nik Hashim, Nik Nur Wahidah Md. Yusof, Hazlina T Technology (General) This paper presents a pilot study for a novel application of converting tongue clicking sound to words for people with the inability to speak. 15 features of speech that are related to speech timing patterns, amplitude modulation, zero crossing and peak detection were extracted. The experiments were conducted with three different patterns using binary Support Vector Machine (SVM) classification with 10 recordings as training data and 10 recordings as development data. Peak size outperformed all features with 85% classification rate for pattern P1-P3 whereas multiple features produced 100% classification rate for P1-P2 and P2-P3. A GUI based system was developed to validate the trained classifier. Multiclass SVM were constructed based on the best features obtained from binary SVM classification outcome, namely peak size and skewness amplitude modulation, and then tested on 15 recordings. The GUI based multiclass SVM obtained a satisfying performance of 67% correct classification of the test data set. IIUM Press, International Islamic University Malaysia 2019-06-01 Article PeerReviewed application/pdf en http://irep.iium.edu.my/72545/1/72545_Augmentative%20and%20alternative%20communication.pdf application/pdf en http://irep.iium.edu.my/72545/7/72545_Augmentative%20and%20alternative%20communication%20method%20based%20on%20tongue%20clicking%20for%20mute%20disabilities_scopus.pdf application/pdf en http://irep.iium.edu.my/72545/13/72545_Augmentative%20and%20alternative%20communication_WOS.pdf Azmi, Muhammad Amirul Amin and Nik Hashim, Nik Nur Wahidah and Md. Yusof, Hazlina (2019) Augmentative and alternative communication method based on tongue clicking for mute disabilities. IIUM Engineering Journal, 20 (1). pp. 119-128. ISSN 1511-788X E-ISSN 2289-7860 https://journals.iium.edu.my/ejournal/index.php/iiumej/article/view/1021 https://doi.org/10.31436/iiumej.v20i1.1021
repository_type	Digital Repository
institution_category	Local University
institution	International Islamic University Malaysia
building	IIUM Repository
collection	Online Access
language	English English English
topic	T Technology (General)
spellingShingle	T Technology (General) Azmi, Muhammad Amirul Amin Nik Hashim, Nik Nur Wahidah Md. Yusof, Hazlina Augmentative and alternative communication method based on tongue clicking for mute disabilities
description	This paper presents a pilot study for a novel application of converting tongue clicking sound to words for people with the inability to speak. 15 features of speech that are related to speech timing patterns, amplitude modulation, zero crossing and peak detection were extracted. The experiments were conducted with three different patterns using binary Support Vector Machine (SVM) classification with 10 recordings as training data and 10 recordings as development data. Peak size outperformed all features with 85% classification rate for pattern P1-P3 whereas multiple features produced 100% classification rate for P1-P2 and P2-P3. A GUI based system was developed to validate the trained classifier. Multiclass SVM were constructed based on the best features obtained from binary SVM classification outcome, namely peak size and skewness amplitude modulation, and then tested on 15 recordings. The GUI based multiclass SVM obtained a satisfying performance of 67% correct classification of the test data set.
format	Article
author	Azmi, Muhammad Amirul Amin Nik Hashim, Nik Nur Wahidah Md. Yusof, Hazlina
author_facet	Azmi, Muhammad Amirul Amin Nik Hashim, Nik Nur Wahidah Md. Yusof, Hazlina
author_sort	Azmi, Muhammad Amirul Amin
title	Augmentative and alternative communication method based on tongue clicking for mute disabilities
title_short	Augmentative and alternative communication method based on tongue clicking for mute disabilities
title_full	Augmentative and alternative communication method based on tongue clicking for mute disabilities
title_fullStr	Augmentative and alternative communication method based on tongue clicking for mute disabilities
title_full_unstemmed	Augmentative and alternative communication method based on tongue clicking for mute disabilities
title_sort	augmentative and alternative communication method based on tongue clicking for mute disabilities
publisher	IIUM Press, International Islamic University Malaysia
publishDate	2019
url	http://irep.iium.edu.my/72545/ http://irep.iium.edu.my/72545/ http://irep.iium.edu.my/72545/ http://irep.iium.edu.my/72545/1/72545_Augmentative%20and%20alternative%20communication.pdf http://irep.iium.edu.my/72545/7/72545_Augmentative%20and%20alternative%20communication%20method%20based%20on%20tongue%20clicking%20for%20mute%20disabilities_scopus.pdf http://irep.iium.edu.my/72545/13/72545_Augmentative%20and%20alternative%20communication_WOS.pdf
first_indexed	2023-09-18T21:42:47Z
last_indexed	2023-09-18T21:42:47Z
_version_	1777413251058892800

Augmentative and alternative communication method based on tongue clicking for mute disabilities

Similar Items