Modeling lip animation based on 4th order polynomial function / Nur Farahin Mohd Johari

Lip movement synthesis plays an important role to realize a natural human-like face of computer graphic since speech intelligibility can be improved by adding lip images to the speech signal Visual speech synthesis research has begun since early 1990s. It has been emergent rapidly and its applicatio...

Full description

Bibliographic Details
Main Author:	Mohd Johari, Nur Farahin
Format:	Thesis
Language:	English
Published:	2014
Online Access:	http://ir.uitm.edu.my/id/eprint/16401/ http://ir.uitm.edu.my/id/eprint/16401/1/TM_NUR%20FARAHIN%20MOHD%20JOHARI%20CS%2014_5.pdf

id	uitm-16401
recordtype	eprints
spelling	uitm-164012019-02-21T02:05:17Z http://ir.uitm.edu.my/id/eprint/16401/ Modeling lip animation based on 4th order polynomial function / Nur Farahin Mohd Johari Mohd Johari, Nur Farahin Lip movement synthesis plays an important role to realize a natural human-like face of computer graphic since speech intelligibility can be improved by adding lip images to the speech signal Visual speech synthesis research has begun since early 1990s. It has been emergent rapidly and its applications are widely use in many areas. For example, visual speech synthesis has been used in human communication and perception area, and virtual talking head in cartoon or game applications area. This study applies parameter based technique in developing visual speech synthesis. A parameter based technique for facial animation overcomes some of the limitations and restrictions of simple interpolations. This technique allows any possible face and expression by a combination of independent parameter value. In this study, 4th order polynomial is proposed to be applied on visual speech synthesis. Previous researcher had applied 6th order polynomial on visual speech synthesis. However, higher order polynomial is known to be wild and wiggly. In order to minimize the synthesization, the visemes have been classified and put into groups. Three control points were set up as parameter and they are labeled with XI which represents point at the right corner lip, HI, point at the center of upper lip and H2 which is point at the center of bottom lip. These control points play very important role in producing result. Viseme is grouped based on the control point motion. The control points also have been used in obtaining correlation coefficient for 4th order polynomial function For the Ups motion, naturalness is measured base on how similar the synthesized to the real lips deformation The similarity between both motions is indicated by the correlation coefficient measurement. Then the correlation coefficient between the synthesized and actual motion curve of lips control points of the all control points are calculated. The results show that the value of correlation coefficient is very close to 1 (about 0.9 and above). The value represents how close the function fits the original data. The proposed 4th order polynomial function achieves high realism in visual speech synthesis system, based on results that had been collected from experiment. The quality of synthesized motions can be evaluated by how much they imitate the real motion of lips. 2014 Thesis NonPeerReviewed text en http://ir.uitm.edu.my/id/eprint/16401/1/TM_NUR%20FARAHIN%20MOHD%20JOHARI%20CS%2014_5.pdf Mohd Johari, Nur Farahin (2014) Modeling lip animation based on 4th order polynomial function / Nur Farahin Mohd Johari. Masters thesis, Universiti Teknologi MARA.
repository_type	Digital Repository
institution_category	Local University
institution	Universiti Teknologi MARA
building	UiTM Institutional Repository
collection	Online Access
language	English
description	Lip movement synthesis plays an important role to realize a natural human-like face of computer graphic since speech intelligibility can be improved by adding lip images to the speech signal Visual speech synthesis research has begun since early 1990s. It has been emergent rapidly and its applications are widely use in many areas. For example, visual speech synthesis has been used in human communication and perception area, and virtual talking head in cartoon or game applications area. This study applies parameter based technique in developing visual speech synthesis. A parameter based technique for facial animation overcomes some of the limitations and restrictions of simple interpolations. This technique allows any possible face and expression by a combination of independent parameter value. In this study, 4th order polynomial is proposed to be applied on visual speech synthesis. Previous researcher had applied 6th order polynomial on visual speech synthesis. However, higher order polynomial is known to be wild and wiggly. In order to minimize the synthesization, the visemes have been classified and put into groups. Three control points were set up as parameter and they are labeled with XI which represents point at the right corner lip, HI, point at the center of upper lip and H2 which is point at the center of bottom lip. These control points play very important role in producing result. Viseme is grouped based on the control point motion. The control points also have been used in obtaining correlation coefficient for 4th order polynomial function For the Ups motion, naturalness is measured base on how similar the synthesized to the real lips deformation The similarity between both motions is indicated by the correlation coefficient measurement. Then the correlation coefficient between the synthesized and actual motion curve of lips control points of the all control points are calculated. The results show that the value of correlation coefficient is very close to 1 (about 0.9 and above). The value represents how close the function fits the original data. The proposed 4th order polynomial function achieves high realism in visual speech synthesis system, based on results that had been collected from experiment. The quality of synthesized motions can be evaluated by how much they imitate the real motion of lips.
format	Thesis
author	Mohd Johari, Nur Farahin
spellingShingle	Mohd Johari, Nur Farahin Modeling lip animation based on 4th order polynomial function / Nur Farahin Mohd Johari
author_facet	Mohd Johari, Nur Farahin
author_sort	Mohd Johari, Nur Farahin
title	Modeling lip animation based on 4th order polynomial function / Nur Farahin Mohd Johari
title_short	Modeling lip animation based on 4th order polynomial function / Nur Farahin Mohd Johari
title_full	Modeling lip animation based on 4th order polynomial function / Nur Farahin Mohd Johari
title_fullStr	Modeling lip animation based on 4th order polynomial function / Nur Farahin Mohd Johari
title_full_unstemmed	Modeling lip animation based on 4th order polynomial function / Nur Farahin Mohd Johari
title_sort	modeling lip animation based on 4th order polynomial function / nur farahin mohd johari
publishDate	2014
url	http://ir.uitm.edu.my/id/eprint/16401/ http://ir.uitm.edu.my/id/eprint/16401/1/TM_NUR%20FARAHIN%20MOHD%20JOHARI%20CS%2014_5.pdf
first_indexed	2023-09-18T22:55:59Z
last_indexed	2023-09-18T22:55:59Z
_version_	1777417856898564096

Modeling lip animation based on 4th order polynomial function / Nur Farahin Mohd Johari

Similar Items