The purpose of this paper is to present a novel coarticulation and speech synchronization framework compliant with MPEG-4 facial animation (FA).
The system the authors have developed uses MPEG-4 FA standard and other development to enable the creation, editing and playback of high-resolution 3D models; MPEG-4 animation streams; and is compatible with well-known related systems such as Greta and Xface. It supports text-to-speech for dynamic speech synchronization. The framework enables real-time model simplification using quadric-based surfaces.
The preliminary experiments show that the coarticulation technique the authors have developed gives overall good and promising results when compared to related techniques.
The coarticulation approach provides realistic and high performance lip-sync animation, based on Cohen-Massaro's model of coarticulation adapted to MPEG-4 FA specification.
Leandro Parreira Duarte, R., El Rhalibi, A. and Merabti, M. (2014), "Coarticulation and speech synchronization in MPEG-4 based facial animation", Kybernetes, Vol. 43 No. 8, pp. 1165-1182. https://doi.org/10.1108/K-07-2014-0139Download as .RIS
Emerald Group Publishing Limited
Copyright © 2014, Emerald Group Publishing Limited