2D/3D Expression Generation Using Advanced Learning Techniques and the Emotion Wheel

Authors

  • Thi Chau Ma Faculty of Information Technology, VNU University of Engineering and Technology, No. 144 Xuan Thuy Street, Dich Vong Ward, Cau Giay District, Hanoi, Vietnam
  • Anh Duc Dam VNU University of Engineering and Technology, No. 144 Xuan Thuy Street, Dich Vong Ward, Cau Giay District, Hanoi, Vietnam
  • Quang Hieu Dao Software Development Department, Flinters Vietnam, Duy Tan street, Dich Vong Ward, Cau Giay district, Hanoi, Vietnam

DOI:

https://doi.org/10.61707/n24d8d13

Keywords:

Expresion Retargeting, Expression Recognition, Expression Blending

Abstract

Facial expression analysis is a critical component in numerous applications, ranging from human- computer interaction to digital character animation. Despite the availability of extensive datasets, most focus predominantly on basic emotions, limiting the expressiveness and applicability of models trained on them. This article introduces a novel approach to generating compound emotional expressions by leveraging the Emotion Wheel, a principle that captures the complex interrelations between basic emotions. Our method integrates the EMOCA (Emotion Driven Monocular Face Capture and Animation) [1] framework, which enhances 3D facial reconstruction by incorporating emotion recognition, stacking models [2, 54] with a sophisticated expression blending algorithm to synthesize nuanced 2D and 3D facial animations. Utilizing the VKIST dataset, which includes high-resolution facial images of Vietnamese individuals, we build a comprehensive database of emotion parameters. Through principal component analysis (PCA) and correlation-driven blending, our approach not only enhances the realism of generated facial expressions but also preserves the subtle nuances that are characteristic of human emotions. Experimental results demonstrate that our method consistently outperforms traditional linear interpolation techniques, producing more distinct and recognizable blended expressions. A user study further validates the naturalness and quality of the generated expressions, with average ratings indicating a strong preference for the proposed method over existing approaches. These findings suggest significant potential for improving emotional expressiveness in both static and dynamic digital character representations. 

Downloads

Published

2024-09-10

Issue

Section

Articles

How to Cite

2D/3D Expression Generation Using Advanced Learning Techniques and the Emotion Wheel. (2024). International Journal of Religion, 5(11), 9078 – 9094. https://doi.org/10.61707/n24d8d13