Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms - Institut d'Electronique et de Télécommunications de Rennes Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Software Engineering Année : 2021

Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms

Résumé

Unlike the conventional facial expressions, micro-expressions are involuntary and transient facial expressions capable of revealing the genuine emotions that people attempt to hide. Therefore, they can provide important information in a broad range of applications such as lie detection, criminal detection, etc. Since micro-expressions are transient and of low intensity, however, their detection and recognition is difficult and relies heavily on expert experiences. Due to its intrinsic particularity and complexity, video-based micro-expression analysis is attractive but challenging, and has recently become an active area of research. Although there have been numerous developments in this area, thus far there has been no comprehensive survey that provides researchers with a systematic overview of these developments with a unified evaluation. Accordingly, in this survey paper, we first highlight the key differences between macro- and micro-expressions, then use these differences to guide our research survey of video-based micro-expression analysis in a cascaded structure, encompassing the neuropsychological basis, datasets, features, spotting algorithms, recognition algorithms, applications and evaluation of state-of-the-art approaches. For each aspect, the basic techniques, advanced developments and major challenges are addressed and discussed. Furthermore, after considering the limitations of existing micro-expression datasets, we present and release a new dataset - called micro-and-macro expression warehouse (MMEW) - containing more video samples and more labeled emotion types. We then perform a unified comparison of representative methods on CAS(ME) for spotting, and on MMEW and SAMM for recognition, respectively. Finally, some potential future research directions are explored and outlined.
Fichier principal
Vignette du fichier
Ben et al-2021-Video-based Facial Micro-Expression Analysis.pdf (2.87 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03229087 , version 1 (10-06-2021)

Identifiants

Citer

Xianye Ben, Yi Ren, Junping Zhang, Su-Jing Wang, Kidiyo Kpalma, et al.. Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms. IEEE Transactions on Software Engineering, 2021, pp.1-1. ⟨10.1109/TPAMI.2021.3067464⟩. ⟨hal-03229087⟩
237 Consultations
752 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More