National Natural Science Foundation of China (No.61303150);Open Project of State Key Laboratory of CAD&CG, Zhejiang University (No.A1501);Youth Innovative Fund of Fundamental Research Funds for the Central Universities (No.WK2100100020);Independent Innovation Special Fund for Intelligent Voice Technology Research and Development and Industrialization of Anhui Province (No.13Z02008)
In view of facial expression recognition from monocular video with dynamic background
a real-time system was proposed based on the algorithm in which facial motion is tracked and facial expression is recognized simultaneously.Firstly
online appearance model and cylinder head model were combined to track 3D facial motion from video in framework of particle filtering;secondly
the static knowledge of facial expression was extracted through facial expression anatomy;thirdly
the dynamic knowledge of facial expression was extracted through manifold learning;fourthly
facial expression was retrieved by fusing the static knowledge and dynamic knowledge during facial motion tracking process.The experiments results confirmed the advantage on facial expression recognition even in the presence of significant head pose and facial expression variations of this system.