基于几何和纹理特征的表情层级分类方法

doi:10.3969/j.issn.0372-2112.2017.01.023

电子学报 ›› 2017, Vol. 45 ›› Issue (1): 164-172.DOI: 10.3969/j.issn.0372-2112.2017.01.023

基于几何和纹理特征的表情层级分类方法

胡敏^1,2, 江河^1,2, 王晓华^1,2, 许良凤¹, 黄晓音^1,2, 程轶红^1,2

1. 合肥工业大学计算机与信息学院, 安徽合肥 230009;
2. 情感计算与先进智能机器安徽省重点实验室, 安徽合肥 230009

收稿日期:2015-05-19 修回日期:2016-01-14 出版日期:2017-01-25
- 通讯作者:
- 江河
- 作者简介:
- 胡敏,女,1967年8月出生,安徽淮北人,教授、硕士生导师,2004年获合肥工业大学计算机应用技术博士学位.主要研究方向:计算机视觉、数字图像处理,等.E-mail:uhnim@163.com

A Hierarchical Classification Method of Expressions Based on Geometric and Texture Features

HU Min^1,2, JIANG He^1,2, WANG Xiao-hua^1,2, XU Liang-feng¹, HUANG Xiao-yin^1,2, CHENG Yi-hong^1,2

1. School of Computer and Information, Hefei University of Technology, Hefei, Anhui 230009, China;
2. Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine, Hefei, Anhui 230009, China

Received:2015-05-19 Revised:2016-01-14 Online:2017-01-25 Published:2017-01-25

摘要/Abstract

摘要：

针对表情识别，为提取对个体差异鲁棒性更强的特征，并有效利用特征自身分布特性，本文提出基于几何和纹理特征的表情层级分类方法.首先，构建基于中性脸相似度的几何特征提取方法，自动匹配样本相似中性脸，提取特征点比例系数几何特征；然后，利用充分矢量三角形提取纹理特征；最后，给出表情层级分类框架，在三个层级下分别利用提取特征判定表情类别.所提方法在JAFFE库和CK库上的实验结果表明，本文方法取得了比基于一般几何和纹理特征的识别方法更好的效果，证明了本文方法的有效性.

关键词: 表情识别, 几何和纹理特征, 中性脸相似度, 层级分类

Abstract:

In order to strengthen the robustness of the extracted features for individual differences and use the distribution characteristics of the features more effectively,this paper presents a hierarchical classification method of expression based on geometric and texture features.Firstly,a geometric feature extract method is constructed based on the similarity of neutral expression,which automatically matches with the similar neutral expression images of sample images and extract geometric features based on feature points scale factor.Then,texture features are extracted by using sufficient vector triangle pattern.Finally,the facial expression hierarchical classification framework is achieved by using the above features to judge expression categories in the three layers respectively.Experiment results in JAFFE database and CK database show that the proposed method improves the recognition rate compared with the methods based on the typically geometric and texture features.

Key words: expression recognition, geometric and texture features, similarity of neutral expression, hierarchical classification

中图分类号:

TP391

胡敏, 江河, 王晓华, 等. 基于几何和纹理特征的表情层级分类方法[J]. 电子学报, 2017, 45(1): 164-172.

HU Min, JIANG He, WANG Xiao-hua, et al. A Hierarchical Classification Method of Expressions Based on Geometric and Texture Features[J]. Acta Electronica Sinica, 2017, 45(1): 164-172.

参考文献

[1] Eleftheriadis S,Rudovic O,Pantic M.Discriminative shared Gaussian processes for multiview and view-invariant facial expression recognition[J].IEEE Transactions on Image Processing,2015,24(1):189-204.
[2] Whitehill J,Serpell Z,Lin Yi-Ching,Foster A,Movellan J R.The face of engagement:automatic recognition of student engagement from facial expressions[J].IEEE Transactions on Affective Computing,2014,5(1):86-98.
[3] 杨飞,苏剑波.人脸显性特征的融合构造方法及识别[J].电子学报,2012,40(3):466-471. Yang Fei,Su Jianbo.Face recognition based on explicit facial features by fusion construction method[J].Acta Electronica Sinica,2012,40(3):466-471.(in Chinese)
[4] Liu Haibin,Zhang Guobao,Huang Yongming,Dong Fei.Multiple features extraction and coordination using Gabor wavelet transformation and fisherfaces with application to facial expression recognition[A].Proceedings of Chinese Conference on Pattern Recognition[C].Chongqing:IEEE Press,2010.1-5.
[5] Shan Caifeng,Gong Shaogang,McOwan Peter W.Robust facial expression recognition using local binary patterns[A].Proceedings of IEEE International Conference on Image Processing[C].USA:IEEE Press,2005.370-373.
[6] 李根,李文辉.主方向旋转LBP特征的平面旋转人脸检测[J].电子学报,2015,43(1):198-202. Li Gen,Li Wenhui.Face detection under rotation in image plane using principal direction rotation LBP[J].Acta Electronica Sinica,2015,43(1):198-202.(in Chinese)
[7] 夏海英.基于纹理和几何特征的表情分类研究[D].武汉:华中科技大学,2011. Xia Haiying.Research on Texture and Geometric Features for Facial Expression Recognition[D].Wuhan:Huazhong University of Science and Technology,2011.(in Chinese)
[8] Anwar Saeed,Ayoub Al-Hamadi,Robert Niese.The effectiveness of using geometrical features for facial expression recognition[A].Proceedings of IEEE International Conference on Cybernetics[C].USA:IEEE Press,2013.122-127.
[9] Song Mingli,Tao Dacheng,Liu Zicheng,Li Xuelong,Zhou Mengchu.Image ratio features for facial expression recognition application[J].IEEE Transactions on Systems,Man,and Cybernetics,Part B:Cybernetics,2010,40(3):779-788.
[10] Parna Kundu,Ravindra Kumar Singh.Geometric feature based recognition of facial expressions using ANN[A].Proceedings of IEEE International Conference on Signal Processing[C].USA:IEEE Press,2013.1-6.
[11] 易积政,毛峡,Ishizuka Mitsuru,薛雨丽.基于特征点矢量与纹理形变能量参数融合的人脸表情识别[J].电子与信息学报,2013,35(10):2403-2410. Yi Jizheng,Mao Xia,Ishizuka Mitsuru,Xue Yuli.Facial expression recognition based on feature point vector and texture deformation energy parameters[J].Journal of Electronics & Information Technology,2013,35(10):2403-2410.(in Chinese)
[12] 魏冉,姜莉,陶霖密.融合人脸多特征信息的表情识别系统[J].中国图象图形学报,2009,14(5):792-800. Wei Ran,Jiang Li,Tao Linmi.Facial expression recognition system based on multiple feature integration[J].Journal of Image and Graphics,2009,14(5):792-800.(in Chinese)
[13] 刘帅师,田彦涛,万川.基于Gabor多方向特征融合与分块直方图的人脸表情识别[J].自动化学报,2011,37(12):1455-1463. Liu Shuaishi,Tian Yantao,Wan Chuan.Facial expression recognition method based on Gabor multi-orientation features fusion and block histogram[J].Acta Automatica Sinica,2011,37(12):1455-1463.(in Chinese)
[14] Zhang Zheng,Fang Chi,Ding Xiaoqing.A hierarchical algorithm with multi-feature fusion for facial expression recognition[A].Proceedings of the 21st International Conference on Pattern Recognition[C].USA:IEEE Press,2012.2363-2366.
[15] 胡敏,江河,王晓华,陈红波,李堃,任福继.精确局部特征描述的表情识别[J].中国图象图形学报,2014,19(11):1613-1622. Hu Min,Jiang He,Wang Xiaohua,Chen Hongbo,Li Kun,Ren Fuji.Precise local feature description for facial expression recognition[J].Journal of Image and Graphics,2014,19(11):1613-1622.(in Chinese)
[16] Wang Hongcheng,Ahuja N.Facial expression decomposition[A].Proceedings of IEEE International Conference on Computer Vision[C].USA:IEEE Press,2003.958-965.
[17] 谭华春,章毓晋.基于人脸相似度加权距离的非特定人表情识别[J].电子与信息学报,2007,29(2):455-459. Tan Huachun,Zhang Yujin.Person-independent facial expression recognition based on person-similarity weighted distance[J].Journal of Electronics & Information Technology,2007,29(2):455-459.(in Chinese)
[18] Jiang He,Hu Min,Chen Hongbo,Li Kun,Wang Xiaohua,Ren Fuji.Fcial expression recognition based on multi-scale vector triangle[A].Proceedings of IEEE/SICE International Symposium on System Integration[C].USA:IEEE Press,2013.82-87.

基于几何和纹理特征的表情层级分类方法

A Hierarchical Classification Method of Expressions Based on Geometric and Texture Features

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 8

编辑推荐

Metrics

[1]	李宏菲, 李庆, 周莉. 基于多视觉描述子及音频特征的动态序列人脸表情识别[J]. 电子学报, 2019, 47(8): 1643-1653.
[2]	张瑞, 蒋晨之, 苏剑波. 基于稀疏特征挑选和概率线性判别分析的表情识别研究[J]. 电子学报, 2018, 46(7): 1710-1718.
[3]	李艳秋, 任福继, 胡敏. 动态模糊密度的多分类器融合算法[J]. 电子学报, 2018, 46(5): 1246-1252.
[4]	孙晓, 潘汀. 基于兴趣区域深度神经网络的静态面部表情识别[J]. 电子学报, 2017, 45(5): 1189-1197.
[5]	邱玉, 赵杰煜, 汪燕芳. 结合运动时序性的人脸表情识别方法[J]. 电子学报, 2016, 44(6): 1307-1313.
[6]	於俊, 汪增福, 李睿. 一种同步人脸运动跟踪与表情识别算法[J]. 电子学报, 2015, 43(2): 371-376.
[7]	蒋斌, 贾克斌. 一种用于表情识别的局部判别分量分析算法[J]. 电子学报, 2014, 42(1): 155-159.
[8]	应自炉;唐京海;李景文;张有为;. 支持向量鉴别分析及在人脸表情识别中的应用[J]. 电子学报, 2008, 36(4): 725-730.