基于稀疏特征挑选和概率线性判别分析的表情识别研究

doi:10.3969/j.issn.0372-2112.2018.07.024

电子学报 ›› 2018, Vol. 46 ›› Issue (7): 1710-1718.DOI: 10.3969/j.issn.0372-2112.2018.07.024

基于稀疏特征挑选和概率线性判别分析的表情识别研究

张瑞, 蒋晨之, 苏剑波

上海交通大学自动化系系统控制与信息处理教育部重点实验室, 上海 200240

收稿日期:2017-03-21 修回日期:2018-03-04 出版日期:2018-07-25
- 通讯作者:
- 苏剑波
- 作者简介:
- 张瑞,男.1991年9月生于安徽.上海交通大学自动化系硕士研究生.研究方向为人脸识别、表情识别.E-mail:Zander_Ray@sjtu.edu.cn
- 基金资助:
- 国家自然科学基金 (No.61533012，No.91748120，No.61521063）

Expression Recognition Based on Sparse Selection and PLDA

ZHANG Rui, JIANG Chen-zhi, SU Jian-bo

Ministry of Education Key Laboratory of System Control and Information Processing, Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China

Received:2017-03-21 Revised:2018-03-04 Online:2018-07-25 Published:2018-07-25
- Corresponding author:
- SU Jian-bo
- Supported by:
- National Natural Science Foundation of China (No.61533012, No.91748120, No.61521063)

摘要/Abstract

摘要： 提出一种基于稀疏特征挑选（Sparse selection）和概率线性判别分析（Probabilistic linear discriminant analysis）的表情识别方法SS-PLDA.该方法由两部分构成：第一部分是使用稀疏的方法挑选出人脸与表情相关的区域，构造表情的完备特征集；第二部分是针对构造的表情完备特征集里仍含有一些其他信息，运用概率线性判别分析实现表情特征与干扰信息的分离，学习出一个只含有表情信息的子空间，最后基于该表情子空间进行表情识别分析.通过在CK+和JAFFE这两个数据库上面的实验，证实了基于稀疏特征挑选的方法可以得到识别性能的改善，且先使用特征挑选再对所挑选结果应用概率线性判别分析可以达到更好的提升效果.

关键词: 人脸表情识别, 稀疏, 特征挑选, 子空间学习

Abstract: A facial expression recognition method named SS-PLDA is proposed based on Sparse Feature Selection and Probabilistic Linear Discriminant Analysis.The SS-PLDA method contains two steps:1) pick out the most discriminative regions for facial expressions and use these regions to construct a complete facial features set;2) apply Probabilistic Linear Discriminant Analysis Method to separate the useful expression signals from other disturbance information.Therefore,a subspace which only contains expression information is learnt and the expression recognition task is implemented in this subspace.Experimental results on Cohn-Kanade(CK+) database and JAFFE database show that the complete facial features set can improve the performance,and the proposed method outperform the state-of-art ones.

Key words: facial expression recognition, sparse, feature selection, subspace learning

中图分类号:

TP391.4

张瑞, 蒋晨之, 苏剑波. 基于稀疏特征挑选和概率线性判别分析的表情识别研究[J]. 电子学报, 2018, 46(7): 1710-1718.

ZHANG Rui, JIANG Chen-zhi, SU Jian-bo . Expression Recognition Based on Sparse Selection and PLDA[J]. Acta Electronica Sinica, 2018, 46(7): 1710-1718.

参考文献

[1] Ryan A,Cohn J F,Lucey S,et al.Automated facial expression recognition system[A].2009 International Carnahan Conference on Security Technology[C].IEEE,2009.172-177.
[2] Tian Y L,Kanade T,Cohn J F.Recognizing action units for facial expression analysis[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2001,23(2):97.
[3] Aleksic P S,Katsaggelos A K.Automatic facial expression recognition using facial animation parameters and multi-stream HMMS[J].IEEE Transactions on Information Forensics & Security,2006,1(1):3-11.
[4] Zhang Y,Ji Q.Active and dynamic information fusion for facial expression understanding from image sequences[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2005,27(5):699-714.
[5] Ekman P.Facial action coding system:manual[J].Agriculture,1978.
[6] Whitehill J,Bartlett M,Movellan J.Automatic facial expression recognition for intelligent tutoring systems[A].IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW'08)[C].IEEE,2008.1-6.
[7] Jain S,Hu C,Aggarwal J K.Facial expression recognition with temporal modeling of shapes[A].IEEE International Conference on Computer Vision Workshops[C].IEEE,2011.1642-1649.
[8] Kotsia I,Zafeiriou S,Nikolaidis N,et al.Texture and shape information fusion for facial action unit recognition[A].First International Conference on Advances in Computer-Human Interaction[C].IEEE,2008.77-82.
[9] Valstar M F,Pantic M.Combined support vector machines and hidden Markov models for modeling facial action temporal dynamics[A].IEEE International Conference on Human-Computer Interaction[C].Springer-Verlag,2007.118-127.
[10] Shan C,Gong S,Mcowan P W.Robust facial expression recognition using local binary patterns[A].IEEE International Conference on Image Processing[C].DBLP,2005.Ⅱ-370-3.
[11] Moore S,Bowden R.Local binary patterns for multi-view facial expression recognition[J].Computer Vision & Image Understanding,2011,115(4):541-558.
[12] Zhao G,Pietikainen M.Dynamic texture recognition using local binary patterns with an application to facial expressions[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2007,29(6):915-928.
[13] Poursaberi A,Noubari H A,Gavrilova M,et al.Gauss-Laguerre wavelet textural feature fusion with geometrical information for facial expression identification[J].Eurasip Journal on Image & Video Processing,2012,2012(1):1-13.
[14] Zhang Z,Yan Y,Wang H.Discriminative filter based regression learning for facial expression recognition[A].IEEE International Conference on Image Processing[C].IEEE,2013.1192-1196.
[15] Li Z,Imai J I,Kaneko M.Facial-component-based bag of words and PHOG descriptor for facial expression recognition[A].IEEE International Conference on Systems,Man and Cybernetics[C].IEEE,2009.1353-1358.
[16] Shan C,Gong S,Mcowan P W.A comprehensive empirical study on linear subspace methods for facial expression analysis[A].Conference on Computer Vision and Pattern Recognition Workshop[C].IEEE,2006.153-153.
[17] Rahulamathavan Y,Phan C W,Chambers J A,et al.Facial expression recognition in the encrypted domain based on local fisher discriminant analysis[J].IEEE Transactions on Affective Computing,2013,4(1):83-92.
[18] Happy S L,Routray A.Automatic facial expression recognition using features of salient facial patches[J].IEEE Transactions on Affective Computing,2015,6(1):1-12.
[19] Yang P.Learning active facial patches for expression analysis[A].Computer Vision and Pattern Recognition[C].IEEE,2012.2562-2569.
[20] Yue Zhao,Jianbo Su.New sparse facial feature description model based on salience evaluation of regions and features[J].International Journal of Pattern Recognition & Artificial Intelligence,2015,29(05):1556007.
[21] Bishop C M.Pattern Recognition and Machine Learning (Information Science and Statistics)[M].New York:Springer-Verlag,2006.
[22] Prince S,Li P,Fu Y,et al.Probabilistic models for inference about identity[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2012,34(1):144-157.
[23] Gong D,Li Z,Lin D,et al.Hidden factor analysis for age invariant face recognition[A].IEEE International Conference on Computer Vision[C].IEEE,2014.2872-2879.
[24] Liu J,Ye J.Moreau-Yosida regularization for grouped tree structure learning[A].International Conference on Neural Information Processing Systems[C].Curran Associates Inc,2010.1459-1467.
[25] Ludwig O,Delgado D,Goncalves V,et al.Trainable classifier-fusion schemes:An application to pedestrian detection[A].International IEEE Conference on Intelligent Transportation Systems[C].IEEE,2009.1-6.
[26] Lucey P,Cohn J F,Kanade T,et al.The extended Cohn-Kanade dataset (CK+):A complete dataset for action unit and emotion-specified expression[A].Computer Vision and Pattern Recognition Workshops[C].IEEE,2010.94-101.
[27] Jabid T,Kabir M H,Chae O.Robust facial expression recognition based on local directional pattern[J].Etri Journal,2010,32(5):784-794.
[28] Liu W,Song C,Wang Y.Facial expression recognition based on discriminative dictionary learning[A].International Conference on Pattern Recognition[C].IEEE,2012.1839-1842.
[29] Lajevardi S M,Hussain Z M.Automatic facial expression recognition:feature extraction and selection[J].Signal Image & Video Processing,2012,6(1):159-169.
[30] 刘帅师,田彦涛,万川.基于Gabor多方向特征融合与分块直方图的人脸表情识别方法[J].自动化学报,2011,37(2):1455-1463. LIU ShuaiShi,TIAN YanTao,WAN Chuan.Facial Expression Recognition Method Based on Gabor Multi-orientationFeatures Fusion and Block Histogram[J].Acta Automatica Sinica,2011,37(12):1455-1463.(in Chinese)
[31] Uddin M Z,Lee J J,Kim T S.An enhanced independent component-based human facial expression recognition from video[J].IEEE Transactions on Consumer Electronics,2009,55(4):2216-2224.
[32] Zhang L,Tjondronegoro D.Facial expression recognition using facial movement features[J].IEEE Transactions on Affective Computing,2012,2(4):219-229.

基于稀疏特征挑选和概率线性判别分析的表情识别研究

Expression Recognition Based on Sparse Selection and PLDA

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	袁海英, 曾智勇, 成君鹏. 面向灵活并行度的稀疏卷积神经网络加速器[J]. 电子学报, 2022, 50(8): 1811-1818.
[2]	王飞扬, 冀鹏欣, 孙笠, 危倩, 李根, 张忠宝. 一种基于深度学习的动态社交网络用户对齐方法[J]. 电子学报, 2022, 50(8): 1925-1936.
[3]	江兵兵, 何文达, 吴兴宇, 项俊浩, 洪立斌, 盛伟国. 基于自适应图学习的半监督特征选择[J]. 电子学报, 2022, 50(7): 1643-1652.
[4]	欧阳与点, 谢鲲, 谢高岗, 文吉刚. 面向大规模网络测量的数据恢复算法：基于关联学习的张量填充[J]. 电子学报, 2022, 50(7): 1653-1663.
[5]	吕明久, 马建朝, 韦旭, 陈文峰, 杨军, 马晓岩. 基于矩阵化原子范数的高频雷达距离-多普勒二维估计方法[J]. 电子学报, 2022, 50(5): 1150-1158.
[6]	刘浩阳, 林耀进, 刘景华, 吴镒潾, 毛煜, 李绍滋. 由粗到细的分层特征选择[J]. 电子学报, 2022, 50(11): 2778-2789.
[7]	夏楠, 邢宝辉, 高丹阳, 崔桐. 基于联合互谱函数的短波同频多目标直接定位方法[J]. 电子学报, 2022, 50(10): 2462-2468.
[8]	张小恒, 张馨月, 李勇明, 王品, 刘玉川. 面向帕金森病语音诊断的非监督两步式卷积稀疏迁移学习算法[J]. 电子学报, 2022, 50(1): 177-184.
[9]	冯西安, 寇思玮, 谭伟杰, 毕杨. 水声信号处理中的稀疏表示理论及应用[J]. 电子学报, 2021, 49(9): 1840-1851.
[10]	杨仲平, 杨书宁, 周青松, 张剑云. 基于ADMM的低副瓣阵列区域聚焦照射[J]. 电子学报, 2021, 49(7): 1370-1378.
[11]	孟乃宣, 孙君. 基于最佳虚拟网关的认知SCMA系统[J]. 电子学报, 2021, 49(4): 736-743.
[12]	禤韵怡, 杨春玲. 基于帧间组稀疏的两阶段递归增强视频压缩感知重构网络[J]. 电子学报, 2021, 49(3): 435-442.
[13]	高琛, 张帆, 高彦钊. 利用数据稀疏性的LSTM加速器设计[J]. 电子学报, 2021, 49(2): 209-215.
[14]	王洪雁, 张海坤, 罗宇华, 汪祖民. 复杂动态背景下基于群稀疏的运动目标检测方法[J]. 电子学报, 2021, 49(12): 2330-2338.
[15]	贾志豪, 孙君. 基于子图的边缘串行消息传递算法[J]. 电子学报, 2021, 49(11): 2146-2151.