加性噪声条件下鲁棒说话人确认

doi:10.3969/j.issn.0372-2112.2019.06.009

电子学报 ›› 2019, Vol. 47 ›› Issue (6): 1244-1250.DOI: 10.3969/j.issn.0372-2112.2019.06.009

加性噪声条件下鲁棒说话人确认

张二华, 王明合, 唐振民

南京理工大学计算机科学与工程学院, 江苏南京 210094

收稿日期:2016-11-24 修回日期:2018-01-15 出版日期:2019-06-25
- 通讯作者:
- 张二华
- 作者简介:
- 王明合 男,2009年于南京工业大学获得硕士学位,现为南京理工大学博士研究生,主要研究方向为信号处理、语音识别、说话人识别.;唐振民 男,1961年,陕西杨凌人.1982年出生于哈尔滨工程大学(原哈尔滨船舶工程学院)获得学士学位,1988于华东理工大学获得硕士学位,2002年于南京理工大学获得博士学位,现为南京理工大学教授、博导,CCF高级会员,主要研究领域为语音识别、图像处理、智能机器人
- 基金资助:
- 国家自然科学基金 (No.61473154）

Robust Speaker Verification Under Additive Noise Condition

ZHANG Er-hua, WANG Ming-he, TANG Zhen-min

School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China

Received:2016-11-24 Revised:2018-01-15 Online:2019-06-25 Published:2019-06-25
- Supported by:
- National Natural Science Foundation of China (No.61473154)

摘要/Abstract

摘要： 基于非负矩阵分解的语音去噪，在提高语音信号信噪比的同时，也会引起语音失真，从而导致噪声环境下说话人确认系统性能下降.本文提出基于分区约束非负矩阵分解的语音去噪方法（Nonnegative Matrix Factorization with Partial Constrains，PCNMF），目的是在未知和非平稳噪声条件下提高话人确认系统的鲁棒性.PCNMF在满足分区约束条件的基础上分别构建语音字典和噪声字典.考虑到传统语音训练产生的语音字典往往含有一定的噪声成分，PCNMF通过数学模型产生基音及泛音频谱，在此基础上利用该频谱模仿人声的共振峰结构来合成字典，从而保证语音字典纯净性.另一方面，为了克服传统噪声字典构建方法带来的部分噪声信息丢失问题，PCNMF对在线分离出的噪声样本进行分帧和短时傅里叶变换，然后以帧为单位线性组合生成噪声字典.性能评估实验引入了多种噪声类型，实验结果表明PCNMF可有效提高说话人确认系统的鲁棒性，特别是在未知和非平稳噪声条件下其等错率相比基线系统（Multi-Condition）平均降低了5.2%.

关键词: 语音处理, 说话人确认, 非负矩阵分解, 加性噪声

Abstract: While nonnegative matrix factorization based speech enhancing methods can improve signal to noise ratio (SNR) of recovered speech signal,these methods lead to the speech distortion,and thus degrade the performance of speaker verification system under noisy environment.This paper proposes a nonnegative matrix factorization with partial constrains (PCNMF),with objective of enhancing the robustness of speaker verification system in presence of unknown and unstable noises.PCNMF constructs the speech and noise dictionaries while satisfying partition conditions.Considering that the speech dictionary generated by traditional speech training contains a little noise element,PCNMF generates speech dictionary using the spectra of pitch and their harmonics via mathematical model,and accordingly imitates the formant structure of human voice.The purpose is to guarantee the purity of speech dictionary.In addition,in order to alleviate the problem about the loss of the information of the noise sample,PCNMF performs framing operation and Short-Time Fourier Transform against the noise samples separated online,and then generates noise dictionary by means of linear combination of the spectrum frames of the noise samples.Our experiment takes unknown and unstable noises into account,demonstrating that the proposed PCNMF achieves significant improvement of robustness under various noise conditions.Particularly,the equal error rate of PCNMF is reduced by an average of 5.2% in comparison with the base-line (Multi-Condition system).

Key words: speech processing, speaker verification, nonnegative matrix factorization, additive noise

中图分类号:

TN912.34

张二华, 王明合, 唐振民. 加性噪声条件下鲁棒说话人确认[J]. 电子学报, 2019, 47(6): 1244-1250.

ZHANG Er-hua, WANG Ming-he, TANG Zhen-min . Robust Speaker Verification Under Additive Noise Condition[J]. Acta Electronica Sinica, 2019, 47(6): 1244-1250.

参考文献

[1] Lei Y,Burget L,Ferrer L,et al.Towards noise-robust speaker recognition using probabilistic linear discriminant analysis[A].Proceedings of IEEE International Conference on Acoustics,Speech,& Signal Processing[C].Kyoto:IEEE,2012.4253-4256.
[2] Lyubimov N,Kotov M.Non-negativematrix factorization with linear constraints for single-channel speech enhancement[A].Proceedings of the 14th Annual Conference of the International Speech Communication Association[C].Lyon:EURASIP,2013.446-450.
[3] Lee D D,Seung H S.Learning the parts of objects by nonnegative matrix factorization[J].Nature,1999,401:788-791.
[4] Mohammadiha N,Smaragdis P,Leijon A.Supervised andunsupervised speech enhancement using nonnegative matrix factorization[J].IEEE Transactions on Audio Speech & Language Processing,2013,21(10):2140-2151.
[5] SUN M,LI YA,GEMMEKE J F,et al.Speechenhancement under low snr conditions via noise estimation using sparse and low-rank nmf with kullback-leibler divergence[J].IEEE Transactions on Audio,Speech,and Language Processing,2015,23(7):1233-1242.
[6] Hu Y,Liu G.Separation of singing voice using nonnegative matrix partial co-factorization for singer identification[J].IEEE/ACM Transactions on Audio Speech & Language Processing,2015,23(4):643-653.
[7] Lyubimov N,Nastasenko M,Kotov M,et al.Exploiting Non-negative Matrix Factorization with Linear Constraints in Noise-Robust Speaker Identification[A].Speech and Computer[C].Novi Sad,Serbia:Springer International Publishing,2014.200-208.
[8] Sun M,Zhang X,Van Hamme H,et al.Unseennoise estimation using separable deep auto encoder for speech enhancement[J].IEEE/ACM Transactions on Audio Speech & Language Processing,2016,24(1):93-104.
[9] Yoshioka T,Nakatani T.Noisemodel transfer:novel approach to robustness against nonstationary noise[J].IEEE Transactions on Audio Speech & Language Processing,2013,21(10):2182-2192.
[10] Li J,Deng L,Gong Y,et al.An overview of noise-robust automatic speech recognition[J].IEEE/ACM Transactions on Audio Speech & Language Processing,2014,22(4):745-777.
[11] 练秋生,石保顺,陈书贞.字典学习模型、算法及其应用研究进展[J].自动化学报,2015,41(2):240-260. LIAN Qiu-sheng,SHI Bao-shun,CHEN Shu-zhen.Research advances on dictionary learning models,algorithms and applications[J].Acta Automatica Sinica,2015,41(2):240-260.(in Chinese)
[12] KANAGASUNDARAM A,DEANA D,SRIDHARAN S,et al.I-vector based speaker recognition using advanced channel compensation techniques[J].Computer Speech and Language,2014,28(1):121-140.
[13] 蒋晔,唐振民.短语音说话人辨认的研究[J].电子学报,2011,39(4):953-957. JIANG Ye,TANG Zhen-min.Research on the speaker identification based on short utterance[J].Acta Electronica Sinica,2011,39(4):953-957.(in Chinese)
[14] XU Long-ting,YANG Zhen,SUN Lin-hui.Simplification of I-vector extraction for speaker identification[J].Chinese Journal of Electronics,2016,25(6):1121-1126.
[15] Avila A R,Sarria-Paja M,Fraga F J,et al.Improving the performance of far-field speaker verification using multicondition training:The case of GMM-UBM and i-vector systems[A].Proceedings of the Fifteenth Annual Conference of the International Speech Communication Association[C].Singapore:EURASIP,2014.1096-1100.
[16] 许云飞,杨海,周若华,等.高斯PLDA在说话人确认中的应用及其联合估计[J].自动化学报,2014,40(6):1068-1074. XU Yun-fei,YANG Hai,ZHOU Ruo-hua,et al.Gaussian PLDA for speaker verification and joint estimation[J].Acta Automatica Sinica,2014,40(6):1068-1074.(in Chinese)
[17] Stafylakis T,Kenny P,Alam M J,et al.Speaker andchannel factors in text-dependent speaker recognition[J].IEEE/ACM Transactions on Audio Speech & Language Processing,2016,24(1):65-78.
[18] Mak M W,Pang X,Chien J T.Mixture of PLDA for noise robust i-vector speaker verification[J].IEEE/ACM Transactions on Audio Speech & Language Processing,2016,24(1):130-142.
[19] 车滢霞,俞一彪.约束条件下的结构化高斯混合模型及非平行语料语音转换[J].电子学报,2016,44(9):2282-2288. CHE Ying-xia,YU Yi-biao.Non-parallelcorpora voice conversion based on structured gaussian mixture model under constraint conditions[J].Acta Electronica Sinica,2016,44(9):2282-2288.(in Chinese)
[20] XU Yun-fei,YANG Hai,YANG Lin,et al.A general bayesian model for speaker verification[J].Chinese Journal of Electronics,2016,25(6):1045-1051.

加性噪声条件下鲁棒说话人确认

Robust Speaker Verification Under Additive Noise Condition

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	肜娅峰, 陈晨, 陈德运, 何勇军. 基于贝叶斯主成分分析的i-vector说话人确认方法[J]. 电子学报, 2021, 49(11): 2186-2194.
[2]	贺超波, 汤庸, 张琼, 刘双印, 刘海. 基于增量式鲁棒非负矩阵分解的短文本在线聚类[J]. 电子学报, 2019, 47(5): 1086-1093.
[3]	薛一鸣, 陈鹞, 何宁宁, 胡彩娥, 王建平. 基于DFT滤波器组的低时延FPGA语音处理实现研究[J]. 电子学报, 2018, 46(3): 695-701.
[4]	范利云, 左万利, 王英, 王鑫. 一种基于差分隐私和时序的推荐系统模型研究[J]. 电子学报, 2017, 45(9): 2057-2064.
[5]	常振超, 陈鸿昶, 王凯, 卫红权, 黄瑞阳. 基于图流在线非负矩阵分解的社团检测[J]. 电子学报, 2017, 45(9): 2077-2084.
[6]	吴奇, 陈福才, 黄瑞阳, 常振超. 基于语义路径的异质网络社区发现方法[J]. 电子学报, 2016, 44(6): 1465-1471.
[7]	刘正, 张国印, 陈志远. 基于特征加权和非负矩阵分解的多视角聚类算法[J]. 电子学报, 2016, 44(3): 535-540.
[8]	王萌萌, 左万利, 王英. 基于加权非负矩阵分解的链接预测算法[J]. 电子学报, 2016, 44(10): 2391-2397.
[9]	叶有时, 刘淑芬, 孙强, 刘鸿瑾, 刘波, 杨桦, 吴一帆. 改进粒子滤波算法在深空红外小目标跟踪中的应用[J]. 电子学报, 2015, 43(8): 1506-1512.
[10]	刘建军, 吴泽彬, 韦志辉, 肖亮, 孙乐. 基于约束非负矩阵分解的高光谱图像解混快速算法[J]. 电子学报, 2013, 41(3): 432-437.
[11]	史加荣;焦李成;尚凡华. 不完全非负矩阵分解的加速算法[J]. 电子学报, 2011, 39(2): 291-295.
[12]	邓晓政;焦李成;卢山. 基于非负矩阵分解的谱聚类集成SAR图像分割[J]. 电子学报, 2011, 39(12): 2905-2909.
[13]	薛二娟;鲍长春;李如玮. 基于二维非负矩阵分解的1kb/s WI语音编码算法[J]. 电子学报, 2010, 38(7): 1574-1579.
[14]	龙泓琳;皮亦鸣;曹宗杰. 基于非负矩阵分解的SAR图像目标识别[J]. 电子学报, 2010, 38(6): 1425-1429.
[15]	简志华;杨震. 基于维特比算法的语声转换[J]. 电子学报, 2009, 37(7): 1470-1475.