一种用于语音增强的卷积门控循环网络

doi:10.3969/j.issn.0372-2112.2020.07.005

电子学报 ›› 2020, Vol. 48 ›› Issue (7): 1276-1283.DOI: 10.3969/j.issn.0372-2112.2020.07.005

一种用于语音增强的卷积门控循环网络

袁文浩, 胡少东, 时云龙, 李钊, 梁春燕

山东理工大学计算机科学与技术学院, 山东淄博 255000

收稿日期:2019-08-02 修回日期:2020-03-30 出版日期:2020-07-25
- 通讯作者:
- 袁文浩
- 作者简介:
- 胡少东 男,1996年出生,山东泰安人.2019年毕业于山东理工大学,现为山东理工大学计算机科学与技术学院硕士研究生.主要研究方向为语音信号处理,语音增强.E-mail:1764513896@qq.com
- 基金资助:
- 国家自然科学基金 (No.61701286，No.11704229）; 山东省自然科学基金 (No.ZR2018LF002）; 山东省高等学校青年创新团队发展计划 (No.2019KJN048）

A Convolutional Gated Recurrent Network for Speech Enhancement

YUAN Wen-hao, HU Shao-dong, SHI Yun-long, LI Zhao, LIANG Chun-yan

College of Computer Science and Technology, Shandong University of Technology, Zibo, Shandong 255000, China

Received:2019-08-02 Revised:2020-03-30 Online:2020-07-25 Published:2020-07-25

摘要/Abstract

摘要： 为了充分利用含噪语音特征来提高语音增强网络的性能，基于含噪语音在时间和频率两个维度上的相关性，本文结合卷积神经网络的局部特征提取能力和门控循环单元的长期依赖建模能力，设计了一种适用于语音增强的卷积门控循环网络.该网络采用卷积网络结构代替全连接网络结构来改进门控循环单元中的特征计算过程，从而能够更好地保留含噪语音特征中的时频结构信息.实验结果表明，与其它语音增强网络相比，本文网络在语音成分的保留和噪声成分的抑制上具有明显优势，增强后语音具有更好的语音质量和可懂度.

关键词: 语音增强, 深度神经网络, 门控循环单元, 卷积神经网络

Abstract: In order to improve the performance of speech enhancement networks by making full use of noisy speech features,based on the correlation of noisy speech in time and frequency,by combining the local feature extraction ability of convolutional neural networks and the long-term dependence modeling ability of gated recurrent unit,a convolutional gated recurrent network suitable for speech enhancement is designed in this paper.This network uses a convolutional network structure instead of a fully connected network structure to improve the feature calculation process in the gated recurrent unit,thereby can better retain the time-frequency structure in the noisy speech features.The experimental results show that compared with other speech enhancement networks,the proposed network has obvious advantages in speech component retention and noise component suppression,and the enhanced speech has better speech quality and intelligibility.

Key words: speech enhancement, deep neural network, gated recurrent unit, convolutional neural network

中图分类号:

TN912.3

袁文浩, 胡少东, 时云龙, 李钊, 梁春燕. 一种用于语音增强的卷积门控循环网络[J]. 电子学报, 2020, 48(7): 1276-1283.

YUAN Wen-hao, HU Shao-dong, SHI Yun-long, LI Zhao, LIANG Chun-yan. A Convolutional Gated Recurrent Network for Speech Enhancement[J]. Acta Electronica Sinica, 2020, 48(7): 1276-1283.

参考文献

[1] 陈楠,鲍长春.基于双耳线索编码原理的语音增强方法[J].电子学报,2019,47(1):227-233. CHEN Nan,BAO Chang-chun.Speech enhancement method based on binaural cues coding principle[J].Acta Electronica Sinica,2019,47(1):227-233.(in Chinese)
[2] OU Shifeng,SONG Peng,GAO Ying.Laplacian speech model and soft decision based MMSE estimator for noise power spectral density in speech enhancement[J].Chinese Journal of Electronics,2018,27(6):1214-1220.
[3] 刘文举,聂帅,梁山,等.基于深度学习语音分离技术的研究现状与进展[J].自动化学报,2016,42(6):819-833. LIU Wenju,NIE Shuai,LIANG Shan,et al.Deep learning based speech separation technology and its developments[J].Acta Automatica Sinica,2016,42(6):819-833.(in Chinese)
[4] WANG D L,CHEN J.Supervised speech separation based on deep learning:An overview[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2018,26(10):1702-1726.
[5] WANG Y,WANG D L.Towards scaling up classification-based speech separation[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2013,21(7):1381-1390.
[6] WANG Y,NARAYANAN A,WANG D L.On training targets for supervised speech separation[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2014,22(12):1849-1858.
[7] WILLIAMSON D S,WANG D L.Time-frequency masking in the complex domain for speech dereverberation and denoising[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2017,25(7):1492-1501.
[8] XU Y,DU J,DAI L R,et al.An experimental study on speech enhancement based on deep neural networks[J].IEEE Signal Processing Letters,2014,21(1):65-68.
[9] XU Y,DU J,DAI L R,et al.A regression approach to speech enhancement based on deep neural networks[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2015,23(1):7-19.
[10] HUANG P S,KIM M,HASEGAWA-JOHNSON M,et al.Joint optimization of masks and deep recurrent neural networks for monaural source separation[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2015,23(12):2136-2147.
[11] WENINGER F,ERDOGAN H,WATANABE S,et al.Speech enhancement with LSTM recurrent neural networks and its application to noise-robust ASR[A].Proceedings of International Conference on Latent Variable Analysis and Signal Separation[C].Liberec:Springer International Publishing,2015.91-99.
[12] CHEN J,WANG D.Long short-term memory for speaker generalization in supervised speech separation[J].Journal of the Acoustical Society of America,2017,141(6):4705-4714.
[13] PARK S R,LEE J.A fully convolutional neural network for speech enhancement[A].Proceedings of the Eighteenth Annual Conference of the International Speech Communication Association[C].Stockholm:ISCA,2017.1993-1997.
[14] FU S W,TSAO Y,LU X.SNR-aware convolutional neural network modeling for speech enhancement[A].Proceedings of the Seventeenth Annual Conference of the International Speech Communication Association[C].California:ISCA,2016.3768-3772.
[15] TAN K,CHEN J,WANG D.Gated residual networks with dilated convolutions for supervised speech separation[A].Proceedings of IEEE International Conference on Acoustics,Speech,and Signal Processing[C].Alberta:IEEE,2018.21-25.
[16] TAN K,CHEN J,WANG D.Gated residual networks with dilated convolutions for monaural speech enhancement[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2019,27(1):189-198.
[17] LI Y,LI X,DONG Y,LI M,XU S,XIONG S.Densely connected network with time-frequency dilated convolution for speech enhancement[A].Proceedings of IEEE International Conference on Acoustics,Speech,and Signal Processing[C].Brighton:IEEE,2019.6860-6864.
[18] 杨绪魁,屈丹,张文林,闫红刚.基于长时信息的自适应话音激活检测[J].电子学报,2018,46(4):878-885. YANG Xu-kui,QU Dan,ZHANG Wen-lin,YAN Hong-gang.Adaptive voice activity detection based on long-term information[J].Acta Electronica Sinica,2018,46(4):878-885.(in Chinese)
[19] SHI X,CHEN Z,WANG H,et al.Convolutional LSTM network:A machine learning approach for precipitation nowcasting[A].Advances in Neural Information Processing Systems[C].Morgan Kaufmann,2015.802-810.
[20] BALLAS N,YAO L,PAL C,et al.Delving deeper into convolutional networks for learning video representations[J].arXiv Preprint,2015,arXiv:1511.06432.
[21] GAROFOLO J S,LAMEL L F,FISHER W M,et al.TIMIT Acoustic-Phonetic Continuous Speech Corpus[M].Linguistic Data Consortium,Philadelphia,1993,33.
[22] WANG D,ZHANG X,ZHANG Z.THCHS-30:A Free Chinese Speech Corpus[OL].http://arxiv.org/abs/1512.01882,2015/2019-08-10.
[23] HU G.100 Nonspeech Environmental Sounds[OL].http://web.cse.ohio-state.edu/pnl/corpus/HuNonspeech/HuCorpus.html,2004/2019-08-10.
[24] VARGA A,STEENEKEN H J M.Assessment for automatic speech recognition:II.NOISEX-92:A database and an experiment to study the effect of additive noise on speech recognition systems[J].Speech Communication,1993,12(3):247-251.
[25] RIX A W,BEERENDS J G,HOLLIER M P,et al.Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs[A].Proceedings of IEEE International Conference on Acoustics,Speech,and Signal Processing[C].Utah:IEEE,2001.749-752.
[26] TAAL C H,HENDRIKS R C,HEUSDENS R,et al.An algorithm for intelligibility prediction of time-frequency weighted noisy speech[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2011,19(7):2125-2136.

一种用于语音增强的卷积门控循环网络

A Convolutional Gated Recurrent Network for Speech Enhancement

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	吴靖, 叶晓晶, 黄峰, 陈丽琼, 王志锋, 刘文犀. 基于深度学习的单帧图像超分辨率重建综述[J]. 电子学报, 2022, 50(9): 2265-2294.
[2]	毛国君, 王者浩, 黄山, 王翔. 基于剪边策略的图残差卷积深层网络模型[J]. 电子学报, 2022, 50(9): 2205-2214.
[3]	袁海英, 曾智勇, 成君鹏. 面向灵活并行度的稀疏卷积神经网络加速器[J]. 电子学报, 2022, 50(8): 1811-1818.
[4]	刘群, 谭洪胜, 张优敏, 王国胤. 基于元路径的动态异质网络表示学习[J]. 电子学报, 2022, 50(8): 1830-1839.
[5]	张志文, 刘天歌, 聂鹏举. 基于实景数据增强和双路径融合网络的实时街景语义分割算法[J]. 电子学报, 2022, 50(7): 1609-1620.
[6]	王相海, 赵晓阳, 王鑫莹, 赵克云, 宋传鸣. 非抽取小波边缘学习深度残差网络的单幅图像超分辨率重建[J]. 电子学报, 2022, 50(7): 1753-1765.
[7]	张波, 陆云杰, 秦东明, 邹国建. 一种卷积自编码深度学习的空气污染多站点联合预测模型[J]. 电子学报, 2022, 50(6): 1410-1427.
[8]	丁毅, 沈薇, 李海生, 钟琼慧, 田明宇, 李洁. 面向CNN的区块链可信隐私服务计算模型[J]. 电子学报, 2022, 50(6): 1399-1409.
[9]	张云, 化青龙, 姜义成, 徐丹. 基于混合型复数域卷积神经网络的三维转动舰船目标识别[J]. 电子学报, 2022, 50(5): 1042-1049.
[10]	廖勇, 李玉杰. 一种轻量化低复杂度的FDD大规模MIMO系统CSI反馈方法[J]. 电子学报, 2022, 50(5): 1211-1217.
[11]	崔亚奇, 何友, 唐田田, 熊伟. 一种深度学习航迹关联方法[J]. 电子学报, 2022, 50(3): 759-763.
[12]	伍邦谷, 张苏林, 石红, 朱鹏飞, 王旗龙, 胡清华. 基于多分支结构的不确定性局部通道注意力机制[J]. 电子学报, 2022, 50(2): 374-382.
[13]	周奕涛, 张斌, 刘自豪. 基于多模态深度神经网络的应用层DDoS攻击检测模型[J]. 电子学报, 2022, 50(2): 508-512.
[14]	陈文俊, 杨春玲. 图像压缩感知的特征域优化及自注意力增强神经网络重构算法[J]. 电子学报, 2022, 50(11): 2629-2637.
[15]	肖斌, 陈嘉博, 毕秀丽, 张俊辉, 李伟生, 王国胤, 马旭. 基于一维卷积神经网络与循环神经网络串联的心音分析方法[J]. 电子学报, 2022, 50(10): 2425-2432.