基于加性间距胶囊网络的家庭活动识别方法研究

doi:10.3969/j.issn.0372-2112.2020.08.017

电子学报 ›› 2020, Vol. 48 ›› Issue (8): 1580-1586.DOI: 10.3969/j.issn.0372-2112.2020.08.017

基于加性间距胶囊网络的家庭活动识别方法研究

郑启航¹, 王章权^1,2, 刘半藤^1,2, 陈阳¹, 陈友荣²

1. 常州大学信息科学与工程学院, 江苏常州 213164;
2. 浙江树人大学信息科技学院, 浙江杭州 310015

收稿日期:2019-07-05 修回日期:2020-05-18 出版日期:2020-08-25
- 通讯作者:
- 刘半藤
- 作者简介:
- 郑启航 男,1996年出生,浙江绍兴人,硕士研究生.主要研究方向为音频分类、半监督学习. E-mail:18000632@smail.cczu.edu.cn
- 基金资助:
- 浙江省公益技术研究项目 (No.LGG19F010011）; 浙江树人大学省属高校基本科研业务费专项资金 (No.2020XZ009）

Research on Family Activity Recognition Method Based on Additive Margin Capsule Network

ZHENG Qi-hang¹, WANG Zhang-quan^1,2, LIU Ban-teng^1,2, CHEN Yang¹, CHEN You-rong²

1. School of Information Science and Engineering, Changzhou University, Changzhou, Jiangsu 213164, China;
2. College of Information Science and Technology, Zhejiang Shuren University, Hangzhou, Zhejiang 310015, China

Received:2019-07-05 Revised:2020-05-18 Online:2020-08-25 Published:2020-08-25
- Corresponding author:
- LIU Ban-teng
- Supported by:
- Public Welfare Technology Research Program of Zhejiang Province (No.LGG19F010011); Zhejiang Shuren University Special fund of Fundamental Research Funds for the Universities of Zhejiang (No.2020XZ009)

摘要/Abstract

摘要： 本文研究基于音频的家庭活动识别方法，提出了一种基于加性间距胶囊神经网络识别模型，针对传统胶囊神经网络目标函数仅以输出胶囊模长作为约束的弊端，本文以几何学的视角，在胶囊神经网络结构中加入Transition层，使用Transition层对胶囊单元空间关系进行变基至一维空间，再使用加性间距Softmax作为目标函数，以同类特征变化小，非同类特征差异大作为优化策略构建基于胶囊向量空间关系的目标函数以提高模型分类能力，最后对方法进行试验，采用音频事件对家庭活动进行分类识别.选择声学场景和事件检测与分类（Detection and Classification of Acoustic Scenes and Events，DCASE）2018挑战任务5作为数据集，进行分类器构建和测试，最终平均F1分数达到92.3%，优于其他主流方法.

关键词: 音频事件分类, 家庭活动识别, 胶囊网络, 加性间距

Abstract: We study the method of family activity recognition based on audio and propose a capsule neural network recognition model based on additive margin. In view of the drawbacks of the traditional capsule neural network objective function only with the output capsule mode length as the constraint, this paper adds a Transition layer to the capsule neural network structure from the perspective of geometry and uses the Transition layer to rebase the capsule unit spatial relationship to the one-dimensional. Then, using the additive margin Softmax as the objective function, the change of similar features is small, and the difference of non-similar features is used as the optimization strategy to construct the objective function based on the capsule vector space relationship to improve model classification ability. Finally, test this method by classified identified for audio events for family activities. Selecting Detection and Classification of Acoustic Scenes and Events (DCASE) 2018 Challenge Task 5 as a dataset for classifier construction and testing, with a final average F1 score of 92.3%, which is superior to other mainstream methods.

Key words: classification of acoustic events, family activity recognition, capsule network, additive margin softmax

中图分类号:

TP391.4

郑启航, 王章权, 刘半藤, 等. 基于加性间距胶囊网络的家庭活动识别方法研究[J]. 电子学报, 2020, 48(8): 1580-1586.

ZHENG Qi-hang, WANG Zhang-quan, LIU Ban-teng, et al. Research on Family Activity Recognition Method Based on Additive Margin Capsule Network[J]. Acta Electronica Sinica, 2020, 48(8): 1580-1586.

参考文献

[1] Nathan V,Paul S,Prioleau T,et al.A survey on smart homes for aging in place:Toward solutions to the specific needs of the elderly[J].IEEE Signal Processing Magazine,2018,35(5):111-119.
[2] Sophiya E,Jothilakshmi S.Large scale data based audio scene classification[J].International Journal of Speech Technology,2018,21(4):825-836.
[3] Ferguson E L,Ramakrishnan R,Williams S B,et al.Deep learning approach to passive monitoring of the underwater acoustic environment[J].The Journal of the Acoustical Society of America,2016,140(4):3351-3351.
[4] Kasnesis P,Tatlas N A,Mitilineos S A,et al.Acoustic sensor data flow for cultural heritage monitoring and safeguarding[J].Sensors,2019,19(7):1629.
[5] Lapuschkin S,Wäldchen S,Binder A,et al.Unmasking clever hans predictors and assessing what machines really learn[J].Nature communications,2019,10(1):1-8.
[6] Keren G,Schuller B.Convolutional RNN:An enhanced model for extracting features from sequential data[A].2016 International Joint Conference on Neural Networks[C].Canada:IEEE,2016.3412-3419.
[7] Chew J,Sun Y,Jayasinghe L,et al.DCASE 2018 Challenge:Solution for task 5[R].DCASE2018 Challenge,Tech.Rep,2018.
[8] Sabour S,Frosst N,Hinton G E.Dynamic routing between capsules[A].Advances in neural information processing systems[C].US:NIPS,2017.3856-3866.
[9] 任开旭,王玉龙,刘同存,李炜.融合多维语义表示的概率矩阵分解模型[J].电子学报,2019,47(9):1848-1854. REN Kai-xu,WANG Yu-long,LIU Tong-cun,LI Wei.A probabilistic matrix factorization model based on multidimensional semantic representation learning[J].Acta Electronica Sinica,2019,47(9):1848-1854.(in Chinese)
[10] 贾旭东,王莉.基于多头注意力胶囊网络的文本分类模型[J].清华大学学报(自然科学版),2020,60(5):415-421. JIA Xudong,WANG Li.Text classification model based on multi-head attention capsule networks[J].Journal of Tsinghua University(Science and Technology),2020,60(5):415-421.(in Chinese)
[11] Wang F,Cheng J,Liu W,et al.Additive margin softmax for face verification[J].IEEE Signal Processing Letters,2018,25(7):926-930.
[12] Dekkers G,Lauwereins S,Thoen B,et al.The SINS database for detection of daily activities in a home environment using an acoustic sensor network[A].Proceedings of the Detection and Classification of Acoustic Scenes and Events 2017 Workshop [C].Germany:DCASE.2017.32-36.
[13] Liu H,Wang F,Liu X,et al.An ensemble system for domestic activity recognition[R].DCASE2018 Challenge,Tech.Rep,2018.
[14] Tanabe R,Endo T,Nikaido Y,et al.Multichannel acoustic scene classification by blind dereverberation,blind source separation,data augmentation,and model ensembling[R].DCASE2018 Challenge,Tech.Rep,2018.
[15] Inoue T,Vinayavekhin P,Wang S,et al.Domestic activities classification based on cnn using shuffling and mixing data augmentation[R].DCASE2018 Challenge,Tech.Rep,2018.
[16] Dekkers G,Vuegen L,van Waterschoot T,et al.DCASE 2018 Challenge-Task 5:Monitoring of domestic activities based on multi-channel acoustics[R].DCASE2018 Challenge,Tech.Rep,2018.
[17] Yuhan Shen,Kexin He,Weiqiang Zhang.Home activity monitoring based on gated convolutional neural networks and system fusion[R].DCASE2018 Challenge,Tech.Rep,2018.

基于加性间距胶囊网络的家庭活动识别方法研究

Research on Family Activity Recognition Method Based on Additive Margin Capsule Network

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 3

编辑推荐

Metrics

[1]	梁顺攀, 刘伟, 郑智中, 原福永. 基于方面和胶囊网络的跨域评分预测模型[J]. 电子学报, 2022, 50(9): 2102-2109.
[2]	胡向东, 李之涵. 基于胶囊网络的工业互联网入侵检测方法[J]. 电子学报, 2022, 50(6): 1457-1465.
[3]	任开旭, 王玉龙, 刘同存, 李炜. 融合多维语义表示的概率矩阵分解模型[J]. 电子学报, 2019, 47(9): 1848-1854.