基于生成对抗网络的无监督域适应分类模型

doi:10.3969/j.issn.0372-2112.2020.06.021

电子学报 ›› 2020, Vol. 48 ›› Issue (6): 1190-1197.DOI: 10.3969/j.issn.0372-2112.2020.06.021

基于生成对抗网络的无监督域适应分类模型

王格格, 郭涛, 余游, 苏菡

四川师范大学计算机科学学院, 四川成都 610101

收稿日期:2019-06-25 修回日期:2019-11-13 出版日期:2020-06-25
- 通讯作者:
- 郭涛
- 作者简介:
- 王格格 女,1995年生于重庆市.现为四川师范大学计算机科学学院硕士研究生.主要研究方向为人工智能与深度学习. E-mail:347673996@qq.com
  余游 男,1993年生于四川省遂宁市.现为四川师范大学计算机科学学院硕士研究生.主要研究方向为深度学习与数据挖掘. E-mail:454665275@qq.com
  苏菡 女,1979年生于四川省阿坝藏族羌族自治州.博士,现为四川师范大学计算机科学学院教授、硕士生导师.主要研究方向为智能信息计算及处理、模式识别与图像处理. E-mail:jkxy_sh@sicnu.edu.cn
- 基金资助:
- 国家自然科学基金 (No.61403266）; 四川省可视化与虚拟现实重点实验室项目 (No.KJ201419）

Unsupervised Domain Adaptation Classification Model Based on Generative Adversarial Network

WANG Ge-ge, GUO Tao, YU You, SU Han

Department of Computer Science, Sichuan Normal University, Chengdu, Sichuan 610101, China

Received:2019-06-25 Revised:2019-11-13 Online:2020-06-25 Published:2020-06-25

摘要/Abstract

摘要： 生成适应模型利用生成对抗网络实现模型结构，并在领域适应学习上取得了突破.但其部分网络结构缺少信息交互，且仅使用对抗学习不足以完全减小域间距离，从而使分类精度受到影响.为此，提出一种基于生成对抗网络的无监督域适应分类模型（Unsupervised Domain Adaptation classification model based on GAN，UDAG）.该模型通过联合使用生成对抗网络和多核最大均值差异度量准则优化域间差异，并充分利用无监督对抗训练及监督分类训练之间的信息传递以学习源域分布和目标域分布之间的共享特征.通过在四种域适应情况下的实验结果表明，UDAG模型学习到更优的共享特征嵌入并实现了域适应图像分类，且分类精度有明显提高.

关键词: 生成适应模型, 迁移学习, 领域适应学习, 生成对抗网络, 多核最大均值差异, 无监督学习

Abstract: Generate-to-adapt model has used generative adversarial network to implement model structure and has made a breakthrough in domain adaptation learning.However,some of its network structures lack information interaction,and the ability to use only adversarial learning is not sufficient to completely reduce the inter-domain distance.In this paper,an unsupervised domain adaptation classification model based on generative adversarial network (UDAG) is proposed.This model optimizes inter-domain differences and makes full use of the information between unsupervised confrontation training and supervised classification training to learn the shared features between the source and target domain distribution.The experimental results under four domain adaptation conditions show that the UDAG model learns better shared feature embedding and implements domain adaptive classification,and the classification accuracy is significantly improved.

Key words: generate-to-adapt model, transfer learning, domain adaptation learning, generative adversarial network, MK-MMD, unsupervised learning

中图分类号:

TP181

王格格, 郭涛, 余游, 苏菡. 基于生成对抗网络的无监督域适应分类模型[J]. 电子学报, 2020, 48(6): 1190-1197.

WANG Ge-ge, GUO Tao, YU You, SU Han. Unsupervised Domain Adaptation Classification Model Based on Generative Adversarial Network[J]. Acta Electronica Sinica, 2020, 48(6): 1190-1197.

参考文献

[1] WANG X,GUPTA A.Unsupervised learning of visual representations using videos[A].Proceedings of the IEEE International Conference on Computer Vision[C].Santiago,Chile:IEEE,2015.2794-2802.
[2] MAHJOURIAN R,WICKE M,ANGELOVA A.Unsupervised learning of depth and ego-motion from monocular video using 3D geometric constraints[A].Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition[C].Salt Lake City,USA:IEEE,2018.5667-5675.
[3] 刘建伟,孙正康,等.域自适应学习研究进展[J].自动化学报,2014,40(8):1576-1600. LIU Jian-Wei,SUN Zheng-Kang,et al.Review and research development on domain adaptation learning[J].Acta Automatica Sinica,2014,40(8):1576-1600.(in Chinese)
[4] PAN S J,YANG Q.A survey on transfer learning[J].IEEE Transactions on Knowledge and Data Engineering,2010,22(10):1345-1359.
[5] ROZANTSEV A,SALZMANN M,FUA P.Beyond sharing weights for deep domain adaptation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,41(4):801-814.
[6] GANIN Y,LEMPITSKY V.Unsupervised domain adaptation by backpropagation[EB/OL].https://arxiv.org/abs/1409.7495v1,2015-02-27.
[7] GHIFARY M,KLEIJN W B,ZHANG M,et al.Deep reconstruction-classification networks for unsupervised domain adaptation[A].European Conference on Computer Vision[C].Amsterdam,the Netherlands:Springer,2016.597-613.
[8] TZENG E,HOFFMAN J,ZHANG N,et al.Deep domain confusion:Maximizing for domain invariance[EB/OL].https://arxiv.org/abs/1412.3474,2014-12-10.
[9] TZENG E,HOFFMAN J,SAENKO K,et al.Adversarial discriminative domain adaptation[A].Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition[C].Hawaii,USA:IEEE,2017.7167-7176.
[10] GOODFELLOW I,POUGET-ABADIE J,MIRZA M,et al.Generative adversarial nets[A].Advances in Neural Information Processing Systems[C].Montreal,Canada:MIT Press,2014.2672-2680.
[11] 王万良,李卓蓉.生成式对抗网络研究进展[J].通信学报,2018,39(2):135-148. WANG Wan-Liang,LI Zhuo-Rong.Advances in generative adversarial network[J].Journal on Communications,2018,39(2):135-148.(in Chinese)
[12] RUSSO P,CARLUCCIi F M,TOMMASI T,et al.From source to target and back:symmetric bi-directional adaptive gan[A].Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition[C].Salt Lake City,USA:IEEE,2018.8099-8108.
[13] VOLPI R,MORERIO P,SAVARESE S,et al.Adversarial feature augmentation for unsupervised domain adaptation[A].Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition[C].Salt Lake City,USA:IEEE,2018.5495-5504.
[14] HOFFMAN J,TZENG E,PARK T,et al.Cycada:cycle-consistent adversarial domain adaptation[EB/OL].https://arxiv.org/abs/1711.03213,2017-12-29.
[15] SANKARANARAYANAN S,BALAJI Y,CASTILLO C D,et al.Generate to adapt:aligning domains using generative adversarial networks[A].Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition[C].Salt Lake City,USA:IEEE,2018.8503-8512.
[16] GRETTON A,SEJDINOVIC D,STRATHMANN H,et al.Optimal kernel choice for large-scale two-sample tests[A].Advances in Neural Information Processing Systems[C].Nevada,USA:MIT Press,2012.1205-1213.
[17] LI J,LU K,HUANG Z,et al.Transfer independently together:a generalized framework for domain adaptation[J].IEEE Transactions on Cybernetics,2018 (99):1-12.
[18] GRETTON A,FUKUMIZU K,HARCHAOUI Z,et al.A fast,consistent kernel two-sample test[A].Advances in Neural Information Processing Systems[C].Vancouver,Canada:MIT Press,2009.673-681.
[19] DENG L.The mnist database of handwritten digit images for machine learning research[best of the web] [J].IEEE Signal Processing Magazine,2012,29(6):141-142.
[20] CHAABAN I,SCHEESSELA M R.Human Performance on the USPS Database[R].South Bend:Indiana University South Bend,2007.
[21] NETZER Y,WANG T,COATES A,et al.Reading digits in natural images with unsupervised feature learning[A].NIPS Workshop on Deep Learning and Unsupervised Feature Learning[C].Granada,Spain:MIT Press,2011.
[22] BOUSMALIS K,TRIGEORGIS G,SILBERMAN N,et al.Domain separation networks[A].Advances in Neural Information Processing Systems[C].Barcelona,Spain:MIT Press,2016.343-351.
[23] MAATEN L,HINTON G.Visualizing data using t-SNE[J].Journal of Machine Learning Research,2008,9(3):2579-2605.

基于生成对抗网络的无监督域适应分类模型

Unsupervised Domain Adaptation Classification Model Based on Generative Adversarial Network

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	吴靖, 叶晓晶, 黄峰, 陈丽琼, 王志锋, 刘文犀. 基于深度学习的单帧图像超分辨率重建综述[J]. 电子学报, 2022, 50(9): 2265-2294.
[2]	邵志文, 周勇, 谭鑫, 马利庄, 刘兵, 姚睿. 基于深度学习的表情动作单元识别综述[J]. 电子学报, 2022, 50(8): 2003-2017.
[3]	裴炤, 邱文涛, 王淼, 马苗, 张艳宁. 基于Transformer动态场景信息生成对抗网络的行人轨迹预测方法[J]. 电子学报, 2022, 50(7): 1537-1547.
[4]	刘文杰, 赵胶胶, 张颖, 葛业波. 一种量子条件生成对抗网络算法[J]. 电子学报, 2022, 50(7): 1586-1593.
[5]	李维刚, 甘平, 谢璐, 李松涛. 基于样本对元学习的小样本图像分类方法[J]. 电子学报, 2022, 50(2): 295-304.
[6]	陈文俊, 杨春玲. 图像压缩感知的特征域优化及自注意力增强神经网络重构算法[J]. 电子学报, 2022, 50(11): 2629-2637.
[7]	孙晨峰, 吕卫民, 戴洪德, 张浩晨. 一种基于TimeGAN和OCSVM的多元退化设备小子样数据增广方法[J]. 电子学报, 2022, 50(11): 2678-2687.
[8]	张小恒, 张馨月, 李勇明, 王品, 刘玉川. 面向帕金森病语音诊断的非监督两步式卷积稀疏迁移学习算法[J]. 电子学报, 2022, 50(1): 177-184.
[9]	李勇斌, 王彬, 邵高平, 邵帅. 一种基于RCGAN的水声通信信号降噪方法[J]. 电子学报, 2022, 50(1): 54-62.
[10]	李宝奇, 黄海宁, 刘纪元, 李宇. 基于改进CycleGAN的光学图像迁移生成水下小目标合成孔径声纳图像算法研究[J]. 电子学报, 2021, 49(9): 1746-1753.
[11]	席亮, 刘涵, 樊好义, 张凤斌. 基于深度对抗学习潜在表示分布的异常检测模型[J]. 电子学报, 2021, 49(7): 1257-1265.
[12]	陈星宇, 叶锋, 黄添强, 翁彬, 陈家祯, 林文忠. 融合小型深度生成模型的显著性检测[J]. 电子学报, 2021, 49(4): 768-774.
[13]	唐焕玲, 郑涵, 刘艳红, 马思源, 窦全胜, 鲁明羽. Tr-SLDA:一种面向交叉领域的迁移主题模型[J]. 电子学报, 2021, 49(3): 605-613.
[14]	张锦, 李阳, 任传伦, 黄炼, 王帅辉, 段晔鑫, 潘志松, 谢钧. 基于帧间高级特征差分的跨场景视频前景分割算法[J]. 电子学报, 2021, 49(10): 2032-2040.
[15]	吴文, 万毅. 基于低尺度细节恢复的单幅图像阴影去除方法[J]. 电子学报, 2020, 48(7): 1293-1302.