基于蒙特卡罗数据集均衡与鲁棒性增量极限学习机的图像自动标注

doi:10.3969/j.issn.0372-2112.2017.12.014

电子学报 ›› 2017, Vol. 45 ›› Issue (12): 2925-2935.DOI: 10.3969/j.issn.0372-2112.2017.12.014

基于蒙特卡罗数据集均衡与鲁棒性增量极限学习机的图像自动标注

柯逍^1,2, 邹嘉伟^1,2, 杜明智^1,2, 周铭柯^1,2

1. 福州大学数学与计算机科学学院, 福建福州 350116;
2. 福建省网络计算与智能信息处理重点实验室(福州大学), 福建福州 350116

收稿日期:2016-03-14 修回日期:2017-03-27 出版日期:2017-12-25
- 作者简介:
- 柯逍,男,1983年10月生,福建省福州市人,博士,福州大学副教授,主要研究方向为计算机视觉、模式识别.E-mail:kex@fzu.edu.cn;邹嘉伟,男,1991年7月生,福建省龙岩市人,硕士,主要研究方向为计算机视觉、模式识别.E-mail:1468645610@qq.com;杜明智,男,1988年2月生,福建省泉州市人,硕士,主要研究方向为机器学习,图像处理.E-mail:dmz1028@163.com;周铭柯,男,1990年1月生,福建省三明市人,硕士,主要研究方向为深度学习、计算机视觉.E-mail:443810956@qq.com.
- 基金资助:
- 国家自然科学基金 (No.61502105）; 福建省科技引导性项目 (No.2017H0015）; 福建省中青年教师教育科研项目 (No.JA15075）

The Automatic Image Annotation Based on Monte-Carlo Data Set Balance and Robustness Incremental Extreme Learning Machine

KE Xiao^1,2, ZOU Jia-wei^1,2, DU Ming-zhi^1,2, ZHOU Ming-ke^1,2

1. College of Mathematics and Computer Science, Fuzhou University, Fuzhou, Fujian 350116, China;
2. Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, Fuzhou University, Fuzhou, Fujian 350116, China

Received:2016-03-14 Revised:2017-03-27 Online:2017-12-25 Published:2017-12-25
- Supported by:
- National Natural Science Foundation of China (No.61502105); Fujian Province Science and Technology Plan Guiding Project (No.2017H0015); Young and Middle-aged Teachers Education Research Project of Education Department of Fujian Province (No.JA15075)

摘要/Abstract

摘要： 针对传统图像标注模型存在着训练时间长、对低频词汇敏感等问题，该文提出了基于蒙特卡罗数据集均衡和鲁棒性增量极限学习机的图像自动标注模型.该模型首先对公共图像库的训练集数据进行图像自动分割，选择分割后相应的种子标注词，并通过提出的基于综合距离的图像特征匹配算法进行自动匹配以形成不同类别的训练集.针对公共数据库中不同标注词的数据规模相差较大，提出了蒙特卡罗数据集均衡算法使得各个标注词间的数据规模大体一致.然后针对单一特征描述存在的不足，提出了多尺度特征融合算法对不同标注词图像进行有效的特征提取.最后针对传统极限学习机存在的隐层节点随机性和输入向量权重一致性的问题，提出了鲁棒性增量极限学习，提高了判别模型的准确性.通过在公共数据集上的实验结果表明：该模型可以在很短时间内实现图像的自动标注，对低频词汇具有较强的鲁棒性，并且在平均召回率、平均准确率、综合值等多项指标上均高于现流行的大多数图像自动标注模型.

关键词: 蒙特卡罗数据集均衡, 多尺度特征融合, 极限学习机, 图像自动标注

Abstract: Aiming at the problem that the traditional image annotation model has long training time,sensitive to low-frequency words and other issues,this paper proposes a new automatic image annotation method based on Monte-Carlo dataset balance and robustness incremental extreme learning machine. First of all,training images of the public image library are segmented into different areas by this model and corresponding seed markup words are selected after segmentation,the areas are matched automatically based on comprehensive distance algorithm and the different keywords represent different areas. Then,for the huge difference of different annotated words' sizes in the public database,the Monte Carlo data set equalization algorithm is proposed to make the data size of each annotated word much the same. And a multi-scale feature fusion algorithm is proposed to extract effective features from different annotated images. Finally,the robustness incremental limit learning is proposed to improve the accuracy of the discriminant model for the problems of the consistency of the hidden layer nodes and the input vector weights existing in the traditional limit learning machine. The experimental results show that:compared with traditional algorithms of image automatic annotation,the methods proposed in this paper can implement the automatic image annotation quickly,and it is robust to low frequency words,and it is higher than most popular models of automatic image annotation in terms of average recall rate,average accuracy rate,comprehensive value and so on.

Key words: Monte-Carlo data set balance, multi-scale feature fusion, extreme learning machine, automatic image annotation

中图分类号:

TP311

柯逍, 邹嘉伟, 杜明智, 等. 基于蒙特卡罗数据集均衡与鲁棒性增量极限学习机的图像自动标注[J]. 电子学报, 2017, 45(12): 2925-2935.

KE Xiao, ZOU Jia-wei, DU Ming-zhi, et al. The Automatic Image Annotation Based on Monte-Carlo Data Set Balance and Robustness Incremental Extreme Learning Machine[J]. Acta Electronica Sinica, 2017, 45(12): 2925-2935.

参考文献

[1] 罗惠兰,郭敏杰,孔繁胜. 一种基于多级空间视觉词典集体的图像分类方法[J]. 电子学报,2015,43(4):684-693. Luo Hui-lan,Guo Min-jie,Kong Fan-sheng. An image classification method based on multiple level spatial visual dictionary ensemble[J]. Acta Electronica Sinica,2015,43(4):684-693.(in Chinese)
[2] Y Mori,H Takahashi,R Oka. Image-to-word transformation based on dividing and vector quantizing images with words[A]. First International Workshop on Multimedia Intelligent Storage and Retrieval Management[C].Florida,USA:MISRM, 1999. 405-409.
[3] 杨栋,周秀玲,郭平. 基于贝叶斯通用背景模型的图像标注[J]. 自动化学报,2013,39(10):1674-1680. YANG Dong,ZHOU Xiu-ling,GUO Ping. Image annotation with bayesian universal background model[J]. Acta Automatica Sinica,2013,39(10):1674-1680. (in Chinese)
[4] Wang C,Blei D,Li F F. Simultaneous image classification and annotation[A] IEEE Conference on Computer Vision & Pattern Recognition[C]. Miami,FL,USA:IEEE,2009.1903-1910.
[5] Makadia A,Pavlovic V,Kumar S. Baselines for image annotation.[J]. International Journal of Computer Vision,2010,90(1):88-105.
[6] Cabral,Ricardo,T Fernando De la,et al. Matrix completion for weakly-supervised multi-label image classification[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence(PAMI),2015,37(1):121-135.
[7] U Mlakar,B Potocnik. Automated facial expression recognition based on histograms of oriented gradient feature vector differences[J]. Signal,Image and Video Processing,2015,9(1):245-253.
[8] 刘威,段成伟,遇冰,等. 基于后验HOG特征的多姿态行人检测[J]. 电子学报,2015,43(2):217-224. Liu Wei,Duan Cheng-wei,Yu Bing. Multi-pose pedestrian detection based on posterior HOG Feature[J]. Acta Electronica Sinica,2015,43(2):217-224. (in Chinese)
[9] 刘军,景晓军,孙松林,谭有恒. 一种基于可变长起主导作用特征(VLDF)的人脸识别算法[J]. 电子学报,2015,43(3):544-549. Liu Jun,Jing Xiao-jun,Sun Song-lin,Tan You-heng. A variable length dominant feature(VLDF) based algorithm for face recognition[J]. Acta Electronica Sinica,2015,43(3):544-549. (in Chinese)
[10] Z Bai,GB Huang,D Wang,et al. Sparse extreme learning machine for classification[J]. IEEE Transactions on Cybernetics,2014,44(10):1858-1870.
[11] Deng W,Zheng Q,Chen L. Regularized extreme learning machine[A]. CIDM'09[C]. Nashville,Tennessee,USA:IEEE,2009. 389-395.
[12] SL Feng,R Manmatha,V LaVrenko. Multiple bernoulli relevance models for image and video annotation[A]. Computer Vision and Pattern Recognition[C]. Washington,USA:IEEE,2004. 1002-1009.
[13] Bucak S S,Jin R,Jain A K. Multi-label learning with incomplete class assignments[J]. Computer Visien & Pattern,2011,42(7):2801-2808.
[14] Barrat S,Tabbone S. Classification and automatic annotation extension of images using bayesian network[J]. Lecture Notes in Computer Science,2008,5342:937-946.
[15] F Shi,J Wang,Z Wang. Region-based supervised annotation for semantic image retrieval[J]. International Journal of Electronics and Communications,2011,65(11):929-936.

基于蒙特卡罗数据集均衡与鲁棒性增量极限学习机的图像自动标注

The Automatic Image Annotation Based on Monte-Carlo Data Set Balance and Robustness Incremental Extreme Learning Machine

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 6

编辑推荐

Metrics

[1]	陆克中, 陈超凡, 蔡桓, 吴定明. 面向概念漂移和类不平衡数据流的在线分类算法[J]. 电子学报, 2022, 50(3): 585-597.
[2]	杨红红, 王刘丽, 张玉梅, 吴晓军, 党允彤. 基于序列多尺度特征融合表示的层级舞蹈动作姿态估计方法[J]. 电子学报, 2021, 49(12): 2428-2436.
[3]	李雅倩, 盖成远, 肖存军, 吴超, 刘佳甲. 基于细化多尺度深度特征的目标检测网络[J]. 电子学报, 2020, 48(12): 2360-2366.
[4]	刘金平, 何捷舟, 马天雨, 张五霞, 唐朝晖, 徐鹏飞. 基于KELM选择性集成的复杂网络环境入侵检测[J]. 电子学报, 2019, 47(5): 1070-1078.
[5]	程玉胜, 赵大卫, 王一宾, 裴根生. 非平衡化标签补全核极限学习机多标签学习[J]. 电子学报, 2019, 47(3): 719-725.
[6]	曾启明, 纪震, 李琰, 俞航. 基于ELM和MA的微型四频天线设计[J]. 电子学报, 2014, 42(9): 1693-1698.