基于兴趣目标的图像检索

doi:10.3969/j.issn.0372-2112.2018.08.016

电子学报 ›› 2018, Vol. 46 ›› Issue (8): 1915-1923.DOI: 10.3969/j.issn.0372-2112.2018.08.016

基于兴趣目标的图像检索

张峰, 钟宝江

苏州大学计算机科学与技术学院, 江苏苏州 215000

收稿日期:2017-02-03 修回日期:2018-01-18 出版日期:2018-08-25 发布日期:2018-08-25
通讯作者: 钟宝江
作者简介:张峰男,1990年生于江苏扬州.苏州大学计算机科学与技术学院硕士研究生.研究方向为图像处理、图像检索.E-mail:276197179@qq.com.
基金资助:
国家自然科学基金（No.61572341）；苏州大学"东吴学者计划"项目

Image Retrieval Based on Interested Objects

ZHANG Feng, ZHONG Bao-jiang

Department of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215000, China

Received:2017-02-03 Revised:2018-01-18 Online:2018-08-25 Published:2018-08-25

摘要/Abstract

摘要： 当前图像检索算法通常针对整体图像提取特征以完成检索任务.然而，在很多情况下用户只会关注图像的一部分，即他们的兴趣目标.此时，从整体图像提取的特征一部分是有效的，另一部分则是无效的且会对检索过程带来消极影响.为此，本文提出基于兴趣目标的图像检索方案，并借助于现有的显著性检测、图像分割、特征提取等技术实现一款有效的图像检索算法.首先采用HS （Hierarchical Saliency，分层显著性）检测算法分析用户的兴趣目标并应用SC （Saliency-based Image Cut，基于显著性的图像分割）算法将其分割，然后针对兴趣目标提取HSV （Hue、Saturation、Value，色调、饱和度、明度）颜色特征、SIFT （Scale Invariant Feature Transform，尺度不变特征变换）局部特征和CNN （Convolutional Neural Network，卷积神经网络）语义特征，最后计算其与数据库图像的相似度并根据相似度排序返回检索结果.仿真实验结果表明，本文算法在解决"这是什么东西"这类图像检索任务时明显优于现有的图像检索算法.

关键词: 图像检索, 兴趣目标, 显著性检测, 图像分割, 卷积神经网络, 尺度不变特征变换, 颜色特征

Abstract: The current image retrieval algorithms usually extract features from the whole input image to conduct retrieval tasks.However,in many cases users focus on only a part of the image,i.e.object-of-interest.As a result,the features extracted from the image are partially effective.In other words,some of the features are ineffective and might have a negative impact on the retrieval process.To overcome this difficulty,an image retrieval scheme based on object-of-interest is proposed.By incorporating this retrieval scheme with the existing techniques in saliency detection,image segmentation,and feature extraction,an effective image retrieval algorithm is coded.First,the hierarchical saliency (HS) detection algorithm is adopted to analyze the user's object-of-interest,and the saliency-based image cut (SC) algorithm is employed to segment it from the input image.Then,we extract the hue,saturation,value (HSV) color features,the scale invariant feature transform (SIFT) local features and the convolutional neural network (CNN) semantic features of the object-of-interest.Finally,the similarity of object-of-interest between a query image and every database image is computed and the retrieval result is sorted accordingly.Simulation experimental results show that,when being used to cope with a retrieval task like "what is this",the proposed algorithm is significantly better than the current image retrieval algorithms.

Key words: image retrieval, object-of-interest, saliency detection, image segmentation, convolutional neural network(CNN), scale invariant feature transform(SIFT), color feature

中图分类号:

TP391

张峰, 钟宝江. 基于兴趣目标的图像检索[J]. 电子学报, 2018, 46(8): 1915-1923.

ZHANG Feng, ZHONG Bao-jiang. Image Retrieval Based on Interested Objects[J]. Acta Electronica Sinica, 2018, 46(8): 1915-1923.

参考文献

[1] Jegou H,Douze M,Schmid C.Hamming embedding and weak geometric consistency for large scale image search[A].European Conference on Computer Vision[C].Berlin,Germany:Springer,2008.304-317.
[2] Zheng L,Wang S,Liu Z,et al.Packing and padding coupled multi-index for accurate image retrieval[A].IEEE Conference on Computer Vision and Pattern Recognition[C].New York,USA:IEEE,2014.1947-1954.
[3] Liu G H,Yang J Y.Content-based image retrieval using color difference histogram[J].Pattern Recognition,2013,46(1):188-198.
[4] Liu G H,Li Z Y,Zhang L,et al.Image retrieval based on micro-structure descriptor[J].Pattern Recognition,2011,44(9):2123-2133.
[5] 周燕,曾凡智.基于二维压缩感知和分层特征的图像检索算法[J].电子学报,2016,44(2):453-460. Zhou Yan,Zeng Fan-zhi.An image retrieval algorithm based on two-dimensional compressive sensing and hierarchical feature[J].Acta Electronica Sinica,2016,44(2):453-460.(in Chinese)
[6] Itti L,Koch C,Niebur E.A model of saliency-based visual attention for rapid scene analysis[J].IEEE Trans on PAMI,1998,20(11):1254-1259.
[7] Hou X,Zhang L.Saliency detection:A spectral residual approach[A].IEEE Conference on Computer Vision and Pattern Recognition[C].New York,USA:IEEE,2007.1-8.
[8] Li J,Levine,M.D,An X,et al.Visual saliency based on scale-space analysis in the frequency domain[J].IEEE Trans on PAMI,2013,35(4):996-1010.
[9] Cheng M M,Zhang G X,Mitra N.J.,et al.Global contrast based salient region detection[J].IEEE Trans on PAMI,2015,37(3):409-416.
[10] Yan Q,Xu L,Shi J,et al.Hierarchical saliency detection[A].IEEE Conference on Computer Vision and Pattern Recognition[C].New York,USA:IEEE,2013.1155-1162.
[11] Fu H,Chi Z,Feng D.Attention-driven image interpretation with application to image retrieval[J].Pattern Recognition,2006,39(9):1604-1621.
[12] Liu G H,Yang J Y,Li Z Y.Content-based image retrieval using computational visual attention model[J].Pattern Recognition,2015,48(8):2554-2566.
[13] Gonzalez R C,Woods R E.Digital Image Processing[M].Nueva Jersey,2008.
[14] Tatler B W.The central fixation bias in scene viewing:selecting an optimal viewing position independently of motor biases and image feature distributions[J].Journal of Vision,2007,7(14):1-17.
[15] Kschischang F R,Frey B J,Loeliger H A.Factor graphs and the sum-product algorithm[J].IEEE Trans on Information Theory.2001,47(2):498-519.
[16] http://www.cse.wustl.edu/~sg/multi-inst-data/[OL]
[17] Rother C,Kolmogorov V,Blake A."GrabCut":interactive foreground extraction using iterated graph cuts[J].ACM Trans on Graphics,2004,23(3):309-314.
[18] Otsu N.A threshold selection method from gray-level histograms[J].IEEE Trans on Systems Man and Cybernetics,1979,9(1):62-66.
[19] Paschos G.Perceptually uniform color spaces for color texture analysis:an empirical evaluation[J].IEEE Trans on Image Processing,2001,10(6):932-937.
[20] Lowe D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision,2004,60(2):91-110.
[21] Muja M,Lowe D G.Scalable nearest neighbor algorithms for high dimensional data[J].IEEE Trans on PAMI,2014,36(11):2227-2240.
[22] Krizhevsky A,Sutskever I,Hinton G E.ImageNet classification with deep convolutional neural networks[J].Advances in Neural Information Processing Systems,2012,25(2):2012.
[23] Szegedy C,Liu W,Jia Y,et al.Going deeper with convolutions[A].IEEE Conference on Computer Vision and Pattern Recognition[C].New York,USA:IEEE,2015.1-9.
[24] Alkoot F M,Kittler J.Experimental evaluation of expert fusion strategies[J].Pattern Recognition Letters,1999,20(11):1361-1369.
[25] Huiskes M J,Lew M S.The MIR flickr retrieval evaluation[A].ACM International Conference on Multimedia Information Retrieval[C].ACM,2008.39-43.
[26] Babenko A,Slesarev A,Chigorin A,et al.Neural codes for image retrieval[A].European Conference on Computer Vision[C].Cham,Germany:Springer,2014.584-599.

基于兴趣目标的图像检索

Image Retrieval Based on Interested Objects

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	廖勇, 李玉杰. 一种轻量化低复杂度的FDD大规模MIMO系统CSI反馈方法[J]. 电子学报, 2022, 50(5): 1211-1217.
[2]	张云, 化青龙, 姜义成, 徐丹. 基于混合型复数域卷积神经网络的三维转动舰船目标识别[J]. 电子学报, 2022, 50(5): 1042-1049.
[3]	崔亚奇, 何友, 唐田田, 熊伟. 一种深度学习航迹关联方法[J]. 电子学报, 2022, 50(3): 759-763.
[4]	伍邦谷, 张苏林, 石红, 朱鹏飞, 王旗龙, 胡清华. 基于多分支结构的不确定性局部通道注意力机制[J]. 电子学报, 2022, 50(2): 374-382.
[5]	蔡超丽, 李纯纯, 黄琳, 杨铁军. ED-NAS: 基于神经网络架构搜索的陶瓷晶粒SEM图像分割方法[J]. 电子学报, 2022, 50(2): 461-469.
[6]	李居朋, 王颖慧, 李刚. 医学图像关键点检测深度学习方法研究与挑战[J]. 电子学报, 2022, 50(1): 226-237.
[7]	赵琰, 赵凌君, 匡纲要. 基于注意力机制特征融合网络的SAR图像飞机目标快速检测[J]. 电子学报, 2021, 49(9): 1665-1674.
[8]	管永明, 王刚, 骆凯波, 吕梁, 吕晓雯, 史玉良. 基于极端不平衡学习的泛化低压异常箱表关系识别研究与应用[J]. 电子学报, 2021, 49(8): 1507-1514.
[9]	徐频捷, 陈逸杰, 李之南, 赵地. 基于事件驱动的车道线识别算法研究[J]. 电子学报, 2021, 49(7): 1379-1385.
[10]	罗会兰, 袁璞, 童康. 基于深度学习的显著性目标检测方法综述[J]. 电子学报, 2021, 49(7): 1417-1427.
[11]	程旭, 宋晨, 史金钢, 周琳, 张毅锋, 郑钰辉. 基于深度学习的通用目标检测研究综述[J]. 电子学报, 2021, 49(7): 1428-1438.
[12]	张昱, 刘开峰, 张全新, 王艳歌, 高凯龙. 基于组合-卷积神经网络的中文新闻文本分类[J]. 电子学报, 2021, 49(6): 1059-1067.
[13]	裴翰奇, 杨春玲, 魏志超, 曹燕. 基于SPL迭代思想的图像压缩感知重构神经网络[J]. 电子学报, 2021, 49(6): 1195-1203.
[14]	乔思波, 庞善臣, 王敏, 翟雪, 于世行, 丁桐. 基于残差混合注意力机制的脑部CT图像分类卷积神经网络模型[J]. 电子学报, 2021, 49(5): 984-991.
[15]	陈星宇, 叶锋, 黄添强, 翁彬, 陈家祯, 林文忠. 融合小型深度生成模型的显著性检测[J]. 电子学报, 2021, 49(4): 768-774.