Saliency Detection with Multi-layer Contour-Region Complementary

doi:10.3969/j.issn.0372-2112.2018.11.016

PDF(1457 KB)

ACTA ELECTRONICA SINICA ›› 2018, Vol. 46 ›› Issue (11) : 2688-2695. DOI: 10.3969/j.issn.0372-2112.2018.11.016

Saliency Detection with Multi-layer Contour-Region Complementary

YANG Xing-ming, WANG Yu-ting, XIE Zhao, WU Ke-wei

Author information +

History +

Abstract

Inspired by Gestalt theory in psychology, we proposes a saliency detection method with multi-layer contour-region characteristic by using the complementary between contour cue and appearance cue, to address the problem that object is indiscoverable in the clutter scene, Firstly, after the image super-pixel segmentation, two kinds of appearance features are extracted respectively, including global appearance cue based on color histogram and local contrast cues based on the regional neighborhood relations. Secondly, in order to solve the object confusion caused by small difference in the appearance, we extract object closure feature to describe the saliency from object contour. Finally, we introduce multi-scale segmentation into our model to enhance the robustness for the diversity of object size, and use the support vector machine to optimize the fusion weights of contour-region cues. Experiments on ASD, MSRA10K, SED2 datasets show that, compared to other state-of-the-art methods, our model can improve the recall and precision measure due to the introduction of contour closure characteristic.

Key words

saliency detection / contour closure / multi-layer fusion / appearance saliency / complementary

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

YANG Xing-ming, WANG Yu-ting, XIE Zhao, WU Ke-wei. Saliency Detection with Multi-layer Contour-Region Complementary[J]. Acta Electronica Sinica, 2018, 46(11): 2688-2695. https://doi.org/10.3969/j.issn.0372-2112.2018.11.016

References

[1] Hadizadeh H,Bajic' I V.Saliency-aware video compression[J].IEEE Transactions on Image Processing a Publication of the IEEE Signal Processing Society,2013,23(1):19-33.
[2] Ye L,Z Liu,Li L,Shen L,Bai C.Salient object segmentation via effective integration of saliency and objectness[J].IEEE Transactions on Multimedia,2017,(99):1-1.
[3] Mahadevan V,Vasconcelos N.Saliency-based discriminant tracking[A].IEEE Conference on Computer Vision and Pattern Recognition[C].Los Alamitos,CA:IEEE Computer Society,2009.1007-1013.
[4] 姜维,卢朝阳,李静,等.基于视觉显著性与文字置信图的场景文字的背景抑制方法[J].电子学报,2015,43(1):62-68. Jiang Wei,Lu Chao-yang,Li Jing,et al.Visual saliency and text confidence map based background suppression for scene text[J].Acta Electronica Sinica,2015,43(1):62-68.(in Chinese)
[5] Gao Y,Shi M,Tao D,et al.Database saliency for fast image retrieval[J].IEEE Transactions on Multimedia,2015,17(3):359-369.
[6] Itti L,Koch C,Niebur E.A model of saliency-based visual attention for rapid scene analysis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259.
[7] Harel J,Koch C,Perona P,et al.Graph-Based visual saliency[A].Neural Information Processing Systems[C].Granada,2006.545-552.
[8] Achanta R,Hemami S,Estrada F,et al.Frequency-tuned salient region detection[A].IEEE Conference on Computer Vision and Pattern Recognition[C].Los Alamitos,CA:IEEE Computer Society,2009.1597-1604.
[9] Frintrop S,Werner T,Garcia G M.Traditional saliency reloaded:A good old model in new shape[A].IEEE Conference on Computer Vision and Pattern Recognition[C].Los Alamitos,CA:IEEE Computer Society,2015.82-90.
[10] Vikram T N,M.Tscherepanow,B.Wrede.A saliency map based on sampling an image into random rectangular regions of interest[J].Pattern Recognition,2012,45(9):3114-3124.
[11] Perazzi F,Krähenbühl P,Pritch Y,et al.Saliency filters:Contrast based filtering for salient region detection[A].IEEE Conference on Computer Vision and Pattern Recognition[C].Los Alamitos,CA:IEEE Computer Society,2012.733-740.
[12] Kim J,Han D,Tai YW,Kim J.Salient region detection via high-dimensional color transform[A].IEEE Conference on Computer Vision and Pattern Recognition[C].Los Alamitos,CA:IEEE Computer Society,2014.25(1):883-890.
[13] Cheng M M,Mitra N J,Huang X,et al.Global contrast based salient region detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(3):569-582.
[14] Liu T,Yuan Z,Sun J,Wang J,Zheng N,Tang X,Shum H-Y.Learning to detect a salient object[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(2):353-367.
[15] Kruthiventi SSS,Ayush K,Babu RV.DeepFix:A fully convolutional neural network for predicting human eye fixations[J].IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society,2015,(99):1-1.
[16] Li G,Yu Y.Deep contrast learning for salient object detection[A].Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition[C].Los Alamitos,CA:IEEE Computer Society,2016.478-487.
[17] Yang C,Zhang L,Lu H.Graph-regularized saliency detection with convex-hull-based center prior[J].IEEE Signal Processing Letters,2013,20(7):637-640.
[18] Ren T,Liu Y,Ju R,et al.How important is location information in saliency detection of natural images[J].Multimedia Tools and Applications,2016,75(5):2543-2564.
[19] 周帅骏,任福继,堵俊,等.融合背景先验与中心先验的显著性目标检测[J].中国图象图形学报,2017,22(5):584-595. Zhou Shuai-jun,Ren Fu-ji,Du Jun,et al.Salient region detection based on the integration of background-bias prior and center-bias prior[J].Journal of Image and Graphics,2017,22(5):584-595.(in Chinese)
[20] Achanta R,Hemami S,Estrada F,et al.Frequency-tuned salient region detection[A].IEEE Conference on Computer Vision and Pattern Recognition[C].Los Alamitos,CA:IEEE Computer Society,2009.1597-1604.
[21] Zhang L,Tong MH,Marks K,Shan H,Cottrell GW.SUN:A Bayesian framework for saliency using natural statistics[J].Journal of Vision,2008,8(7):32.1-20.
[22] Goferman S,Zelnikmanor L,Tal A.Context-Aware Saliency Detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(10):1915-1926.
[23] Hou Q,Cheng MM,Hu XW,Borji A,Tu Z.Deeply supervised salient object detection with short connections[A].IEEE Conference on Computer Vision and Pattern Recognition[C].Los Alamitos,CA:IEEE Computer Society,2017.3203-3212.
[24] 毕威,黄伟国,张永萍,等.基于图像显著轮廓的目标检测[J].电子学报,2017,45(8):1902-1910. Bi Wei,Huang Wei-guo,Zhang Yong-ping,et al.Object detection based on salient contour of image[J].Acta Electronica Sinica,2017,45(8):1902-1910.(in Chinese)
[25] 罗会兰,万成涛,孔繁胜.基于KL散度及多尺度融合的显著性区域检测算法[J].电子与信息学报,2016,38(7):1594-1601. Luo Hui-lan,Wan Cheng-tao,Kong Fan-sheng.Salient region detection algorithm via KL divergence and multi-scale merging[J].Journal of Electronics and Information Technology,2016,38(7):1594-1601.(in Chinese)