A Survey of Crime Scene Investigation Image Retrieval
LIU Ying1,2, HU Dan1,2, FAN Jiu-lun1
1. Center for Image and Information Processing, Xi`an University of Posts & Telecommunications, Xi'an, Shaanxi 710121, China;
2. Key Lab of Electronic Information Processing with Applications in Crime Scene Investigation, Ministry of Public Security, Xi'an, Shaanxi 710121, China
Abstract:Crime scene investigation (CSI) image retrieval is an important means to obtain material evidence for case solving.This paper describes the CSI image datasets,which are classified into different categories according to the content of the data,such as shoe marks,finger prints,tattoo,etc.This paper provides a survey on state-of-the-art techniques in CSI image retrieval focusing on low-level feature extraction and high-level semantic learning.Low-level CSI image features mainly include color feature,texture feature,boundary descriptor,etc.And,three categories of high-level semantic extraction techniques for CSI images are identified including using semantic template and database ontology,machine learning techniques and introducing relevance feedback.In addition,based on practical requirements from the police on using CSI images to find evidence clues,a few research directions are suggested such as introducing prior knowledge of the police to enhance retrieval efficiency.
刘颖, 胡丹, 范九伦. 现勘图像检索综述[J]. 电子学报, 2018, 46(3): 761-768.
LIU Ying, HU Dan, FAN Jiu-lun. A Survey of Crime Scene Investigation Image Retrieval. Acta Electronica Sinica, 2018, 46(3): 761-768.
[1] 刘颖,范九伦,李宗,黄源,燕皓阳.现勘图像数据库检索技术实例探讨[J].西安邮电大学学报,2015,20(3):11-20. LIU Y,FAN J,LI Z,HUANG Y,YAN H.Case study on content-based image retrieval for crime scene investigation image database[J].Journal of Xi'an University of Posts and Telecommunications,2015,20(3):11-20.(in Chinese)
[2] 韩宁,陈巍.基于聚类分析的串并案研究[J].中国人民公安大学学报(自然科学版),2012,18(1):53-58. HAN N,CHEN W.Research on serial case based on cluster analysis[J].Journal of Chinese People's Public Security University(Science and Technology),2012,18(1):53-58.(in Chinese)
[3] 张琪.图像检索在公安图像侦查领域的发展[J].中国安防,2015,(19):59-62. ZHANG Q.The development of image retrieval in public security image detection[J].China Security & Protection,2015,(19):59-62.(in Chinese)
[4] LIU Y,ZHANG D,LU G.A survey of content-based image retrieval with high-level semantics[J].Pattern Recognition,2007,40(1):262-282.
[5] LIU Y.Semantic-Based Image Retrieval[M].Beijing:Science Press,2016.1-191.
[6] LOWE D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision,2004,60(2):91-110.
[7] BAKAR S A,HITAM M S,YUSSOF W N J H W.Content-based image retrieval using SIFT for binary and grey-scale images[A].IEEE International Conference on Signal and Image Processing Application[C].Piscataway,USA:IEEE,2013.83-88.
[8] DALAL N,TRIGGS B.Histograms of oriented gradients for human detection[A].IEEE Conference on Computer Vision & Pattern Recognition[C].Piscataway,USA:IEEE,2005.886-893.
[9] LAZEBNIK S,SCHMID C,PONCE J.Beyond bags of features:Spatial pyramid matching for recognizing natural scene categories[A].IEEE Computer Society Conference on Computer Vision & Pattern Recognition[C].Piscataway,USA:IEEE,2006.2169-2178.
[10] PENG X,YAN R,ZHAO B,et al.Fast low rank representation based spatial pyramid matching for image classification[J].Knowledge-Based Systems,2014,90(C):14-22.
[11] SU J H,HUANG W J,YU P S,et al.Efficient relevance feedback for content-based image retrieval by mining user navigation patterns[J].IEEE Transactions on Knowledge & Data Engineering Archive,2011,23(3):360-372.
[12] CHEN Y,WANG J Z.A region-based fuzzy feature matching approach to content-based image retrieval[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2002,24(9):1252-1267.
[13] XU Shao-ping,LI Chun-quan,JIANG Shun-liang,LIU Xiao-ping.Similarity measures for content-based image retrieval based on intuitionistic fuzzy set theory[J].Journal of Computers,2012,7(7):1733-1742.
[14] DENG J,DONG W,SOCHER R,et al.ImageNet:A large-scale hierarchical image database[A].IEEE Conference on Computer Vision and Pattern Recognition[C].Piscataway,USA:IEEE,2009.248-255.
[15] KRIZHEVSKY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks[A].International Conference on Neural Information Processing Systems[C].USA:Curran Associates Inc,2012.1097-1105.
[16] SZEGEDY C,LIU W,JIA Y,et al.Going deeper with convolutions[A].IEEE Conference on Computer Vision and Pattern Recognition[C].Piscataway,USA:IEEE,2015.1-9.
[17] 刘颖,黄源,高梓铭.刑侦图像检索中的特征提取及相似度度量研究[J].西安邮电大学学报,2014,19(6):11-16. LIU Y,HUANG Y,GAO Z.Feature extraction and similarity measure for crime scene investigation image retrieval[J].Journal of Xi'an University of Posts and Telecommunications,2014,19(6):11-16.(in Chinese)
[18] AZAD R,AZAD B,SHAYEGH H R.Real-time and efficient method for accuracy enhancement of edge based license plate recognition system[A].2013 First International CITADIM Procecding-Scientific[C] [S.L.]:[s.n.],2014.146-155.
[19] MAI V D,MIAO D,WANG R,et al.An improved method for Vietnam license plate location,segmentation and recognition[A].IEEE International Conference on Multimedia Technology[C].Piscataway,USA:IEEE,2011.2942-2946.
[20] LYNCH M R,GAUNT R G.Applications of linear weight neural networks to fingerprint recognition[A].International Conference on Artificial Neural Networks[C].Britain:IET,1995.139-142.
[21] OSISANWO F Y,ADETUNMBI A O,ALESE B K.Barefoot morphology:A person unique feature for forensic identification[A].International Conference for Internet Technology & Secured Transaction[C].Piscataway,USA:IEEE,2015.356-359.
[22] KORTYLEWSKI A,ALBRECHT T,VETTER T.Unsupervised footwear impression analysis and retrieval from crime scene data[A].Asian Conference on Computer Vision[C].Germany:Springer International Publishing,2014.644-658.
[23] LI Z,WEI C,LI Y,SUN T.Research of shoeprint image stream retrieval algorithm with scale-invariance feature transform[A].International Conference on Multimedia Technology[C].Piscataway,USA:IEEE,2011.5488-5491.
[24] 黎向阳,吴敏华,施智平.基于Gabor变换域的积分直方图鞋印图像检索[J].计算机应用与软件,2015,32(3):215-219. LI X,WU M,SHI Z.Shoeprint images retrieval based on integral histogram in gabor transform domain[J].Computer Application and Software,2015,32(3):215-219.(in Chinese)
[25] KANAMADI M,BHOSLE D.Content based forensics tattoo image retrieval and identification method for database applications[J].Journal of Information,Knowledge and Research in Computer Engineering,2010,3(2):651-656.
[26] MANGER D.Large-scale tattoo image retrieval[A].IEEE Computer and Robot Vision[C].Piscataway,USA:IEEE,2012.454-459.
[27] SU H,KONG A W K.A study on low resolution androgenic hair patterns for criminal and victim identification[J].IEEE Transactions on Information Forensics& Security,2014,9(4):666-680.
[28] SUDHAI K G,RASJESWARI S V.Hair patterns and skin marks for criminal and victim identification using RPPSM approach[J].International Journal of Advanced Research in Computer Science and Software Engineering,2015,5(4):65-66.
[29] PRAVEEN R Joshi.Study of identification of criminals and dupe by androgenic hair patterns[J].International Journal of Current Advanced Research,2015,4(10):431-435.
[30] 刘颖,燕皓阳.具有旋转不变性的轮胎纹理特征提取[J].西安邮电大学学报,2015,20(6):10-13. LIU Y,YAN H.A rotation-invariant texture feature extraction method for tire pattern image[J].Journal of Xi'an University of Posts and Telecommunications,2015,20(6):10-13.(in Chinese)
[31] LIU Y,YAN H,LIM K P.Study on rotation-invariant texture feature extraction for tire pattern retrieval[J].Multidimensional Systems & Signal Processing,2017,28(2):757-770.
[32] HUANG Y,LIU Y.Study on region-based forensic image retrieval[A].Seventh International Symposium on Computational Intelligence and Design[C].Piscataway,USA:IEEE,2014.486-489.
[33] 刘伟,刘颖,李大湘,朱婷鸽.一种两层体系刑侦图像检索方法[J].西安邮电大学学报,2016,(06):35-39. LIU W,LIU Y,LI D,ZHU T.A two-phase hierarchical approach for crime scene investigation image retrieval[J].Journal of Xi'an University of Posts and Telecommunications,2016,(06):35-39.(in Chinese)
[34] LIU Y,LI Z.Study on texture feature extraction from forensic images with watermark[A].IEEE 9th Conference on Industrial Electronics and Applications[C].Piscataway,USA:IEEE,2014.1471-1475.
[35] GULHANE S A.Content based image retrieval from forensic image databases[J].International Journal of Engineering Research & Applications,2015,5(3):66-70.
[36] ZHANG Qi,OERLEMANS Ard,BAKKER E M.Crime Scene Investigations Using Interactive Learning[EB/OL].http://press.liacs.nl/publications/technicalreports/2014.CrimeSceneInvestigations.pdf,2014-10-17/2015-10-06.