高分辨率光谱视频采集研究

doi:10.3969/j.issn.0372-2112.2015.04.022

摘要/Abstract

摘要：

相比于当前常用的红、绿、蓝三通道成像技术,光谱采集能够提供更多的颜色通道,从而更加精细地反映光源与场景的物理特性,因此可以广泛应用于遥感、材料、医疗、环境等诸多领域.光谱采集技术需要捕获光线在不同时刻和不同空间位置的光谱信息,主要表现在光谱、时间、空间三个维度上的信息获取.传统的光谱采集设备大多采用时序滤波或空间扫描机制记录光谱信息,需要很长的成像时间,因而不能用于光谱视频信息的采集.近年来,伴随着采样理论和电子元器件技术的迅速发展,光谱的视频(动态)采集成为了可能.本文着眼于近年来刚刚起步的光谱视频采集技术,从采集技术的背景和基本原理出发,对于近年来涌现的高分辨率光谱视频采集方法和系统进行介绍,并对于基于直接采集和计算重构的各类技术手段展开讨论,详细阐述这些方法的光学原理、采集理论以及实际系统构建中的问题.此外,本文对各种方法在光谱视频采集中的一些重要性能指标和系统实际运行优缺点进行对比.最后,本文也对光谱视频采集的相关应用与发展前景进行了讨论.

关键词: 光谱, 视频采集, 分辨率

Abstract:

Spectral capture technique collects information with more color channels than traditional trichromatic sensing.Therefore it provides more detailed properties of the light source and the scene.Possible applications span across lots of fields such as remote sensing,materials science,bio-photonics,environmental monitoring,computer vision and so on.Spectral capture technique needs to record massive data in spatial,temporal and spectral dimension,whereas traditional spectral capture systems suffer from temporal and spatial scanning which is not suitable for video capture.Nowadays,with rapid development in sampling theory and electronic techniques,spectral video acquisition is becoming feasible.This paper presents a review and comparisons on the capturing techniques of high resolution spectral video,especially on hyperspectral video capturing research.In the end,relative applications and future work of hyperspectral video capture are also discussed.

Key words: hyperspectral, video capture, resolution

中图分类号:

O433

马晨光, 曹汛, 季向阳, 戴琼海. 高分辨率光谱视频采集研究[J]. 电子学报, 2015, 43(4): 783-790.

MA Chen-guang, CAO Xun, JI Xiang-yang, DAI Qiong-hai. Research on High Resolution Hyperspectral Capture Technique[J]. Acta Electronica Sinica, 2015, 43(4): 783-790.

参考文献

[1] V Backman,M Wallace,L Perelman,J Arendt,M Müller,Q Zhang,G Zonios,E Kline,T Mcgillican.Detection of preinvasive cancer cells[J].Nature,2000,406(6791):35-36.
[2] W Debskia,P Walczykowskia,A Klewskia,M Zyznowskib.Analysis of usage of multispectral video technique for distinguishing objects in real time[A].20th ISPRS Congress[C].Istanbul:ISPRS,2004.201(323).
[3] S Delalieux,A Auwerkerken,W Verstraeten,B Somers,R Valcke,S Lhermitte,J Keulemans,P Coppin.Hyperspectral reflectance and fluorescence imaging to detect scab induced stress in apple leaves[J].Remote Sensing,2009,1(4):858-874.
[4] R Kester,N Bedard,L Gao,T Tkaczyk.Real-time snapshot hyperspectral imaging endoscope[J].J Biomed Opt,2011,16(5):056005.
[5] M Kim,T Harvey,D Kittle,H Rushmeier,D Brady.3D imaging spectroscopy for measuring hyperspectral patterns on solid objects[J].ACM Transactions on Graphics(TOG),2012,31(4):38.
[6] G Wong.Snapshot hyperspectral imaging and practical applications[J].Journal of Physics:Conference Series,IOP Publishing,2009,178:012048.
[7] J Murguia,G Diaz,T Reeves,R Nelson,J Mooney,F Shepherd,G Griffith,D Franco.Applications of multi spectral video[A].Proceedings of SPIE NanoScience Engineering[C].San Diego:SPIE,2010:77800.
[8] Z Pan,G Healey,M Prasad,B Tromberg.Face recognition in hyperspectral images[J].IEEE Trans PAMI,2003,25(12):1552-1560.
[9] J Kim,M Escuti.Snapshot imaging spectro polarimeter utilizing polarization gratings[A].Proceedings of SPIE Optical Engineering and Applications[C].SPIE,2008.7086:708603.
[10] M Yamaguchi,H Haneishi,H Fukuda,J Kishimoto,H Kanazawa,M Tsuchida,R Iwama,N Ohyama.High fidelity video and still-image communication based on spectral information:natural vision system and Its applications[A].Proceedings of SPIE Electronic Imaging[C].SPIE,2006.6062:129-140.
[11] T Akgun,Y Altunbasak,R Mersereau.Super-resolution reconstruction of hyperspectral images[J].IEEE Trans Image Processing,2005,14(11):1860-1875.
[12] G Brelstaff,A Párraga,T Trosianko,D Carr.Hyperspectral camera system:acquisition and analysis[A].Proceedings of SPIE Satellite Remote Sensing[C].SPIE,1995.150-159.
[13] P Burns,R Berns.Analysis of multispectral image capture[A].Proceedings of 4th IS&T/SID Color Imaging Conference[C].SPIE,1996.19.
[14] M Golub,M Nathan,A Averbuch,E Lavi,V Zheludev,A Schclar.Spectral multiplexing method for digital snapshot spectral imaging[J].Appl Opt,2009,48(8):1520.
[15] A Harvey,J Beale,A Greenaway,T Hanlon,J Williams.Technology options for imaging spectrometry[A].Proceedings of SPIE Imaging Spectrometry VI[C].SPIE,2000.4132.
[16] A Harvey,D Holmes.High-throughput snapshot spectral imaging in two dimensions[A].Proceedings of SPIE Conference Series[C].SPIE,2003.4959:46-54.
[17] A Harvey,D Holmes,A Gorman,K Altenbach,J Arlt,N Read.Spectral imaging in a snapshot[A].Proceedings of SPIE Biomedical Optics[C].SPIE,2005.5694:110-119.
[18] J Kerekes,J Baum.Hyperspectral imaging system modeling[J].Lincoln Laboratory Journal Special Issue on Spectral Imaging,2003,14(1):117-124.
[19] W Porter,H Enmark.A system overview of the airborne visible/infrared imaging spectrometer[A].Proceedings of SPIE Imaging Spectroscopy II[C].SPIE,1987.1:3-12.
[20] R Basedow,D Carmer,M Anderson.Hydice system:implementation and performance[A].Proceedings of SPIE 1995 Symposium on OE[C].SPIE,1995.2480:258.
[21] Y Schechner,S Nayar.Generalized mosaicing[A].IEEE Proceedings of ICCV[C].IEEE,2001.17-24.
[22] Y Schechner,S Nayar.Generalized mosaicing:wide field of view multispectral imaging[J].IEEE Trans PAMI,2002,24(10):1334-1348.
[23] N Gat.Imaging spectroscopy using tunable filters:a review[A].Proceedings of SPIE AeroSense 2000[C].SPIE,2000.4056:50-64.
[24] M Descour,E Derenak.Computed tomography imaging spectrometer:experimental calibration and reconstruction results[J].Appl Opt,1995,34(22):4817-4826.
[25] M Descour,C Volin,B Ford,E Dereniak,P Maker,D Wilson.Snapshot hyperspectral imaging[J].Journal of Integrated Computational Imaging Systems,2001.
[26] N Hagen,E Dereniak.Analysis of computed tomographic imaging spectrometers I:spatial and spectral resolution[J].Appl Opt,2008,47(28):F85-F95.
[27] N Hagen,E Dereniak,D Sass.Maximizing the resolution of a CTIS instrument[A].Proc SPIE Optics Photonics[C].SPIE,2006.6302:63020L.
[28] W Johnson,D Wilson,G Bearman.All-reflective snapshot hyperspectral imager for ultraviolet and infrared applications[J].Opt Lett,2005,30(12):1464-1466.
[29] W Johnson,D Wilson,G Bearman.Spatial and spectral modulating snapshot hyperspectral imager[J].Appl Opt,2006,45(9):1898-1908.
[30] T Chao,H Zhou,X Xia,S Serati.Near Ir electro-optic imaging fourier transform spectrometer[A].Proceedings of SPIE[C].SPIE,2005.5816:163.
[31] M Kudenov,E Dereniak.Compact snapshot real-time imaging spectrometer[A].Proceedings of SPIE Security Defence[C].SPIE,2011.8186:81860W.
[32] A Villemaire,S Fortin,J Giroux,T Smithson,R Oermann.Imaging fourier transform spectrometer[A].Proceedings of SPIE[C].SPIE,1995.2480:387.
[33] R Willett,M Gehm,D Brady.Multiscale reconstruction for computational spectral imaging[A].Proceedings of SPIE Electronic Imaging[C].SPIE,2007.64980.
[34] D Brady,M Gehm.Compressive imaging spectrometers using coded apertures[A].Proceedings of SPIE Defense and Security Symposium[C].SPIE,2006.6246:62460A.
[35] M Gehm,R John,D Brady,R Willett,T Schulz.Single-shot compressive spectral imaging with a dual disperser architecture[J].Opt Express,2007,15(21):14013-14027.
[36] A Wagadarikar,R John,R Willett,D Brady.Single disperser design for coded aperture snapshot spectral imaging[J].Appl Opt,2008,47(10):B44-B51.
[37] A Wagadarikar,M Gehm,D Brady.Performance comparison of aperture codes for multimodal,multiplex spectroscopy[J].Appl Opt,2007,46(22):4932-4942.
[38] A Wagadarikar,N Pitsianis,X Sun,D Brady.Spectral image estimation for coded aperture snapshot spectral imagers[A].Proceedings of SPIE Optical Engineering Applications[C].SPIE,2008.7076:707602.
[39] D Kittle,D Marks,D Brady.Design and fabrication of an ultravioletvisible coded-aperture snapshot spectral imager[J].Optical Engineering,2012,51(7):071403-1-071403-10.
[40] A Wagadarikar,N Pitsianis,X Sun,D Brady.Video rate spectral imaging using a coded aperture snapshot spectral imager[J].Opt Express,2009,17(8):6368-6388.
[41] A Bodkin,A Sheinis,A Norton,J Daly,S Beaven,J Weinheimer.Snapshot hyperspectral imaging:the hyperpixel array camera[A].Proceedings of SPIE[C].SPIE,2009.7334:73340H.
[42] L Gao,R Kester,N Hagen,T Tkaczyk.Snapshot image mapping spectrometer(IMS)with high sampling density for hyperspectral microscopy[J].Opt Express,2010,18(14):14330-14344.
[43] X Cao,H Du,X Tong,Q Dai,S Lin.A prism-mask system for multispectral video acquisition[J].IEEE Trans PAMI,2011,33(12):2423.
[44] R Habel,M Kudenov,M Wimmer.Practical spectral photography[A].Proceedings of Computer Graphics Forum[C].Blackwell Publishing Ltd,2012,31(2pt2):449-458.
[45] X Cao,X Tong,Q Dai,S Lin.High resolution multi spectral video capture with a hybrid camera system[A].IEEE Proceedings of CVPR[C].IEEE,2011.297-304.
[46] R Kawakami,Y Matsushita,J Wright,M Ben-Ezra,Y Tai,K Ikeuchi.High-resolution hyperspectral imaging via matrix factorization[A].IEEE Proceedings of CVPR[C].IEEE,2011.2329-2336.
[47] A Charles,B Olshausen,C Rozell.Learning sparse codes for hyperspectral imagery[J].IEEE Journal of Selected Topics in Signal Process,2011,(99):1.
[48] A Chakrabarti,T Zickler.Statistics of real world hyper spectral images[A].IEEE Proceedings of CVPR[C].IEEE,2011.193-200.
[49] Y Wu,G Arce.Snapshot spectral imaging via compressive random convolution[A].IEEE Proceedings of ICASSP[C].IEEE,2011.1465-1468.
[50] A Mrozack,D Marks,D Brady.Coded aperture spectroscopy with denoising through sparsity[J].Optics Express,2012,20(3):2297-2309.
[51] H Pal,M Neifeld.Multispectral principal component imaging[J].Opt Express,2003,11(18):2118-2125.
[52] M Neifeld,P Shankar.Feature-specific imaging[J].Appl Opt,2003,42(17):3379-3389.