高分辨率光谱视频采集研究

doi:10.3969/j.issn.0372-2112.2015.04.022

电子学报 ›› 2015, Vol. 43 ›› Issue (4): 783-790.DOI: 10.3969/j.issn.0372-2112.2015.04.022

高分辨率光谱视频采集研究

马晨光¹, 曹汛², 季向阳¹, 戴琼海¹

1. 清华大学多维多尺度计算摄像学北京市重点实验室, 北京 100084;
2. 南京大学电子科学与工程学院, 江苏南京 210093

收稿日期:2013-02-18 修回日期:2014-10-24 出版日期:2015-04-25
- 作者简介:
- 马晨光 男,1988年12月出生,河北承德人.2011年本科毕业于清华大学自动化系,其后进入清华大学自动化系攻读博士,从事计算摄像学、计算机视觉相关研究.E-mail:mcg07@mails.tsinghua.edu.cn;曹汛男,1983年10月出生,江苏扬州人.清华大学工学博士,现为南京大学电子科学与工程学院副教授,近年来主要从事图像和视频处理、机器视觉以及计算摄像学方向的研究.
- 基金资助:
- 国家自然科学基金 (No.61327902,No.61422107,No.61325003)

Research on High Resolution Hyperspectral Capture Technique

MA Chen-guang¹, CAO Xun², JI Xiang-yang¹, DAI Qiong-hai¹

1. Beijing Key Laboratory of Multi-Dimension & Multi-Scale Computational Photography(MMCP), Tsinghua University, Beijing 100084, China;
2. School of ESE, Nanjing University, Nanjing, Jiangsu 210093, China

Received:2013-02-18 Revised:2014-10-24 Online:2015-04-25 Published:2015-04-25
- Supported by:
- National Natural Science Foundation of China (No.61327902, No.61422107, No.61325003)

摘要/Abstract

摘要：

相比于当前常用的红、绿、蓝三通道成像技术,光谱采集能够提供更多的颜色通道,从而更加精细地反映光源与场景的物理特性,因此可以广泛应用于遥感、材料、医疗、环境等诸多领域.光谱采集技术需要捕获光线在不同时刻和不同空间位置的光谱信息,主要表现在光谱、时间、空间三个维度上的信息获取.传统的光谱采集设备大多采用时序滤波或空间扫描机制记录光谱信息,需要很长的成像时间,因而不能用于光谱视频信息的采集.近年来,伴随着采样理论和电子元器件技术的迅速发展,光谱的视频(动态)采集成为了可能.本文着眼于近年来刚刚起步的光谱视频采集技术,从采集技术的背景和基本原理出发,对于近年来涌现的高分辨率光谱视频采集方法和系统进行介绍,并对于基于直接采集和计算重构的各类技术手段展开讨论,详细阐述这些方法的光学原理、采集理论以及实际系统构建中的问题.此外,本文对各种方法在光谱视频采集中的一些重要性能指标和系统实际运行优缺点进行对比.最后,本文也对光谱视频采集的相关应用与发展前景进行了讨论.

关键词: 光谱, 视频采集, 分辨率

Abstract:

Spectral capture technique collects information with more color channels than traditional trichromatic sensing.Therefore it provides more detailed properties of the light source and the scene.Possible applications span across lots of fields such as remote sensing,materials science,bio-photonics,environmental monitoring,computer vision and so on.Spectral capture technique needs to record massive data in spatial,temporal and spectral dimension,whereas traditional spectral capture systems suffer from temporal and spatial scanning which is not suitable for video capture.Nowadays,with rapid development in sampling theory and electronic techniques,spectral video acquisition is becoming feasible.This paper presents a review and comparisons on the capturing techniques of high resolution spectral video,especially on hyperspectral video capturing research.In the end,relative applications and future work of hyperspectral video capture are also discussed.

Key words: hyperspectral, video capture, resolution

中图分类号:

O433

马晨光, 曹汛, 季向阳, 等. 高分辨率光谱视频采集研究[J]. 电子学报, 2015, 43(4): 783-790.

MA Chen-guang, CAO Xun, JI Xiang-yang, et al. Research on High Resolution Hyperspectral Capture Technique[J]. Acta Electronica Sinica, 2015, 43(4): 783-790.

参考文献

[1] V Backman,M Wallace,L Perelman,J Arendt,M Müller,Q Zhang,G Zonios,E Kline,T Mcgillican.Detection of preinvasive cancer cells[J].Nature,2000,406(6791):35-36.
[2] W Debskia,P Walczykowskia,A Klewskia,M Zyznowskib.Analysis of usage of multispectral video technique for distinguishing objects in real time[A].20th ISPRS Congress[C].Istanbul:ISPRS,2004.201(323).
[3] S Delalieux,A Auwerkerken,W Verstraeten,B Somers,R Valcke,S Lhermitte,J Keulemans,P Coppin.Hyperspectral reflectance and fluorescence imaging to detect scab induced stress in apple leaves[J].Remote Sensing,2009,1(4):858-874.
[4] R Kester,N Bedard,L Gao,T Tkaczyk.Real-time snapshot hyperspectral imaging endoscope[J].J Biomed Opt,2011,16(5):056005.
[5] M Kim,T Harvey,D Kittle,H Rushmeier,D Brady.3D imaging spectroscopy for measuring hyperspectral patterns on solid objects[J].ACM Transactions on Graphics(TOG),2012,31(4):38.
[6] G Wong.Snapshot hyperspectral imaging and practical applications[J].Journal of Physics:Conference Series,IOP Publishing,2009,178:012048.
[7] J Murguia,G Diaz,T Reeves,R Nelson,J Mooney,F Shepherd,G Griffith,D Franco.Applications of multi spectral video[A].Proceedings of SPIE NanoScience Engineering[C].San Diego:SPIE,2010:77800.
[8] Z Pan,G Healey,M Prasad,B Tromberg.Face recognition in hyperspectral images[J].IEEE Trans PAMI,2003,25(12):1552-1560.
[9] J Kim,M Escuti.Snapshot imaging spectro polarimeter utilizing polarization gratings[A].Proceedings of SPIE Optical Engineering and Applications[C].SPIE,2008.7086:708603.
[10] M Yamaguchi,H Haneishi,H Fukuda,J Kishimoto,H Kanazawa,M Tsuchida,R Iwama,N Ohyama.High fidelity video and still-image communication based on spectral information:natural vision system and Its applications[A].Proceedings of SPIE Electronic Imaging[C].SPIE,2006.6062:129-140.
[11] T Akgun,Y Altunbasak,R Mersereau.Super-resolution reconstruction of hyperspectral images[J].IEEE Trans Image Processing,2005,14(11):1860-1875.
[12] G Brelstaff,A Párraga,T Trosianko,D Carr.Hyperspectral camera system:acquisition and analysis[A].Proceedings of SPIE Satellite Remote Sensing[C].SPIE,1995.150-159.
[13] P Burns,R Berns.Analysis of multispectral image capture[A].Proceedings of 4th IS&T/SID Color Imaging Conference[C].SPIE,1996.19.
[14] M Golub,M Nathan,A Averbuch,E Lavi,V Zheludev,A Schclar.Spectral multiplexing method for digital snapshot spectral imaging[J].Appl Opt,2009,48(8):1520.
[15] A Harvey,J Beale,A Greenaway,T Hanlon,J Williams.Technology options for imaging spectrometry[A].Proceedings of SPIE Imaging Spectrometry VI[C].SPIE,2000.4132.
[16] A Harvey,D Holmes.High-throughput snapshot spectral imaging in two dimensions[A].Proceedings of SPIE Conference Series[C].SPIE,2003.4959:46-54.
[17] A Harvey,D Holmes,A Gorman,K Altenbach,J Arlt,N Read.Spectral imaging in a snapshot[A].Proceedings of SPIE Biomedical Optics[C].SPIE,2005.5694:110-119.
[18] J Kerekes,J Baum.Hyperspectral imaging system modeling[J].Lincoln Laboratory Journal Special Issue on Spectral Imaging,2003,14(1):117-124.
[19] W Porter,H Enmark.A system overview of the airborne visible/infrared imaging spectrometer[A].Proceedings of SPIE Imaging Spectroscopy II[C].SPIE,1987.1:3-12.
[20] R Basedow,D Carmer,M Anderson.Hydice system:implementation and performance[A].Proceedings of SPIE 1995 Symposium on OE[C].SPIE,1995.2480:258.
[21] Y Schechner,S Nayar.Generalized mosaicing[A].IEEE Proceedings of ICCV[C].IEEE,2001.17-24.
[22] Y Schechner,S Nayar.Generalized mosaicing:wide field of view multispectral imaging[J].IEEE Trans PAMI,2002,24(10):1334-1348.
[23] N Gat.Imaging spectroscopy using tunable filters:a review[A].Proceedings of SPIE AeroSense 2000[C].SPIE,2000.4056:50-64.
[24] M Descour,E Derenak.Computed tomography imaging spectrometer:experimental calibration and reconstruction results[J].Appl Opt,1995,34(22):4817-4826.
[25] M Descour,C Volin,B Ford,E Dereniak,P Maker,D Wilson.Snapshot hyperspectral imaging[J].Journal of Integrated Computational Imaging Systems,2001.
[26] N Hagen,E Dereniak.Analysis of computed tomographic imaging spectrometers I:spatial and spectral resolution[J].Appl Opt,2008,47(28):F85-F95.
[27] N Hagen,E Dereniak,D Sass.Maximizing the resolution of a CTIS instrument[A].Proc SPIE Optics Photonics[C].SPIE,2006.6302:63020L.
[28] W Johnson,D Wilson,G Bearman.All-reflective snapshot hyperspectral imager for ultraviolet and infrared applications[J].Opt Lett,2005,30(12):1464-1466.
[29] W Johnson,D Wilson,G Bearman.Spatial and spectral modulating snapshot hyperspectral imager[J].Appl Opt,2006,45(9):1898-1908.
[30] T Chao,H Zhou,X Xia,S Serati.Near Ir electro-optic imaging fourier transform spectrometer[A].Proceedings of SPIE[C].SPIE,2005.5816:163.
[31] M Kudenov,E Dereniak.Compact snapshot real-time imaging spectrometer[A].Proceedings of SPIE Security Defence[C].SPIE,2011.8186:81860W.
[32] A Villemaire,S Fortin,J Giroux,T Smithson,R Oermann.Imaging fourier transform spectrometer[A].Proceedings of SPIE[C].SPIE,1995.2480:387.
[33] R Willett,M Gehm,D Brady.Multiscale reconstruction for computational spectral imaging[A].Proceedings of SPIE Electronic Imaging[C].SPIE,2007.64980.
[34] D Brady,M Gehm.Compressive imaging spectrometers using coded apertures[A].Proceedings of SPIE Defense and Security Symposium[C].SPIE,2006.6246:62460A.
[35] M Gehm,R John,D Brady,R Willett,T Schulz.Single-shot compressive spectral imaging with a dual disperser architecture[J].Opt Express,2007,15(21):14013-14027.
[36] A Wagadarikar,R John,R Willett,D Brady.Single disperser design for coded aperture snapshot spectral imaging[J].Appl Opt,2008,47(10):B44-B51.
[37] A Wagadarikar,M Gehm,D Brady.Performance comparison of aperture codes for multimodal,multiplex spectroscopy[J].Appl Opt,2007,46(22):4932-4942.
[38] A Wagadarikar,N Pitsianis,X Sun,D Brady.Spectral image estimation for coded aperture snapshot spectral imagers[A].Proceedings of SPIE Optical Engineering Applications[C].SPIE,2008.7076:707602.
[39] D Kittle,D Marks,D Brady.Design and fabrication of an ultravioletvisible coded-aperture snapshot spectral imager[J].Optical Engineering,2012,51(7):071403-1-071403-10.
[40] A Wagadarikar,N Pitsianis,X Sun,D Brady.Video rate spectral imaging using a coded aperture snapshot spectral imager[J].Opt Express,2009,17(8):6368-6388.
[41] A Bodkin,A Sheinis,A Norton,J Daly,S Beaven,J Weinheimer.Snapshot hyperspectral imaging:the hyperpixel array camera[A].Proceedings of SPIE[C].SPIE,2009.7334:73340H.
[42] L Gao,R Kester,N Hagen,T Tkaczyk.Snapshot image mapping spectrometer(IMS)with high sampling density for hyperspectral microscopy[J].Opt Express,2010,18(14):14330-14344.
[43] X Cao,H Du,X Tong,Q Dai,S Lin.A prism-mask system for multispectral video acquisition[J].IEEE Trans PAMI,2011,33(12):2423.
[44] R Habel,M Kudenov,M Wimmer.Practical spectral photography[A].Proceedings of Computer Graphics Forum[C].Blackwell Publishing Ltd,2012,31(2pt2):449-458.
[45] X Cao,X Tong,Q Dai,S Lin.High resolution multi spectral video capture with a hybrid camera system[A].IEEE Proceedings of CVPR[C].IEEE,2011.297-304.
[46] R Kawakami,Y Matsushita,J Wright,M Ben-Ezra,Y Tai,K Ikeuchi.High-resolution hyperspectral imaging via matrix factorization[A].IEEE Proceedings of CVPR[C].IEEE,2011.2329-2336.
[47] A Charles,B Olshausen,C Rozell.Learning sparse codes for hyperspectral imagery[J].IEEE Journal of Selected Topics in Signal Process,2011,(99):1.
[48] A Chakrabarti,T Zickler.Statistics of real world hyper spectral images[A].IEEE Proceedings of CVPR[C].IEEE,2011.193-200.
[49] Y Wu,G Arce.Snapshot spectral imaging via compressive random convolution[A].IEEE Proceedings of ICASSP[C].IEEE,2011.1465-1468.
[50] A Mrozack,D Marks,D Brady.Coded aperture spectroscopy with denoising through sparsity[J].Optics Express,2012,20(3):2297-2309.
[51] H Pal,M Neifeld.Multispectral principal component imaging[J].Opt Express,2003,11(18):2118-2125.
[52] M Neifeld,P Shankar.Feature-specific imaging[J].Appl Opt,2003,42(17):3379-3389.

高分辨率光谱视频采集研究

Research on High Resolution Hyperspectral Capture Technique

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	刘杰, 葛一凡, 田明. 文物图像的超分辨率重建算法研究[J]. 电子学报, 2023, 51(1): 139-145.
[2]	李滔, 董秀成, 林宏伟. 基于深监督跨尺度注意力网络的深度图像超分辨率重建[J]. 电子学报, 2023, 51(1): 128-138.
[3]	吴靖, 叶晓晶, 黄峰, 陈丽琼, 王志锋, 刘文犀. 基于深度学习的单帧图像超分辨率重建综述[J]. 电子学报, 2022, 50(9): 2265-2294.
[4]	范鑫燕, 罗海军, 李妍妍, 向洋, 罗霞, 覃睿, 郭盼. 基于蒙特卡罗法硬膜血肿厚度计算的数值仿真研究[J]. 电子学报, 2022, 50(8): 1985-1991.
[5]	李超, 黄新宇, 王凯. 基于特征融合和自学习锚框的高分辨率图像小目标检测算法[J]. 电子学报, 2022, 50(7): 1684-1695.
[6]	王相海, 赵晓阳, 王鑫莹, 赵克云, 宋传鸣. 非抽取小波边缘学习深度残差网络的单幅图像超分辨率重建[J]. 电子学报, 2022, 50(7): 1753-1765.
[7]	许皓文, 陆浩, 王振占. 高光谱微波辐射计系统中2GHz带宽数字谱仪设计[J]. 电子学报, 2022, 50(6): 1472-1479.
[8]	赵旭东, 陶然, 李伟, 张蒙蒙. 高光谱图像分数域信息提取理论与方法进展[J]. 电子学报, 2022, 50(12): 2874-2883.
[9]	廖希, 黄晨曦, 王洋, 车延庭. 室内毫米波3D-MIMO无线信道参数提取与多径簇特性研究[J]. 电子学报, 2022, 50(11): 2698-2706.
[10]	周登文, 李文斌, 李金新, 黄志勇. 一种轻量级的多尺度通道注意图像超分辨率重建网络[J]. 电子学报, 2022, 50(10): 2336-2346.
[11]	田典, 余宁梅, 周广霖, 李娜. 双线阵无透镜超分辨率扫描成像方法研究[J]. 电子学报, 2022, 50(10): 2503-2516.
[12]	王兵兵, 王晓东, 陈雨璐, 张传胜, 臧元章, 潘鸣, 曹俊诚. 硅基阻挡杂质带太赫兹探测器及其成像研究[J]. 电子学报, 2021, 49(9): 1867-1872.
[13]	郑海颖, 王峰, 姜维, 王志强, 姚西文. 神经网络训练策略对高分辨率遥感图像场景分类性能影响的评估[J]. 电子学报, 2021, 49(8): 1599-1614.
[14]	罗阳锦, 张升伟, 陆浩. 高光谱微波辐射计宽带高速数字系统设计[J]. 电子学报, 2021, 49(2): 380-386.
[15]	黄鸿, 徐科杰, 石光耀. 联合多尺度多特征的高分遥感图像场景分类[J]. 电子学报, 2020, 48(9): 1824-1833.