基于小波变换与稀疏傅里叶变换相结合的光场重构方法

doi:10.3969/j.issn.0372-2112.2017.04.003

电子学报 ›› 2017, Vol. 45 ›› Issue (4): 782-790.DOI: 10.3969/j.issn.0372-2112.2017.04.003

基于小波变换与稀疏傅里叶变换相结合的光场重构方法

周广福¹, 文成林¹, 高敬礼²

1. 杭州电子科技大学自动化学院, 浙江杭州 310018;
2. 浙江大学电气工程学院, 浙江杭州 310027

收稿日期:2015-09-25 修回日期:2016-01-25 出版日期:2017-04-25
- 通讯作者:
- 文成林
- 作者简介:
- 周广福 男,1990年出生于山东菏泽,硕士.主要从事数字图像处理、光场图像重构方面的研究.E-mail:guangfu_0212@126.com;高敬礼 男,1980年出生于河南邓州,博士生.主要从事信息融合、目标检测与跟踪等方面的研究.Email:gjl991@163.com
- 基金资助:
- 国家自然科学基金重点项目 (No.61333011）; 国家自然科学基金 (No.61371064，No.61273075，No.61503206）

Light Field Reconstruction Based on Wavelet Transform and Sparse Fourier Transform

ZHOU Guang-fu¹, WEN Cheng-lin¹, GAO Jing-li²

1. School of Automation, Hangzhou Dianzi University, Hangzhou, Zhejiang 310018, China;
2. College of Electrical Engineering, Zhejiang University, Hangzhou, Zhejiang 310027, China

Received:2015-09-25 Revised:2016-01-25 Online:2017-04-25 Published:2017-04-25
- Supported by:
- Key Program of National Natural Science Foundation of China (No.61333011); National Natural Science Foundation of China (No.61371064, No.61273075, No.61503206)

摘要/Abstract

摘要：

随着计算机图形学和计算机视觉技术的发展，光场开始进入人们的视线并被迅速应用于各个领域.然而光场的获取需要大量的图像，具有数据量大，获取成本高等特点，因此学者们越来越关注如何利用少量的光场数据获取整个光场这一问题，并且做出了大量的工作.针对上述问题，本文将小波变换与稀疏傅里叶变换相结合，利用光场在角度域的稀疏性提出一种新的光场重构方法.首先，利用小波变换多分辨率分析的特点，通过小波变换将原始图像分解为多个不同频率的子图像；然后分别对每个子图像通过傅里叶切片定理恢复其频率位置，从而可以分别得到它们的二维角度谱；最后将每个子图像的二维角度谱合并，进行小波逆变换获得整个光场.本文方法利用小波变换将原图像分解为多个不同频率的子图像分别同时处理，不仅降低了算法的复杂度，大大减少了算法的运行时间，为光场的广泛应用提供了条件，而且相比于单独运用稀疏傅里叶算法重构，本方法有效地抑制了窗口效应，使重构结果更加准确.此外，本文方法将高频信息和低频信息分开重构，可以有效地改善并网恢复中小频率丢失的问题，进一步改进重构结果.最后通过仿真验证了算法的有效性.

关键词: 小波变换, 光场重构, 稀疏性, 傅里叶变换, 窗口效应

Abstract:

With the development of computer graphics and computer vision technology,light field comes into sight and is rapidly applied in various fields.However,the acquisition of the light field needs a large amount of pictures,which has the characteristics of large data and high cost.So how to use a small amount of data to obtain the light field has been paid more and more attention,and a lot of work has been done.To address the above problems,a new method of light field reconstructing is proposed,which combines with wavelet transform and sparse Fourier transform by using sparseness of light field in angle domain.First,we use multi-resolution analysis characteristic of wavelet transform,and the original image can be decomposed into four sub-frequency images through wavelet transform.Then the frequency positions of four sub-frequencies are separately recovered through the Fourier slice theorem,and their two-dimensional angle spectrum are further obtained,respectively.Finally,the light field is obtained by combining the two-dimensional angle spectrum of each sub-frequency image and making inverse wavelet transform.In the proposed method,the original image is decomposed into four sub-images by using wavelet transform,and the sub-images are reconstructed respectively.This not only reduces the complexity of our method and greatly reduces the running time of our method,which provides the basis for the wide application of the light field,but also our method effectively inhibits the window effect by comparing to only using sparse Fourier algorithm,so that the reconstruction result is more accurate.In addition,the method can effectively improve problem of small frequency leakage in off-grid recovery by separating high frequency and low frequency information,and further improves the reconstruction results.In the end,the effectiveness of the algorithm is verified by simulation.

Key words: wavelet transform, light field reconstruction, sparse, Fourier transform, window effect

中图分类号:

TP751

周广福, 文成林, 高敬礼. 基于小波变换与稀疏傅里叶变换相结合的光场重构方法[J]. 电子学报, 2017, 45(4): 782-790.

ZHOU Guang-fu, WEN Cheng-lin, GAO Jing-li . Light Field Reconstruction Based on Wavelet Transform and Sparse Fourier Transform[J]. Acta Electronica Sinica, 2017, 45(4): 782-790.

参考文献

[1] 尹晓艮,张晓芳,张伟超,等.基于光场数字重聚焦的三维重建方法研究[J].光电子·激光,2015(5):986-991. YIN Xiao-gen,ZHANG Xiao-fang,ZHANG Wei-chao,et al.Study on 3D reconstruction based on light field digital refocusing[J].Journal of Optoelectronics·Laser,2015(5):986-991.(in Chinese)
[2] Zhou G F,Wen C L,Gao J L.Object recognition based on reconstruction of light field[A].International Conference on Estimation,Detection and Information Fusion (ICEDIF)[C].USA:IEEE,2015.82-87.
[3] Levoy M,Hanrahan P.Light field rendering[J].Proceedings of SIGGRAP'96,1996(23):31-42.
[4] Takahashi K,Naemura T.Layered light-field rendering with focus measurement[J].Signal Processing:Image Communication,2006,21(6):519-530.
[5] Stewart J,Yu J,Gortler S J,Mcmillan L.A new reconstruction filter for undersampled light fields[A].ACM International Conference Proceeding Series[C].USA:ACM,2003.44:150-156.
[6] Petrovic G,Shahulhameed A K,Zinger S,de With,P H N.Region-based all-in-focus light field rendering[A].The 16th IEEE International Conference on Image Processing (ICIP)[C].USA:IEEE,2009.549-552.
[7] 韩曦,曾丹,秦文,张之江.运动物体的时空光场渲染[J].电子测量技术,2009,32(9):63-66,73. Han Xi,Zeng Dan,Qin Wen,Zhang Zhi-jiang.Dynamic light field rendering of moving objects[J].Electronic Measurement Technology,2009,32(9):63-66,73.(in Chinese)
[8] Willett R M,Marcia R F,Nichols J M.Compressed sensing for practical optical imaging systems:a tutorial[J].Optical Engineering,2011,50(7):072601-1-072601-13.
[9] Shi L X,Hassanieh H,Davis A,Katabi D,Durand F.Light field reconstruction using sparsity in the continuous fourier domain[J].ACM Trans,2014,34(1):12.
[10] Shi L X.Imaging Applications of the Sparse FFT[D].Massachusetts Institute of Technology,2013.
[11] 赵兴荣.基于光场相机深度信息获取技术的研究[D].中北大学,2014.
[12] Kak A C,Slaney M.Principles of Computerized Tomographic Imaging[M].Philadelphia:Society for Industrial Mathematics,2001.
[13] Chamgoulov R O,Lane P M.Optical computed-tomography microscope using digital spatial light modulation[A].Three-Dimensional and Multidimensional Microscopy[C].Washington D C:SPIE,2004.5324:182-192.
[14] 谢文章,邱睿,李君利,康玺.X射线源针孔成像系统优化设计研究[J].原子能科学技术,2013,47(12):2349-2354. XIE Wen-zhang,QIU Rui,LI Jun-li,et al.Study on optimization design of x-ray source pinhole imaging system[J].Atomic Energy Science and Technology,2013,47(12):2349-2354.(in Chinese)
[15] 何劲,张群,罗迎,杨小优.逆合成孔径成像激光雷达微多普勒效应分析及特征提取[J].电子学报,2011,39(9):2052-2059. HE Jin,ZHANG Qun,LUO Ying,YANG Xiao-you.Analysis of micro-doppler effect and feature extraction of target in inverse synthetic aperture imaging ladar[J].Acta Electronica Sinica,2011,39(9):2052-2059.(in Chinese)
[16] 龚超,张邦宁,郭道省.基于FFT的快速高精度载波参数联合估计算法[J].电子学报,2010,38(4):766-770. GONG Chao,ZHANG Bang-ning,GUO Dao-xing.A quick and accurate union carrier parameter estimation algorithm based on FFT[J].Acta Electronica Sinica,2010,38(4):766-770.(in Chinese)
[17] 陶然,刘升恒,张果,单涛.一种利用稀疏傅里叶变换计算外辐射源雷达互模糊函数的方法[P].中国,CN201310240140.1.2013-10-9.
[18] 周亚训,叶庆卫,徐铁峰.一种基于小波多分辩率数据组合的文字水印方案[J].电子学报,2000,28(6):122-124. ZHOU Ya-xun,YE Qin-wei,XU Ti-feng.A text watermark scheme based on wavelet multiresolution data combination[J].Acta Electronica Sinica,2000,28(6):122-124.(in Chinese)
[19] 刘佳敏,周荫清.一种基于小波变换的雷达图像边缘提取方法[J].电子学报,2003,31(12):1780-1783. LIU Jia-min,ZHOU Yin-qing.A SAR image edge extraction method based on the wavelet transform[J].Acta Electronica Sinica,2003,31(12):1780-1783.(in Chinese)
[20] Gonzalez R C,Woods R E.Digital Image Processing (Third Edition)[M].Publishing House of Electronics Industry,2011.
[21] Pohit M,Sharma J.Image registration under translation and rotation in two-dimensional planes using Fourier slice theorem[J].Applied Optics,2015,54(14):4514-4519.
[22] 万洪林,彭玉华,曲怀敬.全变差数字滤波器与Ridgelet变换相结合的图像去噪方法[J].电子学报,2008,36(1):90-94. WAN Hong-lin,PENG Yu-hua,QU Huai-jing.Image denoising method with combination of digital TV filter and ridgelet transform[J].Acta Electronica Sinica,2008,36(1):90-94.(in Chinese)
[23] Stanford.The (New) Stanford Light Field Archive[EB/OL].http://lightfield.stanford.edu/lfs.html.2015-9-25.

基于小波变换与稀疏傅里叶变换相结合的光场重构方法

Light Field Reconstruction Based on Wavelet Transform and Sparse Fourier Transform

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	吕杭, 蒋明峰, 李杨, 张鞠成, 王志康. 基于混合时频域特征的卷积神经网络心律失常分类方法的研究[J]. 电子学报, 2023, 51(3): 701-711.
[2]	王相海, 赵晓阳, 王鑫莹, 赵克云, 宋传鸣. 非抽取小波边缘学习深度残差网络的单幅图像超分辨率重建[J]. 电子学报, 2022, 50(7): 1753-1765.
[3]	李明爱, 张圆圆. 基于连续小波变换和符号传递熵的脑功能网络构建方法[J]. 电子学报, 2022, 50(7): 1600-1608.
[4]	刘胜, 王帮民, 张兰勇. 多通道盲电磁辐射现场分离方法研究[J]. 电子学报, 2022, 50(3): 557-566.
[5]	张亮, 于洪波, 张翔宇, 王国宏, 景洲. 吕分布时间尺度分析及实现方法研究[J]. 电子学报, 2022, 50(11): 2790-2798.
[6]	林金朝, 李必禄, 李国权, 黄正文, 庞宇. 基于EWT和结构特征提取的心电信号R波识别算法[J]. 电子学报, 2021, 49(6): 1217-1223.
[7]	甘建旺, 沙芸, 张国英. 基于图像中值灰度相似度函数加权曲率滤波算法[J]. 电子学报, 2021, 49(6): 1187-1194.
[8]	张亮, 王国宏, 张翔宇, 李思文, 辛婷婷. LFM雷达对抗移频干扰方法研究[J]. 电子学报, 2021, 49(3): 510-517.
[9]	高琛, 张帆, 高彦钊. 利用数据稀疏性的LSTM加速器设计[J]. 电子学报, 2021, 49(2): 209-215.
[10]	刘芳, 韩笑. 基于小波变换和深度网络的着陆地貌图像分类[J]. 电子学报, 2021, 49(11): 2171-2176.
[11]	范诚, 宋占杰, 汪火根, 蔡志森, 江朝川, 张硕. 基于随机场的全息采样及三维显示[J]. 电子学报, 2020, 48(9): 1755-1761.
[12]	罗阳锦, 张升伟. 基于FPGA的多通道高速数字谱仪的关键算法的设计与实现[J]. 电子学报, 2020, 48(5): 922-929.
[13]	刘秋红, 李天昀, 王彬, 许漫坤, 邱钊洋. 基于离散小波分解和频率脊线分析的CPM信号符号速率盲估计[J]. 电子学报, 2020, 48(3): 470-477.
[14]	陈兵兵, 曹欣远, 陈明生, 齐琦, 况晓静, 吴先良, 陈辉. 基于欠定方程的频谱峰值搜索算法及其在连续毫米波雷达系统中的应用[J]. 电子学报, 2020, 48(2): 369-374.
[15]	廖祝华, 张健, 刘毅志, 肖浩, 赵肄江, 刘建勋. 基于稀疏轨迹数据的出租车载客区域推荐[J]. 电子学报, 2020, 48(11): 2178-2185.