双线阵无透镜超分辨率扫描成像方法研究

田典; 余宁梅; 周广霖; 李娜

doi:10.12263/DZXB.20210946

PDF(4082 KB)

电子学报 ›› 2022, Vol. 50 ›› Issue (10) : 2503-2516. DOI: 10.12263/DZXB.20210946

学术论文

双线阵无透镜超分辨率扫描成像方法研究

作者信息 +

Research on Super-Resolution Scanning Imaging Method for Lensless with Dual-Line Array

Author information +

文章历史 +

本文亮点

针对无透镜成像系统分辨率低和单线阵扫描成像中由于细胞流速不准确造成的图像重构畸变问题，本文提出了一种基于双线阵图像传感器的超分辨率扫描成像方法.通过引入第二个线阵，利用双线阵的时间空间关系，实现了细胞流动速度的实时测量，为扫描图像的重构提供了精准参数.综合考虑了光源、衍射光路、细胞样品瞬态流速、图像传感器像素尺寸、倾斜角度和帧频等系统特性，建立了线阵扫描成像系统的成像模型，深入分析了影响双线阵成像质量的因素，建立了基于坐标变换、扫描图像插值计算的双线阵扫描成像系统的图像重构模型.综合两种模型，以条形图案为仿真对象，分析了该方法的成像特性，并从理论上验证了双线阵扫描成像系统的可行性和有效性.仿真结果表明，双线阵扫描成像系统的空间分辨率相比面阵系统至少提升了2.8倍，并且结构相似性和峰值信噪比均有5%~15%的提升.在此基础上，搭建了双线阵扫描成像系统，并以微球、红细胞和白细胞作为测试对象，对系统进行了实际测试.结果表明，双线阵扫描成像系统解决了单线阵扫描成像图像重构畸变的问题，同时相比面阵成像系统，20 μm微球的直径均值误差为2.04%，红细胞和白细胞的特征更多、更明显.

HeighLight

Aiming at the problems of the low resolution in lensless imaging systems and the reconstruction distortion in single-line array scanning imaging systems, a super-resolution scanning imaging method is proposed for lensless using a dual-line array image sensor. The cell’s velocity can be measured in real-time using the space-time displacement of the dual-line array, which provides accurate parameters for the reconstruction. Considering the system characteristics of optical wavelength, diffraction light path, cell sample flow rate, pixel size of the image sensor, tilt angle, and frame rate, the scanning imaging model of the scanning imaging system is established. The factors affecting the imaging quality of the dual-line array are analyzed, and the image reconstruction model of the dual-line array scanning imaging system is established by coordinate transformation and scanned image interpolation calculation. By synthesizing the two models and taking the strip pattern as the simulation object, the imaging characteristics are analyzed, and the feasibility and effectiveness of the dual-line array scanning imaging system are verified theoretically. The simulation results show that the spatial resolution of the scanning imaging system with a dual-line array is at least 2.8 times higher than that of the system with an area array, and the SSIM and PSNR are improved by 5%~15%. On this basis, a scanning imaging system for lensless with a dual-line array was built, and the microspheres, red blood cells, and white blood cells were used as test objects to test the system. The results show that the problems of the reconstruction distortion in single-line array scanning imaging systems can be solved with a dual-line array scanning imaging. The mean diameter error of 20 μm microsphere is 2.04% between the scanning imaging system with dual-line array and the area array imaging system, and the characteristics of red blood cells and white blood cells are more obvious under the scanning imaging system with the dual-line array.

导出引用

田典 , 余宁梅 , 周广霖 , 李娜. 双线阵无透镜超分辨率扫描成像方法研究[J]. 电子学报, 2022, 50(10): 2503-2516. https://doi.org/10.12263/DZXB.20210946

TIAN Dian , YU Ning-mei , ZHOU Guang-lin , LI Na. Research on Super-Resolution Scanning Imaging Method for Lensless with Dual-Line Array[J]. Acta Electronica Sinica, 2022, 50(10): 2503-2516. https://doi.org/10.12263/DZXB.20210946

中图分类号： TN911.7

参考文献

原文顺序 | 文献年度倒序 | 文中引用次数倒序

1	HENGX, ERICKSOND, BAUGHL R, et al. Optofluidic microscopy-A method for implementing a high resolution optical microscope on a chip[J]. Lab Chip, 2006, 6(10): 1274-1276. 本文引用 [1]

2	张佳琳, 陈钱, 张翔宇, 等. 无透镜片上显微成像技术: 理论、发展与应用[J]. 红外与激光工程, 2019, 48(6): 121-153. ZHANGJ L, CHENQ, ZHANGX Y, et al. Lens-free on-chip microscopy: Theory, advances, and applications[J]. Infrared and Laser Engineering, 2019, 48(6): 121-153. (in Chinese) 本文引用 [1]

3	MUDANYALIO, TSENGD, OH C, et al. Compact, light-weight and cost-effective microscope based on lensless incoherent holography for telemedicine applications[J]. Lab on a Chip, 2010, 10(11): 1417-1428. 本文引用 [2]

4	LEES A, LEITAOR, ZHENGG, et al. Color capable sub-pixel resolving optofluidic microscope and its application to blood cell imaging for malaria diagnosis[J]. PLoS One, 2011, 6(10): e26127. 本文引用 [2]

5	ROYM, JING, PANJ, et al. Staining-free cell viability measurement technique using lens-free shadow imaging platform[J]. Sensors and Actuators, B: Chemical, 2016, 224: 577-583.

6	ROYM, JING, SEOD, et al. A simple and low-cost device performing blood cell counting based on lens-free shadow imaging technique[J]. Sensors and Actuators, B: Chemical, 2014, 201: 321-328.

7	HUANGX, LIY, XUX, et al. High-Precision Lensless Microscope on a Chip Based on In-Line Holographic Imaging[J]. SENSORS, 2021, 21(3): 720.

8	LIJ, DAIL, YUN, et al. Elliptocyte detection technology based on super-resolution algorithms for a lensless imaging system[J]. Measurement Science and Technology, 2021, 32(2): 025701.

9	LIJ, DAIL, YUN, et al. Red blood cell recognition and posture estimation in microfluidic chip based on lensless imaging[J]. Biomicrofluidics, 2021, 15(3): 34109.

10	LIS, DAIL, LIJ, et al. A Deep learning Feature Fusion Algorithm based on Lensless Cell detection system[C]// Proceedings of the IEEE 15th International Conference on Solid-State & Integrated Circuit Technology. Kunming: IEEE, 2020: 1-3. 本文引用 [1]

11	LIAOY, YUN, TIAND, et al. An intelligent low-power low-cost mobile lab-on-chip yeast cell culture platform[J]. IEEE Access, 2020, 8: 70733-70745. 本文引用 [1]

12	LIAOY, YUN, TIAND, et al. Toward embedded sensing automation and miniaturization for portable smart cost-effective algae monitor[J]. IEEE Sensors Journal, 2021, 21(4): 5230-5239. 本文引用 [1]

13	MUDANYALIO, BISHARAW, OZCANA. Lensfree super-resolution holographic microscopy using wetting films on a chip[J]. Optics Express, 2011, 19(18): 17378-17389. 本文引用 [1]

14	ZHANGJ, CHENQ, LIJ, et al. Lensfree dynamic super-resolved phase imaging based on active micro-scanning[J]. Optics Letters, 2018, 43(15): 3714. 本文引用 [2]

15	TIAND, YUN, LIZ, et al. A super-resolution scanning algorithm for lensless microfluidic imaging using the dual-line array image sensor[J]. PLoS One, 2020, 15(6): e235111. 本文引用 [4]

16	张华, 曹良才, 金国藩, 等. 基于压缩感知算法的无透镜数字全息成像研究[J]. 激光与光电子学进展, 2020, 57(8): 9-19. ZHANGH, CAOL C, JING F, et al. Progress on lensless digital holography imaging based on compressive holographic algorithm[J]. Laser & Optoelectronics Progress, 2020, 57(8): 9-19. (in Chinese) 本文引用 [2]

17	ZUOC, CHENQ, GUG, et al. Laplacian reconstruction of one single hologram using two different reconstruction distances or wavelengths[J]. Chinese Optics Letters, 2012, 10(6): 50-53. 本文引用 [1]

18	GUOC, ZHANGF, GENGY, et al. High-quality multi-wavelength lensfree microscopy based on nonlinear optimization[J]. Optics and Lasers in Engineering, 2021, 137(2): 10640. 本文引用 [2]

19	COSKUNA F, SENCANI, SUT, et al. Wide-field lensless fluorescent microscopy using a tapered fiber-optic faceplate on a chip[J]. The Analyst, 2011, 136(17): 3512. 本文引用 [1]

王相海, 赵晓阳, 毕晓昀, 等. 小波域多角度轮廓模板变分模型的单幅图像超分辨率重建[J]. 电子学报, 2018, 46(9): 2256-2262.

WANG

X H

, ZHAO

X Y

, BI

X Y

, et al. Single image super-resolution reconstruction approach based on multi-angle contour templates variational calculus model in wavelet domain[J]. Acta Electronica Sinica, 2018, 46(9): 2256-2262. (in Chinese)

本文引用 [1]

21	张成, 程鸿, 张芬, 等. 单次曝光频域振幅编码压缩成像[J]. 电子学报, 2014, 42(7): 1262-1267. ZHANGC, CHENGH, ZHANGF, et al. Single-exposure frequency-domain amplitude encoding compressive imaging[J]. Acta Electronica Sinica, 2014, 42(7): 1262-1267. (in Chinese) 本文引用 [1]

22	李展, 陈清亮, 彭青玉, 等. 基于MAP的单帧字符图像超分辨率重建[J]. 电子学报. 2015, 43(1): 191-197. LIZ, CHENQ L, PENGQ Y, et al. MAP-based single-frame super-resolution reconstruction for character image[J]. Acta Electronica Sinica, 2015, 43(1): 191-197. (in Chinese) 本文引用 [1]

23	任福全, 邱天爽, 韩军, 等. 基于二阶广义全变差的多帧图像超分辨率重建[J]. 电子学报, 2015, 43(7): 1275-1280. RENF Q, QIUT S, HANJ, et al. Multiframe image super resolution based on second order total generalized variation[J]. Acta Electronica Sinica, 2015, 43(7): 1275-1280. (in Chinese) 本文引用 [1]

24	唐艳秋, 潘泓, 朱亚平, 等. 图像超分辨率重建研究综述[J]. 电子学报. 2020, 48(7): 1407-1420. TANGY Q, PANH, ZHUY P, et al. A survey of image super-resolution reconstruction[J]. Acta Electronica Sinica, 2020, 48(7): 1407-1420. (in Chinese) 本文引用 [1]

25	ZUOC, SUNJ, ZHANGJ, et al. Lensless phase microscopy and diffraction tomography with multi-angle and multi-wavelength illuminations using a LED matrix[J]. Optics Express, 2015, 23(11): 14314. 本文引用 [2]

26	FANGY, YUN, JIANGY. Super-Resolution Lensless Imaging of Cells Using Brownian Motion[J]. APPLIED SCIENCES-BASEL, 2019, 9(10): 2080. 本文引用 [1]

27	DaiL, LiJ, YuN. Cell image reconstruction for a lens-free imaging system based on linear array sensor[C]//Proceedings of the IEEE International Conference on Electron Devices and Solid-State Circuits, Xi'an: IEEE, 2019: 1-3. 本文引用 [1]

28	王伍娟. 基于片上细胞检测系统的细胞图像超分辨率技术的研究[D]. 西安: 西安理工大学, 2018. WANGW J. Research on Cell Image Super-Resolution Technology Based on On-Chip Cell Detection System[D]. Xi'an: Xi'an University of Technology, 2018. 本文引用 [1]

29	方元. 无透镜显微成像及细胞检测关键技术研究[D]. 西安: 西安理工大学, 2019. FANGY. Research on The Key Techniques of Lens-Less Microscopic Imaging and Cell Detection[D]. Xi'an: Xi'an University of Technology, 2019. 本文引用 [1]

30	王广俊, 王大勇, 王华英. 数字全息显微中常见重建算法比较[J]. 激光与光电子学进展, 2010, 47(3): 83-88. WANGG J, WANGD Y, WANGH Y. Comparison of commonly used numerical reconstruction algorithms in digital holographic microscopy[J]. Laser & Optoelectronics Progress, 2010, 47(3): 83-88. (in Chinese) 本文引用 [2]

31	KUMARS, MAHADEVAPPAM, DUTTAP K. Lensless in-line holographic microscopy with light source of low spatio-temporal coherence[J]. IEEE Journal of Selected Topics in Quantum Electronics, 2021, 27(4): 1-8. 本文引用 [1]

32	CHENL, CHENX, CUIH, et al. Image enhancement in lensless inline holographic microscope by inter-modality learning with denoising convolutional neural network[J]. Optics Communications, 2021, 484 (2): 126682. 本文引用 [1]

33	WUJ, CAOL, BARBASTATHISG. DNN-FZA camera: A deep learning approach toward broadband FZA lensless imaging[J]. Optics Letters, 2021, 46(1): 130-133.

34	ZHOUH, FENGH, HUZ, et al. Lensless cameras using a mask based on almost perfect sequence through deep learning[J]. Optics Express, 2020, 28(20): 30248-30262. 本文引用 [1]

35	戎路, 王大勇, 王云新,等. 同轴数字全息中的相位恢复算法[J]. 中国激光, 2014, 41(2): 63-72. RONGL, WANGD Y, WANGY X, et al. Phase retrieval methods in in-line digital holography[J]. Chinese Journal of Lasers, 2014, 41(2): 63-72. (in Chinese) 本文引用 [1]

36	ROSTENE, DRUMMONDT. Machine learning for high-speed corner detection[C]//Proceedings of the 9th European Conference on Computer Vision. Graz: Springer, 2006: 430-443. 本文引用 [1]

37	FANGY, YUN, JIANGY, et al. High-precision lens-less flow cytometer on a chip[J]. Micromachines, 2018, 9(5): 227. 本文引用 [1]

38	ZHANGJ, SUNJ, CHENQ, et al. Adaptive pixel-super-resolved lensfree in-line digital holography for wide-field on-chip microscopy[J]. Scientific Reports, 2017, 7(1): 11715-11777. 本文引用 [1]