基于局部投影的视差图像拼接平滑优化

刘杰; 游品鸿; 田明; 刘金凤

doi:10.12263/DZXB.20200664

您当前的位置：

首页 >

文章列表页 >

基于局部投影的视差图像拼接平滑优化

学术论文 | 更新时间：2025-12-08

- 基于局部投影的视差图像拼接平滑优化
- Smooth Optimization of Parallax Images Mosaic Based on Local Projection
- 电子学报 2022年50卷第6期页码：1451-1456
- 作者机构：
  
  1.哈尔滨理工大学测控技术与通信工程学院，黑龙江哈尔滨 150080
  2.中国电信黑龙江省分公司，黑龙江哈尔滨 150080
- 作者简介：
  
  [ "刘杰女，1980年出生，黑龙江齐齐哈尔人.副教授.2005年于哈尔滨工业大学获得硕士学位，2013年于哈尔滨理工大学获得博士学位.主要研究方向为光纤光栅传感及解调技术、数字图像处理及计算机视觉技术.E-mail: liujie@hrbust.edu.cn" ]
  [ "游品鸿男，1995年出生，福建福州人.哈尔滨理工大学测控技术与通信工程学院硕士研究生.主要研究方向为计算机视觉以及图像处理.E-mail: 1091453221@qq.com" ]
- 基金信息：
  
  国家自然科学基金(51607049);黑龙江省自然科学基金(LH2019E067)
- DOI：10.12263/DZXB.20200664
  中图分类号： TP311;
- 收稿：2020-07-08，
  
  修回：2021-01-04，
  
  纸质出版：2022-06-25
- 稿件说明：
移动端阅览
刘杰,游品鸿,田明等.基于局部投影的视差图像拼接平滑优化[J].电子学报,2022,50(06):1451-1456.

LIU Jie,YOU Pin-hong,TIAN Ming,et al.Smooth Optimization of Parallax Images Mosaic Based on Local Projection[J].ACTA ELECTRONICA SINICA,2022,50(06):1451-1456.
刘杰,游品鸿,田明等.基于局部投影的视差图像拼接平滑优化[J].电子学报,2022,50(06):1451-1456. DOI： 10.12263/DZXB.20200664.

LIU Jie,YOU Pin-hong,TIAN Ming,et al.Smooth Optimization of Parallax Images Mosaic Based on Local Projection[J].ACTA ELECTRONICA SINICA,2022,50(06):1451-1456. DOI： 10.12263/DZXB.20200664.

摘要

针对视差图像拼接之后存在对齐不准和扭曲的问题，提出一种基于局部投影的视差图像拼接的平滑优化方法.将输入图像进行特征点检测，通过局部保留结构进行图像匹配并计算投影矩阵，利用重合边界投影模型与投影矩阵进行归一化距离判定，距离小于阈值则保留，大于阈值则舍弃并继续矩阵计算.在图像非重合部分，利用图像的变形函数得到最小弯曲能量函数，使非重合区域向全局变换上过渡.实验结果表明：所提算法提高了图像匹配精度，对图像的扭曲具有优化作用，增强了图像的整体性并获得了更好的视觉体验.

Abstract

Aiming at the problems of misalignment and distortion after parallax image stitching

a smooth optimization method for parallax image stitching based on local projection is proposed. The input image is performed feature point detection

matched by locality preserving structure

and calculated the projection matrix. The normalized distance is determined by the projection model of the coincident area and the projection matrix. If it is less than the threshold

it will be retained

otherwise it will be discarded and continue matrix calculation. In the non-coincident part of the image

the minimum bending energy function is obtained by calculating the deformation function of the image

so that the non-coincident region transits to the global transformation. The experimental results show that the proposed algorithm can not only improve the matching accuracy of the image

but also optimize the distortion of the image

enhance the integrity of the image and obtain a better visual experience.

关键词

Keywords

references

CHEN J , WAN Q , LUO L B , et al . Drone image stitching based on compactly supported radial basis function [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing , 2019 , 12 ( 11 ): 4634 - 4643 .

韩敏 , 闫阔 , 秦国帅 . 基于改进KAZE的无人机航拍图像拼接算法 [J]. 自动化学报 , 2019 , 45 ( 2 ): 305 - 314 .

HAN M , YAN K , QIN G S . A mosaic algorithm for UAV aerial image with improved KAZE [J]. Acta Automatica Sinica , 2019 , 45 ( 2 ): 305 - 314 . (in Chinese)

TAPETE D , CIGNA F . Detection of archaeological looting from space: Methods, achievements and challenges [J]. Remote Sensing , 2019 , 11 ( 20 ): 2389 .

ALMADHOUN R , ABDULDAYEM A , TAHA T , et al . Guided next best view for 3D reconstruction of large complex structures [J]. Remote Sensing , 2019 , 11 ( 20 ): 2440 .

丁颖 , 刘延伟 , 刘金霞 , 等 . 虚拟现实全景图像显著性检测研究进展综述 [J]. 电子学报 , 2019 , 47 ( 7 ): 1575 - 1583 .

DING Y , LIU Y W , LIU J X , et al . An overview of research progress on saliency detection of panoramic VR images [J]. Acta Electronica Sinica , 2019 , 47 ( 7 ): 1575 - 1583 . (in Chinese)

LOWE D G . Distinctive image features from scale-invariant keypoints [J]. International Journal of Computer Vision , 2004 , 60 ( 2 ): 91 - 110 .

BROWN M , LOWE D G . Automatic panoramic image stitching using invariant features [J]. International Journal of Computer Vision , 2007 , 74 ( 1 ): 59 - 73 .

徐弘祯 , 李世超 , 季宇寒 , 等 . 基于特征点匹配的全景相机图像拼接方法研究 [J]. 农业机械学报 , 2019 , 50 ( S1 ): 150 - 158 .

XU H Z , LI S C , JI Y H , et al . Panoramic camera image mosaic method based on feature points [J]. Transactions of the Chinese Society for Agricultural Machinery , 2019 , 50 ( S1 ): 150 - 158 . (in Chinese)

ZARAGOZA J , CHIN T J , BROWN M S , et al . As-projective-as-possible image stitching with moving DLT [C]// 2013 IEEE Conference on Computer Vision and Pattern Recognition . Portland : IEEE , 2013 : 2339 - 2346 .

赵春晖 , 樊斌 , 胡劲文 , 等 . 基于网格的统计优化特征匹配算法 [J]. 西北工业大学学报 , 2019 , 37 ( 2 ): 249 - 257 .

ZHAO C H , FAN B , HU J W , et al . Matching algorithm of statistical optimization feature based on grid method [J]. Journal of Northwestern Polytechnical University , 2019 , 37 ( 2 ): 249 - 257 . (in Chinese)

MA J Y , JIANG J J , ZHOU H B , et al . Guided locality preserving feature matching for remote sensing image registration [J]. IEEE Transactions on Geoscience and Remote Sensing , 2018 , 56 ( 8 ): 4435 - 4447 .

WU Z M . Compactly supported positive definite radial functions [J]. Advances in Computational Mathematics , 1995 , 4 ( 1 ): 283 - 292 .

FORNEFETT M , ROHR K , STIEHL H S . Radial basis functions with compact support for elastic registration of medical images [J]. Image and Vision Computing , 2001 , 19 ( 1/2 ): 87 - 96 .

唐逸之 , 罗闪 , 冉清 , 等 . 基于多薄板样条的多视角非刚性配准算法 [J]. 计算机辅助设计与图形学学报 , 2017 , 29 ( 12 ): 2153 - 2161 .

TANG Y Z , LUO S , RAN Q , et al . Multi-view non-rigid registration based on multiple thin-plate splines [J]. Journal of Computer-Aided Design & Computer Graphics , 2017 , 29 ( 12 ): 2153 - 2161 . (in Chinese)

ZHANG Z R , YANG X , LI Y R , et al . Sparse constrained transformation model based on radial basis function expansion: Application to cardiac and brain image registration [J]. IEEE Access , 2018 , 6 : 42631 - 42646 .

SPRENGEL R , ROHR K , STIEHL H S . Thin-plate spline approximation for image registration [C]// Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society . Amsterdam : IEEE , 1996 : 1190 - 1191 .

LIN C C , PANKANTI S U , RAMAMURTHY K N , et al . Adaptive as-natural-as-possible image stitching [C]// 2015 IEEE Conference on Computer Vision and Pattern Recognition . Boston : IEEE , 2015 : 1155 - 1163 .

WANG Z , BOVIK A C , SHEIKH H R , et al . Image quality assessment: From error visibility to structural similarity [J]. IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 - 612 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

可学习阈值优化的大规模动态多用户接入检测

利用相邻帧和背景信息的运动对象检测

一种软件自动测试成本的估算控制模型

一种基于角度的正交FRIT变换及其在图像去噪中的应用