Smooth Optimization of Parallax Images Mosaic Based on Local Projection

LIU Jie; YOU Pin-hong; TIAN Ming; LIU Jin-feng

doi:10.12263/DZXB.20200664

您当前的位置：

首页 >

文章列表页 >

Smooth Optimization of Parallax Images Mosaic Based on Local Projection

PAPERS | 更新时间：2025-12-08

- Smooth Optimization of Parallax Images Mosaic Based on Local Projection
- ACTA ELECTRONICA SINICA Vol. 50, Issue 6, Pages: 1451-1456(2022)
- 作者机构：
  
  1.哈尔滨理工大学测控技术与通信工程学院，黑龙江哈尔滨 150080
  2.中国电信黑龙江省分公司，黑龙江哈尔滨 150080
- 作者简介：
- 基金信息：
- DOI：10.12263/DZXB.20200664
  CLC： TP311;
- Received：08 July 2020，
  
  Revised：2021-01-04，
  
  Published：25 June 2022
- 稿件说明：
移动端阅览
刘杰,游品鸿,田明等.基于局部投影的视差图像拼接平滑优化[J].电子学报,2022,50(06):1451-1456.

LIU Jie,YOU Pin-hong,TIAN Ming,et al.Smooth Optimization of Parallax Images Mosaic Based on Local Projection[J].ACTA ELECTRONICA SINICA,2022,50(06):1451-1456.
刘杰,游品鸿,田明等.基于局部投影的视差图像拼接平滑优化[J].电子学报,2022,50(06):1451-1456. DOI： 10.12263/DZXB.20200664.

LIU Jie,YOU Pin-hong,TIAN Ming,et al.Smooth Optimization of Parallax Images Mosaic Based on Local Projection[J].ACTA ELECTRONICA SINICA,2022,50(06):1451-1456. DOI： 10.12263/DZXB.20200664.

摘要

针对视差图像拼接之后存在对齐不准和扭曲的问题，提出一种基于局部投影的视差图像拼接的平滑优化方法.将输入图像进行特征点检测，通过局部保留结构进行图像匹配并计算投影矩阵，利用重合边界投影模型与投影矩阵进行归一化距离判定，距离小于阈值则保留，大于阈值则舍弃并继续矩阵计算.在图像非重合部分，利用图像的变形函数得到最小弯曲能量函数，使非重合区域向全局变换上过渡.实验结果表明：所提算法提高了图像匹配精度，对图像的扭曲具有优化作用，增强了图像的整体性并获得了更好的视觉体验.

Abstract

Aiming at the problems of misalignment and distortion after parallax image stitching

a smooth optimization method for parallax image stitching based on local projection is proposed. The input image is performed feature point detection

matched by locality preserving structure

and calculated the projection matrix. The normalized distance is determined by the projection model of the coincident area and the projection matrix. If it is less than the threshold

it will be retained

otherwise it will be discarded and continue matrix calculation. In the non-coincident part of the image

the minimum bending energy function is obtained by calculating the deformation function of the image

so that the non-coincident region transits to the global transformation. The experimental results show that the proposed algorithm can not only improve the matching accuracy of the image

but also optimize the distortion of the image

enhance the integrity of the image and obtain a better visual experience.

关键词

Keywords

references

CHEN J , WAN Q , LUO L B , et al . Drone image stitching based on compactly supported radial basis function [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing , 2019 , 12 ( 11 ): 4634 - 4643 .

韩敏 , 闫阔 , 秦国帅 . 基于改进KAZE的无人机航拍图像拼接算法 [J]. 自动化学报 , 2019 , 45 ( 2 ): 305 - 314 .

HAN M , YAN K , QIN G S . A mosaic algorithm for UAV aerial image with improved KAZE [J]. Acta Automatica Sinica , 2019 , 45 ( 2 ): 305 - 314 . (in Chinese)

TAPETE D , CIGNA F . Detection of archaeological looting from space: Methods, achievements and challenges [J]. Remote Sensing , 2019 , 11 ( 20 ): 2389 .

ALMADHOUN R , ABDULDAYEM A , TAHA T , et al . Guided next best view for 3D reconstruction of large complex structures [J]. Remote Sensing , 2019 , 11 ( 20 ): 2440 .

丁颖 , 刘延伟 , 刘金霞 , 等 . 虚拟现实全景图像显著性检测研究进展综述 [J]. 电子学报 , 2019 , 47 ( 7 ): 1575 - 1583 .

DING Y , LIU Y W , LIU J X , et al . An overview of research progress on saliency detection of panoramic VR images [J]. Acta Electronica Sinica , 2019 , 47 ( 7 ): 1575 - 1583 . (in Chinese)

LOWE D G . Distinctive image features from scale-invariant keypoints [J]. International Journal of Computer Vision , 2004 , 60 ( 2 ): 91 - 110 .

BROWN M , LOWE D G . Automatic panoramic image stitching using invariant features [J]. International Journal of Computer Vision , 2007 , 74 ( 1 ): 59 - 73 .

徐弘祯 , 李世超 , 季宇寒 , 等 . 基于特征点匹配的全景相机图像拼接方法研究 [J]. 农业机械学报 , 2019 , 50 ( S1 ): 150 - 158 .

XU H Z , LI S C , JI Y H , et al . Panoramic camera image mosaic method based on feature points [J]. Transactions of the Chinese Society for Agricultural Machinery , 2019 , 50 ( S1 ): 150 - 158 . (in Chinese)

ZARAGOZA J , CHIN T J , BROWN M S , et al . As-projective-as-possible image stitching with moving DLT [C]// 2013 IEEE Conference on Computer Vision and Pattern Recognition . Portland : IEEE , 2013 : 2339 - 2346 .

赵春晖 , 樊斌 , 胡劲文 , 等 . 基于网格的统计优化特征匹配算法 [J]. 西北工业大学学报 , 2019 , 37 ( 2 ): 249 - 257 .

ZHAO C H , FAN B , HU J W , et al . Matching algorithm of statistical optimization feature based on grid method [J]. Journal of Northwestern Polytechnical University , 2019 , 37 ( 2 ): 249 - 257 . (in Chinese)

MA J Y , JIANG J J , ZHOU H B , et al . Guided locality preserving feature matching for remote sensing image registration [J]. IEEE Transactions on Geoscience and Remote Sensing , 2018 , 56 ( 8 ): 4435 - 4447 .

WU Z M . Compactly supported positive definite radial functions [J]. Advances in Computational Mathematics , 1995 , 4 ( 1 ): 283 - 292 .

FORNEFETT M , ROHR K , STIEHL H S . Radial basis functions with compact support for elastic registration of medical images [J]. Image and Vision Computing , 2001 , 19 ( 1/2 ): 87 - 96 .

唐逸之 , 罗闪 , 冉清 , 等 . 基于多薄板样条的多视角非刚性配准算法 [J]. 计算机辅助设计与图形学学报 , 2017 , 29 ( 12 ): 2153 - 2161 .

TANG Y Z , LUO S , RAN Q , et al . Multi-view non-rigid registration based on multiple thin-plate splines [J]. Journal of Computer-Aided Design & Computer Graphics , 2017 , 29 ( 12 ): 2153 - 2161 . (in Chinese)

ZHANG Z R , YANG X , LI Y R , et al . Sparse constrained transformation model based on radial basis function expansion: Application to cardiac and brain image registration [J]. IEEE Access , 2018 , 6 : 42631 - 42646 .

SPRENGEL R , ROHR K , STIEHL H S . Thin-plate spline approximation for image registration [C]// Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society . Amsterdam : IEEE , 1996 : 1190 - 1191 .

LIN C C , PANKANTI S U , RAMAMURTHY K N , et al . Adaptive as-natural-as-possible image stitching [C]// 2015 IEEE Conference on Computer Vision and Pattern Recognition . Boston : IEEE , 2015 : 1155 - 1163 .

WANG Z , BOVIK A C , SHEIKH H R , et al . Image quality assessment: From error visibility to structural similarity [J]. IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 - 612 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Learnable Threshold Optimization for Massive Dynamic Multi-User Access Detection

A Novel Motion Object Detection Algorithm Using Adjacent Frame and Background Frame

A Model of Cost Estimation and Control for Software Test Automation

Angle Based Orthogonal FRIT and Its Application in Image Denoising

Related Author

Pin-hong YOU

Ming TIAN

Jin-feng LIU

Jie LIU

FANG Yi

CHEN Ping-ping

DU Wei-qing

KANG Peng

Related Institution

School of Measurement and Control Technology and Communication Engineering， Harbin University of Science and Technology

School of Information Engineering, Guangdong University of Technology

School of Physics and Information Engineering, Fuzhou University

Digital Media Laboratory,Department of Computer Science,Beihang University

Beijing Technology and Business University

⁰