基于稠密变形场能量优化的非刚性在线体积重建方法

doi:10.12263/DZXB.20170915

电子学报 ›› 2021, Vol. 49 ›› Issue (5): 936-943.DOI: 10.12263/DZXB.20170915

基于稠密变形场能量优化的非刚性在线体积重建方法

林金花¹, 马林²

1. 长春工业大学应用技术学院, 吉林长春 130012;
2. 长春一汽铸造有限公司, 吉林长春 130000

收稿日期:2017-08-08 修回日期:2020-10-10 出版日期:2021-05-25
- 作者简介:
- 林金花 女,1980年9月出生,吉林长春人.长春工业大学讲师.主要研究方向为深度学习算法和金相图像处理. E-mail:ljh3832@163.com;马林男,1979年8月出生,吉林长春人.一汽铸造有限公司高级工程师.主要研究方向为金相图像处理. E-mail:927168801@qq.com
- 基金资助:
- 国家自然科学基金 (No.62006027）; 吉林省教育厅十三五科学技术研究 (No.JJKH20200681KJ）

An Non-Rigid Online Volume Reconstruction Method Based on Energy Optimization of Dense Deformation Field

LIN Jin-hua¹, MA Lin²

1. School of Application Technology, Changchun University of Technology, Changchun, Jilin 130012, China;
2. FAW Foundry Co., Ltd, Changchun, Jilin 130000, China

Received:2017-08-08 Revised:2020-10-10 Online:2021-05-25 Published:2021-05-25

摘要/Abstract

摘要： 针对动态非刚性在线重建存在的重建漂移问题,提出了一种基于单个RGB-D传感器的稠密变形场在线融合策略,实现了对非刚性几何形状的动态重建.通过局部平滑和输入约束处理,将空间的最优变形转换为非线性正则变分优化问题,并使用数据并行闪存优化策略,以摄像机捕获速率,实现对非刚性场景的在线跟踪重建.通过实验表明,本文方法实现了对非刚性场景的鲁棒跟踪,减少了在线重建过程中的漂移现象,适用于快速运动和缺乏几何特征的场景重建.

关键词: RGB-D传感器, 动态重建, 鲁棒跟踪

Abstract: In order to relieve the drift phenomenon in dynamic non-rigid online reconstruction,an on-line fusion strategy for dense deformation field based on a single RGB-D sensor is proposed,realizing the dynamic reconstruction for non-rigid geometries.By local smoothing and input constraint strategy,the optimal deformation problem is transformed into nonlinear regular variational optimization problem.We use the data parallel flash optimization strategy to achieve on-line tracking of non-rigid scene in camera tracking rate.Experiments show that the proposed method achieves robust tracking of non-rigid scenes,which reduces drift in the process of online reconstruction,this algorithm is suitable for fast moving scene as well as the object lack of geometric features.

Key words: RGB-D sensor, dynamic reconstruction, robust tracking

中图分类号:

TP391

林金花, 马林. 基于稠密变形场能量优化的非刚性在线体积重建方法[J]. 电子学报, 2021, 49(5): 936-943.

LIN Jin-hua, MA Lin. An Non-Rigid Online Volume Reconstruction Method Based on Energy Optimization of Dense Deformation Field[J]. Acta Electronica Sinica, 2021, 49(5): 936-943.

参考文献

[1] Newcombe R A,Izadi S,Hilliges O,et al.KinectFusion:Real-time dense surface mapping and tracking[A].Proceedings of IEEE International Symposium on Mixed and Augmented Reality[C].New York,USA:IEEE,2011.127-136.
[2] Zeng M,Zhao F K,Zheng J X,et al.Octree-based fusion for realtime 3D reconstruction[J].Graphical Models,2013,75(3):126-136.
[3] Chen J W,Bautembach D,Izadi S.Scalable real-time volumetric surface reconstruction[J].ACM Transactions on Graphics,2013,32(4):1-16.
[4] 杜惠斌,赵忆文,韩建达,等.基于集员滤波的双Kinect人体关节点数据融合[J].自动化学报,2016,42(12):1886-1898. Du H B,Zhao Y W,Han J D,et al.Data fusion of human skeleton joint tracking using two kinect sensors and extended set membership filter[J].Acta Automatica Sinica,2016,42(12):1886-1898.(in Chinese).
[5] Steinbrucker F,Sturm J,Cremers D.Volumetric 3D mapping in real-time on a CPU[A].Proceedings of IEEE International Conference on Robotics and Automation(ICRA)[C].Hong Kong,China:IEEE,2014.2021-2028.
[6] Zollhöfer M,Nieβner M,Izadi S,et al.Real-time non-rigid reconstruction using an RGB-D camera[J].ACM Transactions on Graphics,2014,33(4):1-12.
[7] Collet A,Chuang M,Sweeney P,et al.High-quality streamable free-viewpoint video[J].ACM Transactions on Graphics,2015,34(4):1-13.
[8] Guo K W,Xu F,Wang Y G,et al.Robust non-rigid motion tracking and surface reconstruction using L0 regularization[A].Proceeding of IEEE International Conference on Computer Vision(ICCV)[C].Santiago,Chile:IEEE,2015.3083-3091.
[9] Garg R,Roussos A,Agapito L.Dense variational reconstruction of non-rigid surfaces from monocular video[A].Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition[C].New York,USA:IEEE,2013.1272-1279.
[10] Li H,Vouga E,Gudym A,et al.3D self-portraits[J].ACM Transactions on Graphics,2013,32(6):187.1-187.9.
[11] 裘国永,刘静娜,刘中华,等.最小特征值的迭代非刚性三维摄影重建方法[J].电子学报,2017,45(5):1211-1217. Qiu G Y,Liu J N,Liu Z H,et al.Iteration projection reconstruction method for 3D non-rigid based on minimal eigenvalue[J].Acta Electronica Sinica,2017,45(5):1211-1217.(in Chinese).
[12] Wang R Z,Wei L U,Vouga E,et al.Capturing dynamic textured surfaces of moving targets[A].Proceedings of the European Conference on Computer Vision[C].Cham,Switzerland:Springer International Publishing,2016.271-288.
[13] 李倩玉,蒋建国,齐美彬.基于改进深层网络的人脸识别算法[J].电子学报,2017,45(3):619-625. Li Q Y,Jiang J G,Qi M L.Face recognition algorithm based on improved deep networks[J].Acta Electronica Sinica,2017,45(3):619-625.(in Chinese).
[14] 陈宝华,邓磊,陈志祥,等.基于即时稠密三维重构的无人机视觉定位[J].电子学报,2017,45(6):1294-1300. Chen B H,Deng L,Chen Z X,et al.Instant dense 3D reconstruction-based UAV vision localization[J].Acta Electronica Sinica,2017,45(6):1294-1300.(in Chinese).
[15] Newcombe R A,Fox D,Seitz S M.DynamicFusion:Reconstruction and tracking of non-rigid scenes in real-time[A].Proceedings of Computer Vision and Pattern Recognition[C].New York,USA:IEEE,2015.343-352.
[16] Sorkine O,Alexa M.As-rigid-as-possible surface modeling[A].Proceedings of Eurographics Symposium on Geometry Processing[C].Barcelona,Spain:Eurographics Association,2007.109-116.

基于稠密变形场能量优化的非刚性在线体积重建方法

An Non-Rigid Online Volume Reconstruction Method Based on Energy Optimization of Dense Deformation Field

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	王子为, 鲁继文, 周杰. 基于自适应梯度优化的二值神经网络[J]. 电子学报, 2023, (): 1-10.
[2]	刘金平, 吴娟娟, 张荣, 徐鹏飞. 基于结构重参数化与多尺度深度监督的COVID-19胸部CT图像自动分割[J]. 电子学报, 2023, (): 1-9.
[3]	张笑宇, 沈超, 蔺琛皓, 李前, 王骞, 李琦, 管晓宏. 面向机器学习模型安全的测试与修复[J]. 电子学报, 2023, (): 1-35.
[4]	王炼红, 罗志辉, 林飞鹏, 李潇瑶. 采用多头注意力机制的C&RM-MAKT预测算法[J]. 电子学报, 2022, (): 1-9.
[5]	苏田田, 王慧敏, 张小凤. 基于多分支瓶颈结构的轻量型图像分类算法研究[J]. 电子学报, 2022, (): 1-9.
[6]	刘芳, 朱天贺, 苏卫星, 刘阳. 基于高斯隐马尔可夫模型的人机共享控制区域化决策算法[J]. 电子学报, 2022, 50(11): 2659-2667.
[7]	桑海峰, 陈旺兴, 王海峰, 王金玉. 基于多模式时空交互的行人轨迹预测模型[J]. 电子学报, 2022, 50(11): 2806-2812.
[8]	刘耿耿, 李泽鹏, 郭文忠, 陈国龙, 徐宁. 面向超大规模集成电路物理设计的通孔感知的并行层分配算法[J]. 电子学报, 2022, 50(11): 2575-2583.
[9]	魏博文, 全红艳. 基于语义与形态特征融合的语义分割网络[J]. 电子学报, 2022, 50(11): 2688-2697.
[10]	姚睿, 朱享彬, 周勇, 王鹏, 张艳宁, 赵佳琦. 基于重要特征的视觉目标跟踪可迁移黑盒攻击方法[J]. 电子学报, 2022, (): 1-10.
[11]	金紫凤, 潘思聪, 危辉. 可变环境下基于位姿变换矩阵的机器人无标定手眼协调方法[J]. 电子学报, 2022, 50(10): 2318-2328.
[12]	魏钰轩, 陈莹. 基于自适应层信息熵的卷积神经网络压缩[J]. 电子学报, 2022, 50(10): 2398-2408.
[13]	马百腾, 张士伟, 高常鑫, 桑农. 面向行为边界框生成的端到端时间全局相关网络[J]. 电子学报, 2022, 50(10): 2452-2461.
[14]	肖斌, 陈嘉博, 毕秀丽, 张俊辉, 李伟生, 王国胤, 马旭. 基于一维卷积神经网络与循环神经网络串联的心音分析方法[J]. 电子学报, 2022, 50(10): 2425-2432.
[15]	周登文, 李文斌, 李金新, 黄志勇. 一种轻量级的多尺度通道注意图像超分辨率重建网络[J]. 电子学报, 2022, 50(10): 2336-2346.