基于稠密变形场能量优化的非刚性在线体积重建方法

doi:10.12263/DZXB.20170915

电子学报 ›› 2021, Vol. 49 ›› Issue (5): 936-943.DOI: 10.12263/DZXB.20170915

基于稠密变形场能量优化的非刚性在线体积重建方法

林金花¹, 马林²

1. 长春工业大学应用技术学院, 吉林长春 130012;
2. 长春一汽铸造有限公司, 吉林长春 130000

收稿日期:2017-08-08 修回日期:2020-10-10 出版日期:2021-05-25
- 作者简介:
- 林金花 女,1980年9月出生,吉林长春人.长春工业大学讲师.主要研究方向为深度学习算法和金相图像处理. E-mail:ljh3832@163.com;马林男,1979年8月出生,吉林长春人.一汽铸造有限公司高级工程师.主要研究方向为金相图像处理. E-mail:927168801@qq.com
- 基金资助:
- 国家自然科学基金 (No.62006027）; 吉林省教育厅十三五科学技术研究 (No.JJKH20200681KJ）

An Non-Rigid Online Volume Reconstruction Method Based on Energy Optimization of Dense Deformation Field

LIN Jin-hua¹, MA Lin²

1. School of Application Technology, Changchun University of Technology, Changchun, Jilin 130012, China;
2. FAW Foundry Co., Ltd, Changchun, Jilin 130000, China

Received:2017-08-08 Revised:2020-10-10 Online:2021-05-25 Published:2021-05-25
- Supported by:
- National Natural Science Foundation of China (No.62006027); Science and Technology Research Project of Department of Education of Jilin Province during the 13th Five-year Plan (No.JJKH20200681KJ)

摘要/Abstract

摘要： 针对动态非刚性在线重建存在的重建漂移问题,提出了一种基于单个RGB-D传感器的稠密变形场在线融合策略,实现了对非刚性几何形状的动态重建.通过局部平滑和输入约束处理,将空间的最优变形转换为非线性正则变分优化问题,并使用数据并行闪存优化策略,以摄像机捕获速率,实现对非刚性场景的在线跟踪重建.通过实验表明,本文方法实现了对非刚性场景的鲁棒跟踪,减少了在线重建过程中的漂移现象,适用于快速运动和缺乏几何特征的场景重建.

关键词: RGB-D传感器, 动态重建, 鲁棒跟踪

Abstract: In order to relieve the drift phenomenon in dynamic non-rigid online reconstruction, an on-line fusion strategy for dense deformation field based on a single RGB-D sensor is proposed, realizing the dynamic reconstruction for non-rigid geometries. By local smoothing and input constraint strategy, the optimal deformation problem is transformed into nonlinear regular variational optimization problem. We use the data parallel flash optimization strategy to achieve on-line tracking of non-rigid scene in camera tracking rate. Experiments show that the proposed method achieves robust tracking of non-rigid scenes, which reduces drift in the process of online reconstruction, this algorithm is suitable for fast moving scene as well as the object lack of geometric features.

Key words: RGB-D sensor, dynamic reconstruction, robust tracking

中图分类号:

TP391

林金花, 马林. 基于稠密变形场能量优化的非刚性在线体积重建方法[J]. 电子学报, 2021, 49(5): 936-943.

LIN Jin-hua, MA Lin . An Non-Rigid Online Volume Reconstruction Method Based on Energy Optimization of Dense Deformation Field[J]. Acta Electronica Sinica, 2021, 49(5): 936-943.

参考文献

[1] Newcombe R A,Izadi S,Hilliges O,et al.KinectFusion:Real-time dense surface mapping and tracking[A].Proceedings of IEEE International Symposium on Mixed and Augmented Reality[C].New York,USA:IEEE,2011.127-136.
[2] Zeng M,Zhao F K,Zheng J X,et al.Octree-based fusion for realtime 3D reconstruction[J].Graphical Models,2013,75(3):126-136.
[3] Chen J W,Bautembach D,Izadi S.Scalable real-time volumetric surface reconstruction[J].ACM Transactions on Graphics,2013,32(4):1-16.
[4] 杜惠斌,赵忆文,韩建达,等.基于集员滤波的双Kinect人体关节点数据融合[J].自动化学报,2016,42(12):1886-1898. Du H B,Zhao Y W,Han J D,et al.Data fusion of human skeleton joint tracking using two kinect sensors and extended set membership filter[J].Acta Automatica Sinica,2016,42(12):1886-1898.(in Chinese).
[5] Steinbrucker F,Sturm J,Cremers D.Volumetric 3D mapping in real-time on a CPU[A].Proceedings of IEEE International Conference on Robotics and Automation(ICRA)[C].Hong Kong,China:IEEE,2014.2021-2028.
[6] Zollhöfer M,Nieβner M,Izadi S,et al.Real-time non-rigid reconstruction using an RGB-D camera[J].ACM Transactions on Graphics,2014,33(4):1-12.
[7] Collet A,Chuang M,Sweeney P,et al.High-quality streamable free-viewpoint video[J].ACM Transactions on Graphics,2015,34(4):1-13.
[8] Guo K W,Xu F,Wang Y G,et al.Robust non-rigid motion tracking and surface reconstruction using L0 regularization[A].Proceeding of IEEE International Conference on Computer Vision(ICCV)[C].Santiago,Chile:IEEE,2015.3083-3091.
[9] Garg R,Roussos A,Agapito L.Dense variational reconstruction of non-rigid surfaces from monocular video[A].Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition[C].New York,USA:IEEE,2013.1272-1279.
[10] Li H,Vouga E,Gudym A,et al.3D self-portraits[J].ACM Transactions on Graphics,2013,32(6):187.1-187.9.
[11] 裘国永,刘静娜,刘中华,等.最小特征值的迭代非刚性三维摄影重建方法[J].电子学报,2017,45(5):1211-1217. Qiu G Y,Liu J N,Liu Z H,et al.Iteration projection reconstruction method for 3D non-rigid based on minimal eigenvalue[J].Acta Electronica Sinica,2017,45(5):1211-1217.(in Chinese).
[12] Wang R Z,Wei L U,Vouga E,et al.Capturing dynamic textured surfaces of moving targets[A].Proceedings of the European Conference on Computer Vision[C].Cham,Switzerland:Springer International Publishing,2016.271-288.
[13] 李倩玉,蒋建国,齐美彬.基于改进深层网络的人脸识别算法[J].电子学报,2017,45(3):619-625. Li Q Y,Jiang J G,Qi M L.Face recognition algorithm based on improved deep networks[J].Acta Electronica Sinica,2017,45(3):619-625.(in Chinese).
[14] 陈宝华,邓磊,陈志祥,等.基于即时稠密三维重构的无人机视觉定位[J].电子学报,2017,45(6):1294-1300. Chen B H,Deng L,Chen Z X,et al.Instant dense 3D reconstruction-based UAV vision localization[J].Acta Electronica Sinica,2017,45(6):1294-1300.(in Chinese).
[15] Newcombe R A,Fox D,Seitz S M.DynamicFusion:Reconstruction and tracking of non-rigid scenes in real-time[A].Proceedings of Computer Vision and Pattern Recognition[C].New York,USA:IEEE,2015.343-352.
[16] Sorkine O,Alexa M.As-rigid-as-possible surface modeling[A].Proceedings of Eurographics Symposium on Geometry Processing[C].Barcelona,Spain:Eurographics Association,2007.109-116.

基于稠密变形场能量优化的非刚性在线体积重建方法

An Non-Rigid Online Volume Reconstruction Method Based on Energy Optimization of Dense Deformation Field

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	陈君毅, 蒋德琛, 王智铭, 曹佳禾, 王勇. 一种基于双维度滤波和自适应定长化的FMCW雷达手势识别算法研究[J]. 电子学报, 2023, (): 1-9.
[2]	韩光洁, 赵腾飞, 刘立, 张帆, 徐政伟. 基于多元区域集划分的工业数据流概念漂移检测[J]. 电子学报, 2023, (): 1-11.
[3]	彭锦佳, 王辉兵. 基于异构卷积神经网络集成的无监督行人重识别方法[J]. 电子学报, 2023, (): 1-13.
[4]	余伶俐, 易倩, 金鸣岳, 周开军. 面向仿射目标识别的几何与仿生融合特征提取方法[J]. 电子学报, 2023, (): 1-12.
[5]	郭凯红, 崔明茜, 刘婷婷. 模糊知识测度下图像脉冲噪声去除方法[J]. 电子学报, 2023, (): 1-14.
[6]	李杨帅, 彭斐, 韩倩, 李小帅, 解光军. 一种针对QCA电路自动布局布线的混合策略研究[J]. 电子学报, 2023, 51(3): 666-674.
[7]	吕杭, 蒋明峰, 李杨, 张鞠成, 王志康. 基于混合时频域特征的卷积神经网络心律失常分类方法的研究[J]. 电子学报, 2023, 51(3): 701-711.
[8]	郑云飞, 王晓兵, 张雄伟, 曹铁勇, 孙蒙. 基于金字塔知识的自蒸馏HRNet目标分割方法[J]. 电子学报, 2023, 51(3): 746-756.
[9]	隗昊, 唐焕玲, 周爱, 张益嘉, 陈飞, 鲁明羽. 基于双路分段注意力神经张量网络的临床文本关系抽取[J]. 电子学报, 2023, 51(3): 658-665.
[10]	黄赟, 张帆, 郭威, 陈立, 羊光. 一种基于数据标准差的卷积神经网络量化方法[J]. 电子学报, 2023, 51(3): 639-647.
[11]	范兵兵, 何庭建, 张聪炫, 陈震, 黎明. 联合遮挡约束与残差补偿的特征金字塔光流计算方法[J]. 电子学报, 2023, 51(3): 648-657.
[12]	张晶, 王翌歆, 任永功. 统一全局空间表达的脑电信号跨被试情感识别[J]. 电子学报, 2023, (): 1-9.
[13]	申铉京, 李涵宇, 黄永平, 王玉. 基于自适应多尺度特征融合网络的车辆检测方法[J]. 电子学报, 2023, (): 1-9.
[14]	陈习坤, 杨俊美. 基于离散小波包变换与胶囊生成对抗网络的语音超分辨率算法[J]. 电子学报, 2023, (): 1-11.
[15]	张娜, 包梓群, 罗源, 吴彪, 涂小妹. 基于改进Cascade R-CNN算法在目标检测上的应用[J]. 电子学报, 2023, (): 1-11.