电子学报 ›› 2015, Vol. 43 ›› Issue (11): 2263-2270.DOI: 10.3969/j.issn.0372-2112.2015.11.019

• 学术论文 • 上一篇    下一篇

基于新视角合成的视频摘要交互式浏览

徐超1, 聂勇伟2, 葛红美1, 周国富3   

  1. 1. 南京审计学院, 江苏 南京 210029;
    2. 华南理工大学, 广东 广州 510006;
    3. 武汉大学, 湖北 武汉 430072
  • 收稿日期:2015-04-14 修回日期:2015-07-17 出版日期:2015-11-25
    • 通讯作者:
    • 聂勇伟
    • 作者简介:
    • 徐超 男,1980年出生,湖北红安人,博士,副教授,研究方向为可信软件、软件工程和嵌入式系统.E-mail:xuchao@nau.edu.cn
    • 基金资助:
    • 国家自然科学基金 (No.61170022); 江苏省高校自然科学研究面上项目 (No.15KJB520019); 江苏省高校"青蓝工程"优秀青年骨干教师培养对象资助

Novel-View Synthesis Based Interactive Video Synopsis Browsing

XU Chao1, NIE Yong-wei2, GE Hong-mei1, ZHOU Guo-fu3   

  1. 1. Nanjing Audit University, Nanjing, Jiangsu 210029, China;
    2. School of Computer Science and Engineering, South China University of Technology, Guangzhou, Guangdong 510006, China;
    3. School of Computer, Wuhan University, Wuhan, Hubei 430072, China
  • Received:2015-04-14 Revised:2015-07-17 Online:2015-11-25 Published:2015-11-25

摘要:

现有视频摘要方法大多仅在固定视角下对视频内容进行压缩,限制了视频内容的浏览空间,导致压缩后的视频内容相互碰撞和遮挡.最近的方法改变视频内容的时空关系,但导致摘要结果与原始视频的相似度降低.本文研究基于新视角合成技术的交互式摘要视频浏览算法,通过为视频内容构建新的观察视角,增加视频浏览空间,从本质上减少视频内容碰撞和遮挡的可能性.为完全避免碰撞现象,提出了特定视角下投影遮挡消除技术,仅需较小地改变视频内容的时空关系,保证摘要视频与原始视频内容的一致性.最后,为方便用户交互式浏览摘要视频,构建了观察视角自动生成算法,根据当前摘要内容实时推荐并调整到最优观察视角.实验结果和用户调查表明本文提出的交互式视频摘要算法能有效压缩视频冗余信息,提高了摘要视频准确度、易理解程度.

关键词: 新视角合成, 交互式视频摘要浏览, 单张图片场景重建, 速度障碍法

Abstract:

Most of the previous video synopsis methods compact the video under a fixed viewpoint,which limits the browsing space of the video.Recent method changes the spatiotemporal relationships between video objects with the side-effect of reducing the accuracy of synopsized video.This paper presents a novel-view synthesis based interactive video synopsis browsing method.Our method constructs wider browsing space that can inherently reduce the probability of collision and occlusion occurrences.To completely remove collision and occlusion artifacts,we propose a projective occlusion removing algorithm for a specified viewpoint,slightly changing the relationships between video objects.Finally,to facilitate user interactive browsing the video,we further propose an automatic viewpoint suggestion method,to compute and adjust to the optimal viewpoint in real-time according to current synopsized contents.The experiments and user study demonstrate the effectiveness of our method.

Key words: novel-view synthesis, dynamic 3D video synopsis, single image scene reconstruction, velocity obstacles

中图分类号: