电子学报 ›› 2020, Vol. 48 ›› Issue (3): 538-544.DOI: 10.3969/j.issn.0372-2112.2020.03.017

• 学术论文 • 上一篇    下一篇

基于kuwahara滤波的视频风格化框架

李大锦1, 高文冉2, 高俊杰2   

  1. 1. 山东师范大学传媒学院, 山东济南 250014;
    2. 山东师范大学物理与电子科学学院, 山东济南 250014
  • 收稿日期:2019-05-17 修回日期:2019-11-25 出版日期:2020-03-25
    • 作者简介:
    • 李大锦 男,1971年11月生于江苏省连云港,现为山东师范大学传媒学院数字媒体系副教授,硕士生导师,研究方向为计算机图形学,虚拟现实与计算机动画技术.E-mail:ldjwqc@163.com;高文冉 男,1996年12月生于山东省济宁市,现为山东师范大学物理与电子科学学院硕士研究生,研究方向为数字图像处理、计算机视觉.;高俊杰 男,1995年9月生于山东省泰安市,现为山东师范大学物理与电子科学学院硕士研究生,研究方向为数字图像处理.
    • 基金资助:
    • 国家自然科学基金 (No.61340019); 山东省科技发展计划 (No.2014GG201004); 山东省重点研发计划 (No.2015GGB01295)

Artistic Video Stylization Based on Kuwahara Filter

LI Da-jin1, GAO Wen-ran2, GAO Jun-jie2   

  1. 1. College of Communication, Shandong Normal University, Jinan, Shandong 250014, China;
    2. College of Physics and Electronics Science, Shandong Normal University, Jinan, Shandong 250014, China
  • Received:2019-05-17 Revised:2019-11-25 Online:2020-03-25 Published:2020-03-25
    • Supported by:
    • National Natural Science Foundation of China (No.61340019); Science and Technology Development Project of Shandong Provicne (No.2014GG201004); Key R&D Program of Shandong Province (No.2015GGB01295)

摘要: 保边滤波被广泛应用于图像的艺术化风格转换,但目前的方法大都只能产生类似卡通的绘画风格,对于具有明显笔画形状的绘画风格转换都无能为力.文章在kuwahara滤波的基础上提出了一种尺度可控的各向异性kuwahara滤波,可以生成具有明显笔画形状的艺术效果.为了更好的模拟画家的绘画技法,文章以图像显著性作为控制信息来实时调整滤波核大小,可以产生丰富的笔画尺度.基于该算法,文章还给出了一个视频的艺术化风格渲染框架.该渲染框架可以保持良好的帧间一致性,自动的将视频转换为水粉画或油画效果.同时利用图像的边缘切方向场图、边缘梯度和显著性控制凹凸映射,产生油画和水粉画笔触的厚重感和层次感,能很好的模拟"厚涂技法"的艺术风格.

关键词: 各向异性滤波, 非真实感渲染, 风格转换, 笔画纹理

Abstract: Edge-preserving filters have been extensive used to image artistic stylization, but most of the existing filters can only generate cartoon-like style and can do nothing about the painting styles with clear brush stroke shape. Based on kuwahara filter, the paper proposes a multi-scale anisotropic kuwahara filter to generate some painting styles with obvious brush stroke shape. To simulate the painting techniques, saliency is used to control the size of the filter kernel and can produce strokes with rich geometrical scales. Based on the multi-scale anisotropic kuwahara filter, we also propose an artistic rendering framework for video stylization, which can keep frame-to-frame coherence well and automatically convert video into gouache or oil painting effect. To produce brush strokes a thick and layered feel, bump mapping is used to produce the stroke touch effects. The edge tangent vector field map, edge gradient magnitude and image saliency are combined to control the bump mapping, which can simulate the "impasto technique" well in oil or gouache paintings.

Key words: anisotropic filter, nonphotorealistic rendering, style transfer, strokes texture

中图分类号: