1. 清华大学计算机科学与技术系,北京,100084
2. 清华大学微电子学研究所,北京,100084
3. 北京化工大学信息科学与技术学院,北京,100029
4. 清华大学计算机科学与技术系,北京,100084
5. 清华大学微电子学研究所,北京,100084
6. 北京航天晨信科技有限公司,北京,102308
7. 北京化工大学信息科学与技术学院,北京,100029
网络出版:2020-08-25,
纸质出版:2020
移动端阅览
陆兴鹏, 王明羽, 曹扬, 等. 一种基于帧图像的动态视觉传感器样本集建模方法[J]. 电子学报, 2020,48(8):1457-1464.
LU Xing-peng, WANG Ming-yu, CAO Yang, et al. A Dynamic Vision Sensor Sample Set Modeling Method Based on Frame Images[J]. Acta Electronica Sinica, 2020, 48(8): 1457-1464.
陆兴鹏, 王明羽, 曹扬, 等. 一种基于帧图像的动态视觉传感器样本集建模方法[J]. 电子学报, 2020,48(8):1457-1464. DOI: 10.3969/j.issn.0372-2112.2020.08.001.
LU Xing-peng, WANG Ming-yu, CAO Yang, et al. A Dynamic Vision Sensor Sample Set Modeling Method Based on Frame Images[J]. Acta Electronica Sinica, 2020, 48(8): 1457-1464. DOI: 10.3969/j.issn.0372-2112.2020.08.001.
动态视觉传感器(Dynamic Vision Sensor,DVS)利用事件驱动原理实现运动目标的快速提取,具有低延迟、低存储空间和高动态范围等优势.目前研究表明,基于DVS的神经网络在目标检测等领域具有明显的速度优势.但是,这类神经网络在训练时所需要的样本集主要依赖DVS相机产生,缺少高效的样本集生成方法,这制约了这类神经网络的应用与发展.本文根据DVS原理,提出了一种基于帧图像的DVS建模以及样本集建模方法.该方法设定每个像素单元独立工作,经过动态差分和逻辑判断后输出触发的地址-事件数据,这些数据通过编码和归一化生成神经网络训练时所需要的样本集.通过对MNIST和CIFAR-10样本集建模的实验结果表明,该建模方法效果与DVS相机基本一致;与基于帧图像的存储方式相比,该样本集可以明显减少存储空间.该方法所生成样本集已经通过卷积神经网络训练和测试验证.
Dynamic vision sensor (DVS) shows significant advantages on low computational latency
low memory usage and high dynamic range by utilizing the event-driven principle to extract features from moving objects. Current research shows that DVS-based neural networks improve object detection speed obviously. However
the sample sets required by such neural networks mainly rely on specific DVS cameras while lacking efficient generation methods for the sample sets. It limits the application and development of those neural networks. According to the principle of DVS
this paper presents a DVS sample set modeling method based on frame images
in which the sample set can be generated by encoding and normalizing the address-event (AE) data after being trigged by dynamic differential comparisons and logical judgments. The experimental results for modeling the MNIST and CIFAR-10 sample sets show that
the sample set modeled by the proposed method is basically matched with the real DVS cameras. Compared with traditional frame image sample sets
this method can significantly reduce the memory usage. The sample set generated by the proposed modeling method has also been verified by training and testing a typical convolutional neural network.
0
浏览量
132
下载量
1
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621