信息工程大学,河南,郑州,450002
网络出版:2021-02-25,
纸质出版:2021
移动端阅览
高琛, 张帆, 高彦钊. 利用数据稀疏性的LSTM加速器设计[J]. 电子学报, 2021,49(2):209-215.
GAO Chen, ZHANG Fan, GAO Yan-zhao. Design of LSTM Accelerator by Utilizing Data Sparseness[J]. Acta Electronica Sinica, 2021, 49(2): 209-215.
高琛, 张帆, 高彦钊. 利用数据稀疏性的LSTM加速器设计[J]. 电子学报, 2021,49(2):209-215. DOI: 10.12263/DZXB.20190773.
GAO Chen, ZHANG Fan, GAO Yan-zhao. Design of LSTM Accelerator by Utilizing Data Sparseness[J]. Acta Electronica Sinica, 2021, 49(2): 209-215. DOI: 10.12263/DZXB.20190773.
针对长短时记忆神经网络(Long Short-Term Memory,LSTM)模型计算开销大、冗余计算较多的问题,本文提出一种利用输入数据稀疏性的LSTM加速器设计方案.本方案基于Delta网络算法,对输入序列的稀疏性进行构建,在避免数据不规则加载的前提下,对冗余矩阵向量乘法运算进行过滤;针对矩阵向量乘法计算模式进行建模,寻找最高效的并行阵列计算架构设计.在MNIST标准数据集上的实验表明,当Delta网络算法的过滤门限不超过0.5时,LSTM神经网络算法检测准确率不变,计算性能提高了21.53倍.
Aiming at the problem of high computational overhead and redundancy in LSTM model
this paper proposed a design method of LSTM accelerator based on data sparsity. This scheme uses Delta network algorithm to mine the sparsity of input data
and filters the multiplication of redundant matrix vectors without irregular loading of data. The calculation mode of matrix-vector multiplication is modeled to find the most efficient parallel array computing architecture design scheme. The experimental results on MINIST dataset show that when the filter threshold of Delta network algorithm is less than 0.5
the detection accuracy of LSTM neural network algorithm remains unchanged
and the computational performance is improved by 21.53 times.
0
浏览量
23
下载量
1
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621