一种能耗优化的RAID小写预读方法

doi:10.3969/j.issn.0372-2112.2019.09.024

电子学报 ›› 2019, Vol. 47 ›› Issue (9): 1987-1993.DOI: 10.3969/j.issn.0372-2112.2019.09.024

一种能耗优化的RAID小写预读方法

孙志卓¹, 黄洪², 张全新³, 谭毓安³, 李元章³, 张小松⁴

1. 德州学院计算机系, 山东德州 253000;
2. 中国人民解放军 61516部队, 北京 100094;
3. 北京理工大学计算机学院, 北京 100081;
4. 唐山学院计算机科学与技术系, 河北唐山 063000

收稿日期:2018-08-30 修回日期:2018-12-31 出版日期:2019-09-25
- 通讯作者:
- 张小松
- 作者简介:
- 孙志卓.E-mail:sunzhizhuo@126.com;黄洪.E-mail:huanghongbj@163.com;张全新.E-mail:zhangqx@bit.edu.cn;谭毓安.E-mail:victortan@yeah.net;李元章.E-mail:popular@bit.edu.cn
- 基金资助:
- 国家自然科学基金 (No.61370063）; 山东省自然科学基金 (No.ZR2016FM37，No.ZR2017LC014，No.ZR2015FL006）

A Small Write Prefetching Scheme for Engery-Optimized RAID Sub-systems

SUN Zhi-zhuo¹, HUANG Hong², ZHANG Quan-xin³, TAN Yu-an³, LI Yuan-zhang³, ZHANG Xiao-song⁴

1. College of Computer Science and Technology, Dezhou University, Dezhou, Shandong 253000, China;
2. Chinese People's Liberation Army Unit 61516, Beijing 100094, China;
3. School of Computer Science, Beijing Institute of Technology, Beijing 100081, China;
4. Department of Computer Science and Technology, Tangshan University, Tangshan, Hebei 063000, China

Received:2018-08-30 Revised:2018-12-31 Online:2019-09-25 Published:2019-09-25

摘要/Abstract

摘要： 视频监控、备份、归档等应用产生海量存储数据，导致存储能耗急剧增加.S-RAID采用局部并行数据布局，可显著降低该类应用的存储能耗.为使更多磁盘待机节能，S-RAID通常执行"小写"操作，写操作时会额外引入等量的读操作，会显著降低性能.现有预读机制主要发生在文件级，无法感知RAID级小写引发的读旧数据、旧校验数据等读操作，因此不会也无法预读该类数据.为此，提出一种面向S-RAID的RAID级小写预读算法，由小写操作触发并在RAID级执行预读，根据S-RAID的数据布局方式，大粒度异步预读小写需要的旧数据、旧校验数据，有效减少I/O数和寻道数，提高磁盘的利用率.该方法可显著提高S-RAID的写性能，并且不依赖于任何额外硬件，具有更高的可用性.

关键词: 海量存储, 节能, 局部并行, 盘阵, 数据布局

Abstract: The applications,such as video surveillance,backup,and archiving,generate massive storage data,which make the energy consumption of storage devices increase rapidly.S-RAID can reduce the storage energy consumption of above applications significantly.In order to make more disks standby for energy saving,S-RAID prefers to small write.However,performing small write requires additional and equal amount of read operations for generating parity data,and the write performance of S-RAID is decreased.The existing prefetching mechanism mainly implements at the file system level,and cannot sense the read operations generated by small write at RAID level,such as reading old data and reading old parity.So it can not prefetch these old data and old parity data.Therefore,a RAID-level prefetching algorithm for small write of S-RAID is proposed,which is triggered by small write operations and performs at RAID level.It asynchronously prefetches the old data and old parity data required by small writes in large granularity according to the data layout of S-RAID.The write performance of S-RAID can be improved by about 40% without any additional hardware cost.

Key words: massive storage, energy conservation, partial parallelism, RAID, data layout

中图分类号:

TP333

孙志卓, 黄洪, 张全新, 谭毓安, 李元章, 张小松. 一种能耗优化的RAID小写预读方法[J]. 电子学报, 2019, 47(9): 1987-1993.

SUN Zhi-zhuo, HUANG Hong, ZHANG Quan-xin, TAN Yu-an, LI Yuan-zhang, ZHANG Xiao-song. A Small Write Prefetching Scheme for Engery-Optimized RAID Sub-systems[J]. Acta Electronica Sinica, 2019, 47(9): 1987-1993.

参考文献

[1] Sun zhizhuo,Li Yuanzhang,Tan Yu-an.An energy-efficient storage for video surveillance[J].Multimedia Tools and Applications,2014,73(1):151-167.
[2] 王金铭,叶时平,徐振宇,陈超祥,蒋燕君.半张量积低存储压缩感知方法研究[J],电子学报,2018,46(4):797-804. Wang Jinming,Ye Shiping,Xu Zhenyu,Chen Chaoxiang,Jiang Yanjun.Low storage space of random measurement matrixfor compressed sensing with semi-tensor product[J].Acta Electronica Sinica,2018,46(4):797-804.(in Chinese)
[3] Xiao Yu,Yu-an Tan,Changyou Zhang,Chen Liang,AOURRA Khaled,Jun Zheng,Quanxin Zhang.Ahigh-performance hierarchical snapshot scheme for hybrid storage systems[J].Chinese Journal of Electronics,2018,27(1):76-85.
[4] Sun Zhizhuo,Zhang Quanxin,Li Yuanzhang,Tan Yu-an.DPPDL:a dynamic partial-parallel data layout for green video surveillance storage[J].IEEE Transactions on Circuits and Systems for Video Technology,2018,28(1):193-205.
[5] Zhang Guangyan,Huang Zican,Ma Xiaosong,et al.RAID+:deterministic and balanced data distribution for large disk enclosures[A].Proc of the 16th USENIX Conference on File and Storage Technologies (FAST)[C].Oakland:USENIX Association,2018.279-294.
[6] Yan Fang,Tan Yu-an,Zhang Quanxin,Wu Fei,Cheng Zijing,Zheng Jun.An effective RAID data layout for object-based de-duplication backup system[J].Chinese Journal of Electronics,2016,25(5):832-840.
[7] 李元章,孙志卓,马忠梅,郑军,谭毓安.S-RAID 5:一种适用于顺序数据访问的节能磁盘阵列[J].计算机学报,2013,36(6):1290-1302. Li Yuanzhang,Sun Zhizhuo,Ma Zhongmei,Zheng Jun,Tan Yu-an.S-RAID 5:An energy-saving raid for sequential access based application[J].Chinese Journal of Computers,2013,36(6):1290-1302.(in Chinese)
[8] Li X,Tan YA,Sun ZZ.Semi-RAID:a reliable energy-aware RAID data layout for sequential data access[A].27th Symposium on Mass Storage Systems and Technologies (MSST)[C].Piscataway:IEEE,2011.1-11
[9] Weddle C,Oldham M,Qian J,et al.PARAID:a gear-shifting power-aware RAID[A].5th USENIX Conf on File and Storage Technologies (FAST)[C].Berkeley:USENIX Association,2007.245-260.
[10] Zhu Q B,Chen Z F,Tan L,et al.Hibernator:helping disk arrays sleep through the winter[J].Operating Systems Review,2005,39(5):177-190.
[11] Colarelli D,Grunwald D.Massive arrays of idle disks for storage archives[A].ACM/IEEE Conference on Supercomputing[C].Los Alamitos:IEEE,2002.1-11.
[12] Wang J,Zhu H,Li D.eRAID:conserving energy in conventional disk-based RAID system[J].IEEE Transactions on Computers,2008,57(4):359-374.
[13] 刘靖宇,谭毓安,薛静锋,马忠梅,李元章,张全新.S-RAID中基于连续数据特征的写优化策略[J].计算机学报,2014,37(3):722-734. Liu Jingyu,Tan Yu-an,Xue Jingfeng,Ma Zhongmei,Li Yuanzhang,Zhang Quanxin.Write optimization strategy in s-raid based on sequential data characteristics[J].Chinese Journal of Computers,2014,37(3):722-734.(in Chinese)
[14] 孙志卓,张全新,谭毓安,李元章.Ripple-RAID:一种面向连续数据存储的高效能盘阵[J].软件学报,2015,26(7):1824-1839. Sun Zhizhuo,Zhang Quanxin,Tan Yu-an,Li Yuanzhang.Ripple-RAID:A high-performance and energy-efficient RAID for continuous data storage[J].Journal of Software,2015,26(7):1824-1839.(in Chinese)
[15] Stodolsky D,Holland M,Courtright W V,et al.Parity-logging disk arrays[J].ACM Transactions on Computer Systems,1994,12(3):206-235.
[16] Jin Chao,Feng Dan,Jiang Hong,et al.RAID6L:a log-assisted RAID6 storage architecture with improved write performance[A].27th Symptom on Mass Storage Systems and Technologies (MSST)[C].Piscataway:IEEE,2011.1-6.
[17] 孙志卓,张全新,李元章,谭毓安,刘靖宇,马忠梅.连续数据存储中面向RAID 5的写操作优化设计[J].计算机研究与发展,2013,50(8):1604-1612. Sun Zhizhuo,Zhang Quanxin,Li Yuanzhang,Tan Yu-an,Liu Jingyu,Ma Zhongmei.Write optimization for RAID5 in sequential data storage[J].Journal of Computer Research and Development,2013,50(8):1604-1612.(in Chinese)
[18] Li Mingqiang,Shu Jiwu.DACO:a high-performance disk architecture designed specially for large-scale erasure-coded storage systems[J].IEEE Transactions on Computers,2010,59(10):1350-1362.
[19] 吴峰光,奚宏生,徐陈锋.一种支持并发访问流的文件预取算法[J].软件学报,2010,21(8):1820-1833. Wu Fengguang,Xi Hongsheng,Xu Chenfeng.File prefetching algorithm for concurrent streams[J].Journal of Software,2010,21(8):1820-1833.(in Chinese)
[20] Yu Xiao,Zhang Changyou,Xue Yuan,et al.An extra-parity energy saving data layout for video surveillance[J].Multimedia Tools and Applications,2018,77(4):4563-4583.

一种能耗优化的RAID小写预读方法

A Small Write Prefetching Scheme for Engery-Optimized RAID Sub-systems

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	蒋万春, 廖凯琴. 节能以太网的节能策略综述[J]. 电子学报, 2021, 49(9): 1830-1839.
[2]	王强, 陈俊, 王天施, 刘晓琴. 节能型三相桥式零电流开关整流器[J]. 电子学报, 2020, 48(7): 1403-1406.
[3]	王强, 郭国先, 王天施, 刘晓琴. 具有软开关功能的三相谐振直流环节逆变器[J]. 电子学报, 2019, 47(9): 1994-1997.
[4]	张晓娟, 马学彬, 王洪彬. 延迟容忍移动传感器网络中基于最优距离的可靠节能传输策略[J]. 电子学报, 2019, 47(1): 105-112.
[5]	王强, 岳远韶, 王天施, 刘晓琴. 电流型零电压开关节能整流器[J]. 电子学报, 2018, 46(6): 1515-1518.
[6]	王巍, 赵继军, 彭力, 黄晓丹, 李林茂, 魏丁丁. 基于UAV的移动物联网远距离通信节能策略研究[J]. 电子学报, 2018, 46(12): 2914-2922.
[7]	张铭泉, 古志民, 张吉赞. 一种基于频繁值和位变换感知的数据总线节能方法[J]. 电子学报, 2017, 45(8): 1810-1817.
[8]	徐骥, 朱艺华, 田贤忠, 池凯凯. 无线传感器网络中利用随机网络编码的低能耗可靠机会路由[J]. 电子学报, 2016, 44(8): 1799-1805.
[9]	陈晓华, 李春芝, 陈良育, 曾振柄, 蒋云良. 虚拟网络映射高效节能运输模型及算法[J]. 电子学报, 2016, 44(3): 725-731.
[10]	邵星, 王翠香, 饶元. 基于跨层网络编码感知的无线传感器网络节能路由算法研究[J]. 电子学报, 2015, 43(12): 2484-2490.
[11]	黄永平, 郭凯, 金玉善. 调压式抽油机节能控制器的研究[J]. 电子学报, 2013, 41(4): 828-832.
[12]	朱艺华, 周标, 李燕君. 支持WiMAX节点灵活休眠的两阶段可靠多播策略[J]. 电子学报, 2012, 40(8): 1552-1557.
[13]	李建敦, 彭俊杰, 张武. 云存储中一种基于布局的虚拟磁盘节能调度方法[J]. 电子学报, 2012, 40(11): 2247-2254.
[14]	商云飞, 徐明伟, 李丹. 互联网路由设备与协议节能研究综述[J]. 电子学报, 2012, 40(11): 2290-2297.
[15]	金超;冯丹;刘景宁;田磊. RAID6编码的扩展算法及性能研究[J]. 电子学报, 2012, 40(1): 173-178.