云存储中一种基于布局的虚拟磁盘节能调度方法

doi:10.3969/j.issn.0372-2112.2012.11.017

电子学报 ›› 2012, Vol. 40 ›› Issue (11): 2247-2254.DOI: 10.3969/j.issn.0372-2112.2012.11.017

云存储中一种基于布局的虚拟磁盘节能调度方法

李建敦^1,2, 彭俊杰¹, 张武^1,3

1. 上海大学计算机工程与科学学院,上海 200072;
2. 上海电机学院电子信息学院,上海 201306;
3. 上海大学高性能计算中心,上海 200072

收稿日期:2011-11-21 修回日期:2012-05-16 出版日期:2012-11-25
- 作者简介:
- 李建敦 男,1982年11月出生,河北张家口人.2005年毕业于河北经贸大学信息技术学院,取得工学学士学位;随后考入上海大学计算机工程与科学学院,2011年博士毕业;现为上海电机学院电子信息学院教师,从事高性能计算与云计算等方面的研究. E-mail:jdli@shu.edu.cn 彭俊杰 男,1977年1月出生,湖北红安人.副教授,硕士生导师.1999年、2001年和2005年在哈尔滨工业大学分别获工学学士、硕士和博士学位.现为上海大学计算机学院高性能计算研究室主任.主要从事云计算、物联网、光学计算及嵌入式系统等相关领域的研究工作. E-mail:jjie.peng@shu.edu.cn 张武 男,1957年11月出生,江西武宁人.教授,博士生导师.1988年于西北工业大学获博士学位.现为上海大学计算机学院执行院长,上海大学高性能计算中心主任.主要从事高性能计算与应用及生物信息学等领域的研究工作. E-mail:wzhang@shu.edu.cn
- 基金资助:
- 国家自然科学基金 (No.61103054); 教育部博士点基金 (No.20113108120022); 上海市重点学科 (No.J50103); 上海市科委重点项目 (No.11510500300)

A Layout-Based Energy-Aware Approach for Virtual Disk Scheduling in Cloud Storage

LI Jian-dun^1,2, PENG Jun-jie¹, ZHANG Wu^1,3

1. School of Computer Engineering & Science,Shanghai University,Shanghai 200072,China;
2. Electronics Information School,Shanghai Dianji University,Shanghai 201306,China;
3. High Performance Computing Center,Shanghai University,Shanghai 200072,China

Received:2011-11-21 Revised:2012-05-16 Online:2012-11-25 Published:2012-11-25
- Supported by:
- National Natural Science Foundation of China (No.61103054); Ph.D. Programs Foundation of Ministry of Education of China (No.20113108120022); Shanghai key disciplines (No.J50103); Key Project of Shanghai Science and Technology Commission (No.11510500300)

摘要/Abstract

摘要： 在云存储中,如何有效地调度用户请求到目标磁盘以实现绿色节能存储是一个热点问题.鉴于云存储对节能调度算法提出的新要求,如请求响应时间敏感与对动态优化的限制等,本文提出了一种基于布局的虚拟磁盘节能调度方法.该方法将磁盘阵列动态划分为工作区与就绪区,以工作区为主向用户分发资源,并以未连接虚拟机的虚拟磁盘为单位,根据实时负载情况对虚拟磁盘布局进行动态优化.实验结果表明,这种方法不仅能够降低磁盘阵列的能耗,而且能够有效地缓解响应时间延长的问题,还能够使虚拟磁盘布局达到更高的负载均衡水平.

关键词: 云计算, 云存储, 虚拟磁盘, 节能调度, 负载均衡

Abstract: In cloud storage,how to effectively schedule user’s request to specific disk becomes to be a hot topic.Considering the new requirements related to energy-aware scheduling algorithms proposed by cloud storage,e.g.sensitivity to request’s response time and limited space left for dynamic optimization,this paper proposes a layout-based scheduling approach for virtual disks.The disk array is dynamically partitioned into two sets,working set and standby set respectively using this approach,and requests are mainly addressed by working set.Additionally,according to real-time workloads,the layout of virtual disks is optimized with standalone virtual disk as a unit.Results of experiments show that this approach can cut down the power of disk array,effectively alleviate the problem of prolonged response time,and achieve higher level of load balancing.

Key words: cloud computing, cloud storage, virtual disk, energy-aware scheduling, load balancing

中图分类号:

TP301

李建敦, 彭俊杰, 张武. 云存储中一种基于布局的虚拟磁盘节能调度方法[J]. 电子学报, 2012, 40(11): 2247-2254.

LI Jian-dun, PENG Jun-jie, ZHANG Wu. A Layout-Based Energy-Aware Approach for Virtual Disk Scheduling in Cloud Storage[J]. Acta Electronica Sinica, 2012, 40(11): 2247-2254.

参考文献

[1] M Armbrust,A Fox,R Griffith,A D Joseph,R H Katz,A Konwinski,G Lee,D A Patterson,A Rabkin,I Stoica,M Zaharia.Above the Clouds:A Berkeley View of Cloud Computing .Berkeley,California,USA:University of California at Berkley,2009.1-23.
[2] 李建江,崔健,王聃,严林,黄义双.MapReduce并行编程模型研究综述[J].电子学报,2011,39(11):2635-2642. LI Jian-jiang,CUI Jian,WANG Dan,YAN Lin,HUANG Yi-shuang.Survey of MapReduce parallel programming model[J].Acta Electronica Sinica,2011,39(11):2635-2642.(in Chinese)
[3] I Foster,Y Zhao,I Raicu,S Lu.Cloud computing and grid computing 360-degree compared .Proceedings of Grid Computing Environments Workshop .Washington,DC:IEEE Computer Society,2008.1-10.
[4] J D Li,W Zhang,J J Peng,Z Lei,Y Lei.A carbon 2.0 framework based on cloud computing .Proceedings of 2010 International Conference on Information Systems .Washington,DC:IEEE Computer Society,2010.153-158.
[5] A Berl,E Gelenbe,M D Girolamo,G Giuliani,D H Meer,M Q Dang,K Pentikousis.Energy-efficient cloud computing[J].The Computer Journal,2010,53(7):1045-1051.
[6] F S Chu,K C Chen,C M Cheng.Toward green cloud computing .Proceedings of the 5th International Conference on Ubiquitous Information Management and Communication .New York:ACM,2011.1-5.
[7] K D Bowers,A Juels,A Oprea.HAIL:a high-availability and integrity layer for cloud storage .Proceedings of the 16th ACM Conference on Computer and Communications Security .New York:ACM,2009.187-198.
[8] 吴吉义,傅建庆,平玲娣,谢琪.一种对等结构的云存储系统研究[J].电子学报,2011,39(5):1100-1107. WU Ji-yi,FU Jian-qing,PING Ling-di,XIE Qi.Study on the P2P cloud storage system[J].Acta Electronica Sinica,2011,39(5):1100-1107.(in Chinese)
[9] 孙大为,常桂然,李凤云,王川,王兴伟.一种基于免疫克隆的偏好多维QoS云资源调度优化算法[J].电子学报,2011,39(8):1824-1831. SUN Da-wei,CHANG Gui-ran,LI Feng-yun,WANG Chuan,WANG Xing-wei.Optimizing multi-dimensional QoS cloud resource scheduling by immune clonal with preference[J].Acta Electronica Sinica,2011,39(8):1824-1831.(in Chinese)
[10] D Colarelli,D Grunwald.Massive arrays of idle disks for storage archives .Proceedings of the 2002 ACM/IEEE Conference on Supercomputing .Washington,DC:IEEE Computer Society,2002.1-11.
[11] E Pinheiro,R Bianchini.Energy conservation techniques for disk array-based servers .Proceedings of the 18th Annual ACM International Conference on Supercomputing .New York:ACM,2004.68-78.
[12] Q Zhu,Z Chen,L Tan,Y Zhou,K Keeton,J Wilkes.Hibernator:helping disk arrays sleep through the winter .Proceedings of the 20th ACM Symposium on Operating Systems Principles .New York:ACM,2005.177-190.
[13] D Narayanan,A Donnelly,A Rowstron.Write off-loading:practical power management for enterprise storage .Proceedings of the 6th USENIX Conference on File and Storage Technologies .New York:ACM,2008.253-267.
[14] E Y Chung,L Benini,A Bogliolo,Y H Lu,G D Micheli.Dynamic power management for nonstationary service requests[J].IEEE Transactions on Computing,2002,51(11):1345-1361.
[15] E Pinheiro,R Bianchini,C Dubnicki.Exploiting redundancy to conserve energy in storage systems .Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems .New York:ACM,2006.15-26.
[16] D Li,J Wang.Eeraid:energy efficient redundant and inexpensive disk array .Proceedings of the 11th ACM SIGOPS European Workshop .New York:ACM,2004.29-es.
[17] X Yao,J Wang.Rimac:A novel redundancy-based hierarchical cache architecture for energy efficient,high performance storage systems .Proceedings of 1st ACM SIGOPS/EuroSys European Conference on Computer Systems .New York:ACM,2006.249-262.
[18] K M Greenan,D D E Long,E L Miller,T J E Schwarz,J J Wylie.A spin-up saved is energy earned:Achieving power-efficient,erasure-coded storage .Proceedings of 4th Workshop on Hot Topics in System Dependability .Berkeley,CA:USENIX Association Berkeley,2008.1-6.
[19] C Weddle,M Oldham,J Qian,A A Wang.Paraid:a gear-shifting power-aware raid[J].ACM Transactions on Storage (TOS),2007,3(3):13:1-13:33.
[20] Q Zhu,F M David,C F Devara,Z Li,Y Zhou,P Cao.Reducing energy consumption of disk storage using power-aware cache management .Proceedings of the 10th International Symposium on High Performance Computer Architecture .Washington,DC:IEEE Computer Society,2004.118-129.
[21] S D Carson,S Setia.Analysis of the periodic update write policy for disk cache .IEEE Transactions on Software Engineering,1992,18(1):44-54.
[22] J C Mogul.A better update policy .Proceedings of the USENIX Summer Technical Conference .Berkeley,CA:USENIX,1994.99-111.
[23] F Douglis,P Krishnan,B N Bershad.Adaptive disk spin-down policies for mobile computers .Proceedings of the 2nd Symposium on Mobile and Location-Independent Computing .Berkeley,CA:USENIX,1995.121-137.
[24] R Golding,P Bosch,C Staelin,T Sullivan,J Wilkes.Idleness is not sloth .Proceedings of the USENIX Winter Technical Conference .Berkeley,CA:USENIX Association Berkeley,1995.201-212.
[25] E Y Chung,L Benini,G D Micheli.Dynamic power management using adaptive learning tree .Proceedings of the 1999 IEEE/ACM International Conference on Computer-Aided Design .Washington,DC:IEEE Computer Society,1999.274-279.
[26] C H Hwang,A C H Wu.A predictive system shutdown method for energy saving of event-driven computation[J].ACM Transactions on Design Automation of Electronic Systems,2000,5(2):226-241.
[27] M B Srivastava,A P Chandrakasan,R W Brodersen.Predictive system shutdown and other architectural techniques for energy efficient programmable computation[J].IEEE Transactions on Very Large Scale Integration Systems,1996,4(1):42-55.
[28] A E Papathanasiou,M L Scott.Energy effcient prefetching and caching .Proceedings of the USENIX Annual Technical Conference .Berkeley,CA:USENIX Association Berkeley,2004.255-268.
[29] Y H Lu,E Y Chung,T Simunic,L Benini,G D Micheli.Quantitative comparison of power management algorithms .Proceedings of the Conference on Design,Automation and Test in Europe .Washington,DC:IEEE Computer Society,2000.20-26.
[30] J Stoess,C Lang,F Bellosa.Energy management for hypervisor-based virtual machines .Proceedings of the USENIX Annual Technical Conference .Berkeley,CA:USENIX Association Berkeley,2007.1-14.
[31] L Ye,G Lu,S Kumar,C Gniady,J H Hartman.Energy-effcient storage in virtual machine environments .Proceedings of the 2010 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments .New York:ACM,2010.75-84.
[32] Barracuda 7200.12 Serial ATA.Seagate Product Manual[S].2010.
[33] Round-robin (RR) on Wikipedia .http://en.wikipedia.org/wiki/Round-robin_scheduling.2012.
[34] Greedy on Wikipedia .http://en.wikipedia.org/wiki/Greedy_algorithm.2012.
[35] D Nurmi,R Wolski,C Grzegorczyk,G Obertelli,S S oman,L Youseff,D Zagorodnov.The eucalyptus open-Source cloud-computing system .Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid .Washington,DC:IEEE Computer Scoiety,2009.124-131.

云存储中一种基于布局的虚拟磁盘节能调度方法

A Layout-Based Energy-Aware Approach for Virtual Disk Scheduling in Cloud Storage

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	刘焕淋, 胡俊岭, 任杰, 胡会霞, 唐畅, 陈浩楠. 基于光路负载均衡和邻域匹配的串扰感知资源分配方法[J]. 电子学报, 2022, 50(11): 2746-2753.
[2]	刘耿耿, 李泽鹏, 郭文忠, 陈国龙, 徐宁. 面向超大规模集成电路物理设计的通孔感知的并行层分配算法[J]. 电子学报, 2022, 50(11): 2575-2583.
[3]	任正伟, 李雪婷, 王丽娜, 童言, 徐士伟, 丁炜. 云存储中外包数据确定性删除研究综述[J]. 电子学报, 2022, 50(10): 2542-2560.
[4]	罗智勇, 朱梓豪, 谢志强, 孙广路. 面向云计算的花朵差分授粉工作流多目标优化算法研究[J]. 电子学报, 2021, 49(3): 470-476.
[5]	崔子熙, 胡宇翔, 兰巨龙, 王雨. 基于流分类的数据中心网络负载均衡机制[J]. 电子学报, 2021, 49(3): 559-565.
[6]	王宁远, 刘亮, 陈东, 刘欢, 郝时光. 低轨巨星座多品类业务流低复杂度分段路由方法[J]. 电子学报, 2021, 49(11): 2124-2132.
[7]	江小玉, 李贵洋, 周悦, 胡金平, 李慧. 基于负载均衡的纠删码修复流水线[J]. 电子学报, 2020, 48(5): 930-936.
[8]	王亚文, 郭云飞, 刘文彦, 霍树民, 杨超. 面向云存储安全的可自愈拜占庭Quorum系统[J]. 电子学报, 2020, 48(4): 675-681.
[9]	李航, 冯朝胜, 刘帅南, 刘彬, 赵开强. 支持离线/在线加密及可验证外包解密的CP-WABE方案[J]. 电子学报, 2020, 48(11): 2146-2153.
[10]	杜瑞忠, 石朋亮, 田俊峰. 基于DDCT表的多副本完整性审计方案[J]. 电子学报, 2020, 48(1): 164-171.
[11]	李建江, 马占宁, 张凯. 一种基于内容分块的层次化去冗优化策略[J]. 电子学报, 2019, 47(5): 1094-1100.
[12]	刘焕淋, 胡浩, 陈勇, 杜君丹, 向敏. 联合能耗与负载均衡的虚拟网络映射方法[J]. 电子学报, 2019, 47(12): 2488-2494.
[13]	黄建洋, 兰巨龙, 胡宇翔, 马腾. 一种基于分段路由的多路径流传输机制[J]. 电子学报, 2018, 46(6): 1488-1495.
[14]	卢晶, 段勇, 刘海波. 基于z值的分布式密度峰值聚类算法[J]. 电子学报, 2018, 46(3): 730-738.
[15]	胡涛, 张建辉, 邬江, 何为伟, 江逸茗, 赵伟. SDN中基于分布式决策的控制器负载均衡机制[J]. 电子学报, 2018, 46(10): 2316-2324.