物联网海量异构数据存储与共享策略研究

doi:10.3969/j.issn.0372-2112.2016.02.002

电子学报 ›› 2016, Vol. 44 ›› Issue (2): 247-257.DOI: 10.3969/j.issn.0372-2112.2016.02.002

物联网海量异构数据存储与共享策略研究

田野¹, 袁博¹, 李廷力²

1. 中国科学院计算机网络信息中心物联网信息中心, 北京 100190;
2. 北京百度网讯科技有限公司, 北京 100085

收稿日期:2014-04-23 修回日期:2015-08-26 出版日期:2016-02-25
- 通讯作者:
- 袁博
- 作者简介:
- 田野男,1979年出生,重庆涪陵人.博士,副研究员,硕士生导师,中国计算机学会高级会员.2006年博士毕业于中国科学院计算技术研究所,2009年进入中国科学院计算机网络信息中心.从事物联网、下一代互联网、网络安全方面的有关研究.E-mail:tianye@cnic.cn;李廷力 男,1987年出生,四川什邡人.2013年硕士毕业于中国科学院计算机网络信息中心.从事物联网信息处理方面的研究工作.
- 基金资助:
- 国家科技支撑计划 (No.2015BAK36B02); 国家发改委2012物联网技术研发产业化专项 (物联网标识管理公共服务平台); 中国科学院一三五规划重点培育方向 (No.CNIC_PY_1403)

A Massive and Heterogeneous Data Storage and Sharing Strategy for Internet of Things

TIAN Ye¹, YUAN Bo¹, LI Ting-li²

1. Computer Network Information Center, Chinese Academy of Science, Beijing 100190, China;
2. Beijing Baidu Netcom Science and Technology Company, Ltd, Beijing 100085, China

Received:2014-04-23 Revised:2015-08-26 Online:2016-02-25 Published:2016-02-25
- Supported by:
- National Key Technology Research and Development Program of the Ministry of Science and Technology (No.2015BAK36B02); National Development and Reform Commission 2012 Internet of Things Technology Research and Development Industrialization Project (China Internet of Things Names Service Platform); Key Cultivation Directions Fund of "One Three Five" Strategic Plan of the Chinese Academy of Sciences (No.CNIC_PY_1403)

摘要/Abstract

摘要：

随着物联网向各行业的深入发展,各行业的信息化进程也进入了快车道.信息服务作为物联网在各行业应用中重要的公共服务之一,一直受到广泛关注.然而,当前物联网信息服务系统面对物联网海量异构数据存在性能低下、共享困难等问题.因此,本文提出了一种基于NoSQL、REST以及国家物联网标识管理公共服务平台(NIOT)的存储与共享策略,并着重对该系统的构成、逻辑设计进行了详尽阐述.针对性能改进的策略设计了适当的量化评测,实验结果表明提出策略具有较好的效果,基于实验结果对进一步的优化进行了讨论.

关键词: 物联网, 海量异构数据, 信息服务系统, 数据存储, 数据共享

Abstract:

With the development of the Internet of Things (IoT), it accelerates the process of the informatization of all industries.Information service is an important service in the IoT.However, massive and heterogeneous data of the IoT brings the storage huge challenges to the information service.This paper proposes an IoT information service system to solve the current problem of the performance shortfalls and the difficulty of data sharing, which is based on NoSQL, REST and NIOT (National IOT id management and public service platform).The work focuses on improving the performance of the system and exploring the expression of storage and the sharing mechanism of the heterogeneous data.The test result shows that the solution proposed by this paper significantly enhanced the system performance.The relevant achievements of this paper provide reference for facilitating the development of the IoT information service system.

Key words: internet of things, massive and heterogeneous data, information service system, data storage, data sharing

中图分类号:

TP311

田野, 袁博, 李廷力. 物联网海量异构数据存储与共享策略研究[J]. 电子学报, 2016, 44(2): 247-257.

TIAN Ye, YUAN Bo, LI Ting-li . A Massive and Heterogeneous Data Storage and Sharing Strategy for Internet of Things[J]. Acta Electronica Sinica, 2016, 44(2): 247-257.

参考文献

[1] Li Tingli,Liu Yang,Tian Ye,et al.A storage solution for massive IoT data based on NoSQL[A].Proceedings of the 2012 IEEE International Conference on Internet of Things[C].USA:IEEE,2012.50-57.
[2] Zhang Yin,Han Weili,Wang Wei,et al.Optimizing the storage of massive electronic pedigrees in HDFS[A].Proceedings of the 3^rd International Conference on the Internet of Things[C].USA:IEEE,2012.68-75.
[3] Zhang Guigang,Li Chao,Zhang Yong,et al.SemanMedical:a kind of semantic medical monitoring system model based on the IoT sensors[A].Proceedings of the IEEE 14^th International Conference on e-Health Networking,Applications and Services[C].USA:IEEE,2012.238-243.
[4] L Paul,M Dirk,B Andre.HashFS:applying hashing to optimize file systems for small file reads[A].Proceedings of the International Workshop on Storage Network Architecture and Parallel I/Os[C].USA:IEEE,2010.33-42.
[5] Zhang Yang and Liu Dan.Improving the efficiency of storing for small files in HDFS[A].Proceedings of the International Conference on Computer Science & Service System[C].USA:IEEE,2012.2239-2242.
[6] Yang Hui,Qin Yong,Feng Gefei,et al.Online monitoring of geological CO2 storage and leakage based on wireless sensor networks[J].IEEE Sensors Journal,2013,13(2):556-562.
[7] Chang Penho,Wand Tsanpin.Supporting personal mobility with integrated RFID in VoIP systems[A].Proceedings of the International Conference on New Trends in Information and Service Science[C].USA:IEEE,2009.1353-1359.
[8] H Gonzalez,Han Jiawei,Li Xiaolei,et al.Warehousing and analyzing massive RFID data sets[A].Proceedings of the 22^nd International Conference on Data Engineering[C].USA:IEEE,2006.83.
[9] 丁治明,高需.面向物联网海量传感器采样数据管理的数据库集群系统框架[J].计算机学报,2012,35(6):2514-2517. Ding Zhiming,Gao Xu.A database cluster system framework for managing massive sensor sampling data in the Internet of things[J].Chines Journal of Computers,2012,35(6):2514-2517.(in Chinese)
[10] M D Francesco,Li Na,M Raj,et al.A storage infrastructure for heterogeneous and multimedia data in the Internet of things[A].Proceedings of the 2012 IEEE International Conference on Internet of Things[C].USA:IEEE,2012.26-33.
[11] A M Marìa,H L Sergio,S Abel,et al.A comparative study of data storage and processing architectures for the smart grid[A].Proceedings of the First IEEE International Conference on Smart Grid Communications[C].USA:IEEE,2010.285-290.
[12] Deng Zhongliang,Xu Binxu,Li Ning.A sharing platform based on the Internet of things[A].Proceedings of the International Conference on Computational Intelligence and Software Engineering[C].USA:IEEE,2010.1-4.
[13] IETF RFC 7252.Constrained application protocol (CoAP),2014[S].
[14] Gao Lei,Zhang Chunhong,Sun Li.RESTful web of things API in sharing sensor data[A].Proceedings of the International Conference on Internet Technology and Applications[C].USA:IEEE,2011.1-4.
[15] D Guinard,M Mueller,V Trifa.RESTifying Real-world Systems a Practical Case Study in RFID[M].Germany:Springer-Verlag,2011.359-379.
[16] Liu Yimeng,Wang Yizhi and Jin Yi.Research on the improvement of MongoDB auto-sharding in cloud environment[A].Proceedings of the 7^th International Conference on the Computer Science & Education[C].USA:IEEE,2012.851-854.
[17] Tian Ye,Liu Yang,Yan Zhiwei,et al.RNS-a publice resource name service platform for the IoT[A].Proceedings of the 2012 IEEE International Conference on Internet of Things[C].USA:IEEE,2012.234-239.
[18] 刘阳,李馨迟,田野,等.物联网名字服务关键技术研究[J].电子学报,2014,42(10):2032-2039. Liu Yang,Li Xinchi,Tian Ye,et al.Research on key technology of name service for the Internet of things[J].Acta Electronica Sinica,2014,42(10):2032-2039.(in Chinese)
[19] NIOT.国家物联网标识管理公共服务平台[OL].http://www.cniotroot.cn,2015.
[20] GS1 Standard Version 1.1.EPC information services (EPCIS) version 1.1,2014[S].
[21] Fan Chunxiao,Song Jie,Wen Zhigang,et al.A scalable Internet of things lean data provision architecture based on ontology[A].Proceedings of the IEEE GCC Conference and Exhibition[C].USA:IEEE,2011.553-556.
[22] Intel Berkeley Research Lab.Intel lab data.[OL].http://db.csail.mit.edu/labdata/labdata.html,2004
[23] University of Washington,CSE.The lahar project RFID data[OL].http://lahar.cs.washington.edu/displayPage.php?path=./content/Download/RFIDData/rfidData.html,2012.

物联网海量异构数据存储与共享策略研究

A Massive and Heterogeneous Data Storage and Sharing Strategy for Internet of Things

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	李玮, 张雨希, 谷大武, 张金煜, 朱晓铭, 刘春, 蔡天培, 李嘉耀. 轻量级密码MANTIS的唯密文故障分析[J]. 电子学报, 2022, 50(4): 967-976.
[2]	陈书仪, 刘亚丽, 林昌露, 李涛, 董永权. 面向物联网的轻量级可验证群组认证方案[J]. 电子学报, 2022, 50(4): 990-1001.
[3]	孟超, 周倩, 郭林, 王攀, 孙知信. 基于相关性传输模型的无线链路质量估计方法及路由优化算法[J]. 电子学报, 2022, 50(10): 2409-2424.
[4]	陈亮, 李峰, 任保全, 杨建喜. 软件定义物联网研究综述[J]. 电子学报, 2021, 49(5): 1019-1032.
[5]	张佳辰, 胡泽瑞, 赵盛, 施文杰, 王刚, 刘晓光. VMFS: 一种持久性内存统一管理系统[J]. 电子学报, 2021, 49(12): 2299-2306.
[6]	焦贤龙, 郭松涛, 黎勇, 李艳涛, 向朝参. 基于相继干扰消除和跨层并发传输的物联网数据聚合调度[J]. 电子学报, 2021, 49(10): 1982-1992.
[7]	蒋婵, 梁俊斌, 马方强, 李陶深. 移动低占空比传感网中基于分段拟合压缩的数据容灾存储算法[J]. 电子学报, 2020, 48(12): 2376-2383.
[8]	黄美根, 郁滨. 软件定义WSN规则一致更新研究[J]. 电子学报, 2019, 47(9): 1965-1971.
[9]	徐诚, 何杰, 张晓彤, 姚翠, 段世红, 齐悦. IMU/TOA融合人体运动追踪性能评估方法[J]. 电子学报, 2019, 47(8): 1748-1754.
[10]	王巍, 彭力, 赵继军, 常存喜, 黄晓丹, 田立勤. 移动物联网非完整约束中继的协同任务规划[J]. 电子学报, 2019, 47(6): 1251-1259.
[11]	李森森, 黄一才, 郁滨, 鲍博武. 基于PUF的低开销物联网安全通信方案[J]. 电子学报, 2019, 47(4): 812-817.
[12]	元铸, 谢平, 耿生玲. RAID系统扩容方案研究综述[J]. 电子学报, 2019, 47(11): 2420-2431.
[13]	唐晓庆, 谢桂辉, 佘亚军, 俞杨. 基于MCU的无源Wi-Fi散射通信方法[J]. 电子学报, 2019, 47(10): 2069-2075.
[14]	杨晓东, 陈益强, 于汉超, 张迎伟, 钟习, 胡子昂, 刘弘. 面向帕金森病的多模态异构协同感知方法[J]. 电子学报, 2018, 46(3): 659-664.
[15]	王巍, 赵继军, 彭力, 黄晓丹, 李林茂, 魏丁丁. 基于UAV的移动物联网远距离通信节能策略研究[J]. 电子学报, 2018, 46(12): 2914-2922.