A Kind of New Routing Algorithm with Adaptivity for Mobile IOT Based on Q-Learning
ZHANG De-gan1,2, GE Hui1,2, LIU Xiao-huan1,2, ZHANG Xiao-dan3, LI Wen-bin1,2
1. Tianjin Key Lab of Intelligent Computing & Novel Software Technology, Tianjin University of Technology, Tianjin 300384, China;
2. Key Laboratory of Computer Vision and System(Tianjin University of Technology), Ministry of Education, Tianjin University of Technology, Tianjin 300384, China;
3. Institute of Institute of Scientific and Technical Information of China, Beijing 100038, China
Abstract：In order to solve the routing problem of mobile IOT (IOV),based on our analyzing the details about motion characteristics of the vehicle and the reasons that cause links down,we set up link model of the duration time and using the duration time as key parameter to design the new routing method.Q-Learning as a kind of heuristic machine learning strategy is able to dynamically adjust the routing path through interaction with the surrounding environment.So a kind of new routing algorithm with adaptivity for mobile IOT based on Q-learning has been presented in this paper.It distributes the learning task into each vehicle node and maintains the reliable routing path by continuously exchanging the beacon information with the neighbor nodes.With the NS-2 simulator,the performance of the algorithm is tested.The results show that it has better performances on delivery,end-to-end delay and average hops in many mobile applications.
张德干, 葛辉, 刘晓欢, 张晓丹, 李文斌. 一种基于Q-Learning策略的自适应移动物联网路由新算法[J]. 电子学报, 2018, 46(10): 2325-2332.
ZHANG De-gan, GE Hui, LIU Xiao-huan, ZHANG Xiao-dan, LI Wen-bin. A Kind of New Routing Algorithm with Adaptivity for Mobile IOT Based on Q-Learning. Acta Electronica Sinica, 2018, 46(10): 2325-2332.
[1] Namboodiri V,Gao L.Prediction-based routing for vehicular ad hoc networks[J].IEEE Transactions on Vehicular Technology,2007,56(4):2332-2345.
[2] Zhang D G.A new approach and system for attentive mobile learning based on seamless migration[J].Applied Intelligence,2012,36(1):75-89.
[3] Liu S.Novel unequal clustering routing protocol considering energy balancing based on network partition & distance for mobile education[J].Journal of Network and Computer Applications,2017,88(15):1-9.
[4] Ma Z.A novel compressive sensing method based on SVD sparse random measurement matrix in wireless sensor network[J].Engineering Computations,2016,33(8):2448-2462.
[5] Zhang X D.Design and implementation of embedded un-interruptible power supply system (EUPSS) for web-based mobile application[J].Enterprise Information Systems,2012,6(4):473-489.
[6] Song X D.Extended AODV routing method based on distributed minimum transmission (DMT) for WSN[J].International Journal of Electronics and Communications,2015,69(1):371-381.
[7] Zhao C P.A new medium access control protocol based on perceived data reliability and spatial correlation in wireless sensor network[J].Computers & Electrical Engineering,2012,38(3):694-702.
[8] Zhang D G,Liang Y P.A kind of novel method of service-aware computing for uncertain mobile applications[J].Mathematical and Computer Modelling,2013,57(3-4):344-356.
[9] Zhang D G,Li G.An energy-balanced routing method based on forward-aware factor for wireless sensor network[J].IEEE Transactions on Industrial Informatics,2014,10(1):766-773.
[10] Ma Z.Shadow detection of moving objects based on multisource information in internet of things[J].Journal of Experimental & Theoretical Artificial Intelligence,2017,29(3):649-661.
[11] Zhang D G.A novel image de-noising method based on spherical coordinates system[J].EURASIP Journal on Advances in Signal Processing,2012,2012(110):1-10.DOI:10.1186/1687-6180-2012-110.
[12] Eiza M H.An evolving graph-based reliable routing scheme for VANETs[J].IEEE Transactions on Vehicular Technology,2013,62(4):1493-1504.
[13] Yan G J,Olariu S.A probabilistic analysis of link duration in vehicular ad hoc networks[J].IEEE Transactions on Intelligent Transportation Systems,2011,12(5):41227-41236.
[14] 张德干.基于局域世界的WSN拓扑加权演化模型[J].电子学报,2012,40(5):1000-1004. ZHANG De-gan.Local-world weighted topology evolving model for wireless sensor networks[J].Acta Electronica Sinica,2012,40(5):1000-1004.(in Chinese)
[15] 钟远.一种不可信环境下的匿名位置辅助路由激励机制[J].电子学报,2013,41(3):475-480. ZHONG Yuan.An anonymous incentive mechanism for location-aided routing in untrusted MANET scenarios[J].Acta Electronica Sinica,2013,41(3):475-480.(in Chinese)
[16] 张德干.一种基于前向感知因子的WSN能量均衡路由方法[J].电子学报,2014,42(1):113-118. ZHANG De-gan.A kind of routing protocol based on forward-aware factor for energy balance[J].Acta Electronica Sinica,2014,42(1):113-118.(in Chinese)
[17] Zhang D G.A novel approach to mapped correlation of ID for RFID anti-collision[J].IEEE Transactions on Services Computing,2014,7(4):741-748.
[18] Zhu Y N.A new constructing approach for a weighted topology of wireless sensor networks based on local-world theory for the internet of things (IOT)[J].Computers & Mathematics with Applications,2012,64(5):1044-1055.
[19] Song X D.New agent-based proactive migration method and system for big data environment (BDE)[J].Engineering Computations,2015,32(8):2443-2466.
[20] Zhang D G.A kind of novel VPF-based energy-balanced routing strategy for wireless mesh network[J].International Journal of Communication Systems,2017,30(6):1-15.
[21] Wang X.New clustering routing method based on PECE for WSN[J].EURASIP Journal on Wireless Communications and Networking,2015,2015(162):1-13.DOI:10.1186/s13638-015-0399-x.
[22] Zheng K.Novel quick start (QS) method for optimization of TCP[J].Wireless Networks,2016,22(1):211-222.
[23] Zheng K.A novel multicast routing method with minimum transmission for WSN of cloud computing service[J].Soft Computing,2015,19(7):1817-1827.
2018, Vol. 46 
