电子学报 ›› 2012, Vol. 40 ›› Issue (4): 674-680.DOI: 10.3969/j.issn.0372-2112.2012.04.009

• 学术论文 • 上一篇    下一篇

基于RCSW的数据流速度异常检测算法研究

詹英1, 吴春明2, 王宝军1   

  1. 1. 浙江交通职业技术学院,浙江杭州 311112;2. 浙江大学系统工程研究所,浙江杭州 310027
  • 收稿日期:2010-07-01 修回日期:2010-09-01 出版日期:2012-04-25
    • 基金资助:
    • 浙江省自然科学基金 (No.Y1101133); 浙江省教育厅项目 (No.Y201018946)

An Algorithm for Data Stream Speed Anomaly Detection Based on RCSW

ZHAN Ying1, WU Chun-ming2, WANG Bao-jun1   

  1. 1. Zhejiang Institute of Communications,Hangzhou,Zhejiang 311112,China;2. Institute of Computer System Architecture,Zhejiang University,Hangzhou,Zhejiang 310027,China
  • Received:2010-07-01 Revised:2010-09-01 Online:2012-04-25 Published:2012-04-25

摘要: 目前许多应用领域产生数据流的流速不断地震荡,使得面向数据流的挖掘变得困难.系统采用RCSW来完成数据流抽取,提出了实时度T、关键时点集、数据流处理率的概念,并进一步提出了数据流速度异常检测算法.系统监控、预测数据流速,当数据流速异常减速或增速时,系统智能调节环形缓冲区和数据流处理率来应对异常,为解决数据流处理能力与流速、流量与有限空间之间的矛盾提供解决方案.实验表明数据流速度异常检测算法能够保证数据流的挖掘持续正常实施,最大程度的满足系统的实时性要求.

关键词: 数据流, 环形循环滑动窗口, 关键时点, 实时度T

Abstract: In many fields,data stream continues to grow in terms of generation speed,scale and vibration,which makes the data stream mining more difficult.RCSW is used in data stream mining to finish data steam sampling.The three concept such as real-time T,key time point set,data stream processing ratio are proposed.Then an algorithm for data stream speed anomaly detection is proposed,which monitor and predict flow velocity.The system intelligently adjust ring buffer and data stream processing ratio if there is excessive flow velocity,in order to solve the conflicts commendably between data processing power and flow velocity,throughput and limited memory.Experimental results show that it is an algorithm for data stream speed anomaly detection which can ensure normal execution of data stream mining and well meet the need of the system real-time.

Key words: data stream, ring circular sliding window (RCSW), time point, real-time T

中图分类号: