一种面向Deep Web数据源的重复记录识别模型

申德荣;刘丽楠;寇月;聂铁铮;于戈

电子学报 ›› 2010, Vol. 38 ›› Issue (2) : 275-281.

PDF(2183 KB)
PDF(2183 KB)
电子学报 ›› 2010, Vol. 38 ›› Issue (2) : 275-281.
学术论文

一种面向Deep Web数据源的重复记录识别模型

  • 申德荣,刘丽楠,寇月,聂铁铮,于戈

作者信息 +

A Duplicate Records Identification Model for Deep Web Data Sources

  • SHEN De-rong, LIU Li-nan, KOU Yue, NIE Tie-zheng, YU Ge
Author information +
文章历史 +

摘要

重复记录是指描述现实世界中同一实体的不同的记录信息。由于从同一个领域的不同Deep Web数据源中抽取的记录信息通常存在许多重复记录,本文针对半结构化的重复记录的识别进行研究。在已知全局模式和全局模式与各Deep Web数据源查询接口映射关系的基础上,提出了一种重复记录识别模型。 基于从Deep Web中抽取出的半结构化的数据,采用查询探测方法确定所抽取数据所匹配的属性,通过分析抽取的实例数据确定属性重要度,结合多种相似度估算器和多种算法计算记录间的相似度,进而识别重复记录。实验表明,该重复记录识别模型在Deep Web环境下是可行且有效的。

Abstract

Duplicate records are multiple different records describing the same entity in the real world. Since some of the records extracted from different Deep Web sources in the same domain usually are duplicates, the paper focuses on duplicate records identification and a duplicate records identification model is proposed on the basis of known global schema and the relationship between the global schema and the interface attributes of each Deep Web data source. Based on the semi-structured data extracted from Deep Web data sources, the attributes that these data matching to are annotated by using a query probing method and the dominance of attributes of global schema is specified by analyzing these extracting instance data. Moreover, multiple estimators and multiple similarity algorithms are adopted to identify the duplicates. The experiment results show our duplicate record identification model is feasible and efficient.

关键词

重复记录 / 深层 web / 数据清洗

Key words

Duplicate records identification / deep web / data extraction

引用本文

导出引用
申德荣;刘丽楠;寇月;聂铁铮;于戈. 一种面向Deep Web数据源的重复记录识别模型[J]. 电子学报, 2010, 38(2): 275-281.
SHEN De-rong;LIU Li-nan;KOU Yue;NIE Tie-zheng;YU Ge. A Duplicate Records Identification Model for Deep Web Data Sources[J]. Acta Electronica Sinica, 2010, 38(2): 275-281.
中图分类号: tp391   
PDF(2183 KB)

2811

Accesses

0

Citation

Detail

段落导航
相关文章

/