面向句法结构的文本检索方法研究

doi:10.3969/j.issn.0372-2112.2020.05.001

电子学报 ›› 2020, Vol. 48 ›› Issue (5): 833-839.DOI: 10.3969/j.issn.0372-2112.2020.05.001

• 学术论文 • 下一篇

面向句法结构的文本检索方法研究

马路遥, 夏博, 肖叶, 荀恩东

北京语言大学信息科学学院, 北京 100083

收稿日期:2019-09-10 修回日期:2020-01-06 出版日期:2020-05-25
- 通讯作者:
- 荀恩东
- 作者简介:
- 马路遥 女,硕士研究生,1994年出生.研究方向为自然语言处理.E-mail:maluyao_blcu@outlook.com;肖叶女,硕士研究生,1996年出生,研究方向为自然语言处理.E-mail:blcuxiao@126.com;夏博男,硕士,1993年出生,研究方向为计算机网络,自然语言处理.E-mail:blcuxiabo@126.com
- 基金资助:
- 国家社会科学基金重点项目 (No.16AYY007）; 北京市语言资源高精尖创新中心科研项目 (No.TYR17001J）; 北京语言大学研究生创新基金 (No.19YCX118）

Structural Retrieval on Chinese Syntax Tree Corpus

MA Lu-yao, XIA Bo, XIAO Ye, XUN En-dong

Beijing Language and Culture University, School of Information Science, Beijing 100083, China

Received:2019-09-10 Revised:2020-01-06 Online:2020-05-25 Published:2020-05-25
- Corresponding author:
- XUN En-dong
- Supported by:
- The National Social Science Fund of China (No.16AYY007); Research Program of Beijing Advanced Innovation Center for language Recourses (No.TYR17001J); Postgraduate Innovation Fund Project of Beijing Language and Culture University (No.19YCX118)

摘要/Abstract

摘要： 语言资源加工和语言学研究，对大规模树库的结构化检索有很高需求.本文针对句法树语料设计了索引、检索方法.针对汉语的特点以及知识抽取任务的需求，我们设计了七种索引结构，旨在借助句法树的结构、属性信息，进行高效、准确的知识抽取.本方法不仅支持字符串检索、属性检索，也支持基于句法树结构、属性信息的检索.实验证明，本方法高效、准确.

关键词: 句法树语料, 知识抽取, 信息检索, 语言资源

Abstract: Language resource processing and linguistics research require effective retrieval on syntax tree corpus. This paper presented an index and search method for syntax tree corpus, which is efficient, accurate, and flexible. Based on the features of Chinese language and the needs for knowledge extraction, we designed seven types of indexes, aiming that with the help of structure and attribute information, knowledge extraction will be performed more effectively and accurately. Apart from general retrieval functions, our method supports retrieval based on the structure and attribute information of syntax trees. Experiments show that our method is both accurate and efficient.

Key words: syntax tree corpus, knowledge extraction, information retrieval, language resource

中图分类号:

TP391.12

马路遥, 夏博, 肖叶, 等. 面向句法结构的文本检索方法研究[J]. 电子学报, 2020, 48(5): 833-839.

MA Lu-yao, XIA Bo, XIAO Ye, et al. Structural Retrieval on Chinese Syntax Tree Corpus[J]. Acta Electronica Sinica, 2020, 48(5): 833-839.

参考文献

[1] 俞士汶,段慧明,等.北京大学现代汉语语料库基本加工规范[J].中文信息学报,2002,16(5):49-64.
[2] 国家语委语言文字应用研究所计算语言学研究室.信息处理用现代汉语词类标记集规范[J].语言文字应用,2001(3):16-20.
[3] 荀恩东,饶高琦,等.大数据背景下BCC语料库的研制[J].语料库语言学,2016,3(1):93-118.
[4] 国家语言资源监测与研究平面媒体中心.动态流通语料库使用帮助[Z/OL].http://dcc.blcu.edu.cn/explain.jsp,2015-05-19.
[5] 黄居人,陈克健.中央研究院平衡语料库检索系统使用说明[R].台湾:中央研究院,1998.
[6] Nikita Kitaev,et al.Constituency parsing with a self-attentive encoder[A].Proceedings of the 2018 Annual Meeting of the Association for Computational Linguistics[C].Melbourne,Australia:Association for Computational Linguistics,2018.2676-2686.
[7] Daniel Fried,et al.Improving neural parsing by disentangling model combination and reranking effects[A].Proceedings of the 2017 Annual Meeting of the Association for Computational Linguistics[C].Vancouver,Canada:Association for Computational Linguistics,2017.161-166.
[8] Sabine Brants,et al.TIGER:Linguistic interpretation of a german corpus[J].Research on Language and Computation,2004,2(4):597-620.
[9] L T Rohde,Douglas.Tgrep2 user manual[Z/OL].https://web.stanford.edu/dept/linguistics/corpora/cas-tut-tgrep.html.2004.
[10] Roger Levy,et al.Tregex and Tsurgeon:tools for querying and manipulating tree data structures[A].Proceedings of International Conference on Language Resources and Evaluation[C].Genoa,Italy:European Language Resources Association.2006.2231-2234
[11] Juhani Luotolahti,et al.SETS:Scalable andefficient tree search in dependency graphs[A].Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics[C].Denver,Colorado:Association for Computational Linguistics.2015.51-55.
[12] Juhani Luotolahti,et al.Dep search:Efficientsearch tool for large dependency parsebanks[A].Proceedings of the 2017 Nordic Conference of Computational Linguistics[C].Gothenburg,Sweden:Linkoping University Electronic Press.2017.255-258.
[13] Lai,C,Bird,S.Querying and updating treebanks:a critical survey and requirements analysis[A].Proceedings of the Australasian Language Technology Work-shop[C].Sydney,Australia:Australasian Language Technology Association.2004.139-146.
[14] Ji í Mírovský.PDT 2.0 Requirements on a query language[A].Proceedings of the 2008 Annual Meeting of the Association for Computational Linguistics:Human Language Technology[C].Columbus,Ohio,USA:Association for Computational Linguistics.2008.37-45
[15] Salton Gerard.A Theory of Indexing[M].Cambridge University Press,1975.41-48.
[16] Christopher D.Manning,et al.Anintroduction to information retrieval[M/OL].https://nlp.stanford.edu/IR-book/,2009.
[17] Xue Nianwen,et al.The penn chinese treebank:phrase structure annotation of a large corpus[J].Natural Language Engineering,2005,11(2).207-238.

面向句法结构的文本检索方法研究

Structural Retrieval on Chinese Syntax Tree Corpus

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	黄名选. 关联模式挖掘与词向量学习融合的伪相关反馈查询扩展[J]. 电子学报, 2021, 49(7): 1305-1313.
[2]	黄名选, 蒋曹清. 基于项权值排序挖掘的跨语言查询扩展[J]. 电子学报, 2020, 48(3): 568-576.
[3]	黄名选, 蒋曹清. 基于完全加权正负关联模式挖掘的越-英跨语言查询译后扩展[J]. 电子学报, 2018, 46(12): 3029-3036.
[4]	张维维, 陈喆, 殷福亮, 张俊星. 复调音乐主旋律提取方法综述[J]. 电子学报, 2017, 45(4): 1000-1011.
[5]	田萱, 张骁, 孟祥光, 陈志泊. 时间敏感查询词补全关键技术研究综述[J]. 电子学报, 2015, 43(6): 1160-1168.
[6]	乔亚男;齐勇. 查询语义图辅助的信息检索性能预测模型[J]. 电子学报, 2011, 39(3A): 158-162.
[7]	黄震华;向阳;林琛. 有效降低分布式SKYLINE查询网络传输代价[J]. 电子学报, 2010, 38(4): 848-0852.
[8]	赖冠辉, 王晓博, 刘超. 代码与文档间关联关系的提取方法研究和改进[J]. 电子学报, 2009, 37(S1): 22-30.
[9]	刘怡, 蔚磊, 刘子利, 王鹏. 中国民歌地域风格分类中的特征选择[J]. 电子学报, 2008, 36(S1): 152-156.
[10]	李新叶;苑津莎. 一种快速的XML语义检索算法[J]. 电子学报, 2007, 35(11): 2220-2225.
[11]	刘辉, 麻志毅, 和云峰, 邵维忠. 一种用况模型中的相似事件流检测算法[J]. 电子学报, 2006, 34(S1): 2366-2370.
[12]	陆建江, 徐宝文, 康达周, 李言辉, . 概念的最小上近似[J]. 电子学报, 2006, 34(5): 845-851.
[13]	彭波, 李晓明. 搜索引擎倒排文件的一种分块组织技术[J]. 电子学报, 2005, 33(2): 358-362.
[14]	韩立新. 对搜索引擎中评分方法的研究[J]. 电子学报, 2005, 33(11): 2094-2096.
[15]	吴劲, 陈泽琳. 基于部分匹配的XML文本文档向量检索模型[J]. 电子学报, 2002, 30(S1): 2169-2171.