基于项权值排序挖掘的跨语言查询扩展

doi:10.3969/j.issn.0372-2112.2020.03.021

电子学报 ›› 2020, Vol. 48 ›› Issue (3): 568-576.DOI: 10.3969/j.issn.0372-2112.2020.03.021

所属专题：自然语言处理技术

基于项权值排序挖掘的跨语言查询扩展

黄名选^1,2,3, 蒋曹清³

1. 广西跨境电商智能信息处理重点实验室(广西财经学院), 广西南宁 530003;
2. 广西财经学院广西(东盟)财经研究中心, 广西南宁 530003;
3. 广西财经学院信息与统计学院, 广西南宁 530003

收稿日期:2019-03-18 修回日期:2019-05-17 出版日期:2020-03-25
- 作者简介:
- 黄名选 男,1966年出生于广西乐业县,硕士,现为广西财经学院信息与统计学院教授,主要研究方向为数据挖掘、信息检索、机器学习,主持国家自然科学基金项目2项,主持完成广西自然科学基金项目1项,主持广西教育厅科研项目3项,获2011年广西高校优秀人才资助计划项目1项,参与完成国家自然科学基金项目1项,发表学术论文60余篇,其中,中文核心期刊论文40余篇,被期刊EI收录5篇,ISTP收录1篇,发明专利授权15件.E-mail:mingxh05@163.com;蒋曹清 男,1973年出生于湖南省永州市,博士,现为广西财经学院教授,主要研究方向为形式化方法,程序分析,数据挖掘.E-mail:jcqng@163.com
- 基金资助:
- 国家自然科学基金 (No.61762006，No.61662003）; 广西应用经济学一流学科 (培育）开放性课题 (No.2018MA07）; 广西 (东盟）财经研究中心开放性课题 (No.2018DMCJYB08）

Cross Language Query Expansion Based on Item Weight Sorting Mining

HUANG Ming-xuan^1,2,3, JIANG Cao-qing³

1. Guangxi Key Laboratory of Cross-border E-commerce Intelligent Information Processing, Guangxi University of Finance and Economics, Nanning, Guangxi 530003, China;
2. Guangxi (ASEAN) Financial Research Center, Guangxi University of Finance and Economics, Nanning, Guangxi 530003, China;
3. School of Information and Statistics, Guangxi University of Finance and Economics, Nanning, Guangxi 530003, China

Received:2019-03-18 Revised:2019-05-17 Online:2020-03-25 Published:2020-03-25
- Supported by:
- National Natural Science Foundation of China (No.61762006, No.61662003); Open (Cultivation) Project of Guangxi First-class Discipline Applied Economics Construction Project Fund (No.2018MA07); Open Project of Guangxi (ASEAN) Financial Research Center (No.2018DMCJYB08)

摘要/Abstract

摘要： 为了改善自然语言处理应用中长期存在的主题漂移和词不匹配问题，本文首先提出一种加权项集支持度计算方法和基于项权值排序的剪枝方法，给出面向查询扩展的基于项权值排序的加权关联规则挖掘算法，讨论关联规则混合扩展、后件扩展和前件扩展模型，最后提出基于项权值排序挖掘的跨语言查询扩展算法.该算法采用新的支持度和剪枝策略挖掘加权关联规则，根据扩展模型从规则中提取高质量扩展词实现跨语言查询扩展.实验结果表明，与现有基于加权关联规则挖掘的跨语言扩展算法比较，本文扩展算法能有效遏制查询主题漂移和词不匹配问题，可用于各种语言的信息检索以改善检索性能，扩展模型中后件扩展获得最优检索性能，混合扩展的检索性能不如后件扩展和前件扩展，支持度对后件扩展更有效，置信度更有利于提升前件扩展和混合扩展的检索性能.本文挖掘方法可用于文本挖掘、商务数据挖掘和推荐系统以提高其挖掘性能.

关键词: 自然语言处理, 文本挖掘, 信息检索, 跨语言检索, 查询扩展, 推荐系统

Abstract: To ameliorate the long-standing problems of theme drift and word mismatch in natural language processing applications, this paper first proposes a computing method for weighted itemset support and a pruning method based on item weight sorting (IWS). And then, a weighted association rule mining algorithm for query expansion is presented based on the IWS, and the models such as association rule antecedent and consequent hybrid expansion (RACHE), rule consequent expansion (RCE) along with rule antecedent expansion (RAE) are discussed. Finally, an algorithm of cross-language query expansion (CLQE) is put forward based on the IWS mining. The algorithm utilized the new support and the pruning method to mine the weighted association rules,and extracted high quality expansion terms from the rules according to the expansion models in order to carry out CLQE. A comparison between the proposed expansion algorithm and the existing CLQE algorithms based on weighted association rules mining is made, which shows that the former can effectively restrain the problems of query topic drift and word mismatch, and can be used in information retrieval in various languages to improve retrieval performance. The RCE achieves the optimal retrieval performance in the proposed expansion models, and the retrieval performance of the RACHE is not as good as that of the RAE and the RCE. The support is more effective for the RCE algorithm. The confidence can make the RAE and the RACHE get the best retrieval result. And moreover, the proposed mining method can be used in text mining, business data mining and recommendation system to improve its mining performance.

Key words: natural language processing, text mining, information retrieval, cross language retrieval, query expansion, recommendation system

中图分类号:

TP311

黄名选, 蒋曹清. 基于项权值排序挖掘的跨语言查询扩展[J]. 电子学报, 2020, 48(3): 568-576.

HUANG Ming-xuan, JIANG Cao-qing . Cross Language Query Expansion Based on Item Weight Sorting Mining[J]. Acta Electronica Sinica, 2020, 48(3): 568-576.

参考文献

[1] Ballesteros L,Croft W B.Phrasal translation and query expansion techniques for cross-language information retrieval[A].Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval[C].New York,NY,USA:ACM,1997.84-91.
[2] 吴丹,何大庆,王惠临.基于伪相关反馈的跨语言查询扩展[J].情报学报,2010,29(2):232-239. WU Dan,HE Daging,WANG Huilin.Cross-language query expansion using pseudo relevance feedback[J].Journal of the China Society for Scientific and Technical Information,2010,29(2):232-239.(in Chinese)
[3] Gaillard B,Bouraoui J L,Neef E G D,et al.Query expansion for cross language information retrieval improvement[A].Proceedings of the Fourth IEEE International Conference on Research Challenges in Information Science[C].Nice,France:IEEE,2010.337-342.
[4] 魏露,李书琴等.跨语言查询扩展优化[J].计算机工程与设计,2014,35(8):2785-2803. WEI Lu,LI Shu-qin,et al.Optimization of cross-language query expansion[J].Computer Engineering and Design,2014,35(8):2785-2803.(in Chinese)
[5] Cao G,Gao J,Nie J Y,et al.Extending query translation to cross-language query expansion with Markov chain models[A].Proceedings of the Sixteenth ACM Conference on Conference on Information and Knowledge Management[C].New York,NY,USA:ACM,2007.351-360.
[6] Agrawal A,Agrawal D A J.Improving performance of Hindi-English based cross language information retrieval using selective documents technique and query expansion[J].International Journal of Science and Research,2016,5(5):1964-1967.
[7] Tang P,Zhao J,Yu Z,et al.A method of Chinese and Thai cross-lingual query expansion based on comparable corpus[J].Journal of Information Processing Systems,2017,13(4):805-817.
[8] Geraldo A P,Moreira V P.UFRGS@CLEF2008:using association rules for cross-language information retrieval[A].Proceedings of the 9th Cross-Language Evaluation Forum Conference on Evaluating Systems for Multilingual and Multimodal Information Access[C].Berlin,Germany:Springer-Verlag,2009.66-74.
[9] 黄名选.完全加权模式挖掘与相关反馈融合的印尼汉跨语言查询扩展[J].小型微型计算机系统,2017,38(8):1783-1791. HUANG Ming-xuan.Indonesian-Chinese cross language query expansion based on all-weighted patterns mining and relevance feedback[J].Journal of Chinese Computer Systems,2017,38(8):1783-1791.(in Chinese)
[10] 黄名选,蒋曹清.基于完全加权正负关联模式挖掘的越-英跨语言查询译后扩展[J].电子学报,2018,46(12):3029-3036. HUANG Ming-xuan,JIANG Cao-qing.Vietnamese-English cross language query post-translation expansion based on all-weighted positive and negative association patterns mining[J].Acta Electronica Sinica,2018,46(12):3029-3036.(in Chinese)
[11] 黄名选.基于加权关联模式挖掘的越-英跨语言查询扩展[J].情报学报,2017,36(3):307-318. HUANG Ming-xuan.Vietnamese-English cross language query expansion based on weighted association patterns mining[J].Journal of the China Society for Scientific and Technical Information,2017,36(3):307-318.(in Chinese)
[12] 黄名选,蒋曹清,何冬蕾.基于矩阵加权关联规则的跨语言查询译后扩展[J].模式识别与人工智能,2018,31(10):887-898. HUANG Ming-xuan,JIANG Cao-qing,HE Dong-lei.Cross language query post-translation expansion based on matrix-weighted association rules[J].Pattern Recognition and Artificial Intelligence,2018,31(10):887-898.(in Chinese)
[13] 黄名选.基于矩阵加权关联模式的印尼中跨语言信息检索模型[J].数据分析与知识发现,2017(1):26-36. HUANG Ming-xuan.Indonesian-Chinese cross language information retrieval model based on matrix-weighted association patterns mining[J].Data Analysis and Knowledge Discovery,2017,1(1):26-35.(in Chinese)
[14] 周秀梅,黄名选.有效的矩阵加权正负关联规则挖掘算法——MWARM-SRCCCI[J].计算机应用,2015,34(10):2820-2826. ZHOU Xiu-mei,HUANG Ming-xuan.MWARM-SRCCCI:efficient algorithm for mining matrix-weighted positive and negative association rules[J].Journal of Computer Application,2015,34(10):2820-2826.(in Chinese)
[15] Salton G,Buckley C.Term-weighting approaches in automatic text retrieval[J].Information Processing & Management,1988,24(5):513-523.
[16] 周秀梅,黄名选.基于项权值变化的完全加权正负关联规则挖掘[J].电子学报,2015,43(8):1545-1554. ZHOU Xiu-mei,HUANG Ming-xuan.All-weighted positive and negative association rules mining based on dynamic item weight[J].Acta Electronica Sinica,2015,43(8):1545-1554.(in Chinese)

基于项权值排序挖掘的跨语言查询扩展

Cross Language Query Expansion Based on Item Weight Sorting Mining

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	曹阳, 高旻, 余俊良, 范琪琳, 荣文戈, 文俊浩. 基于双图混合随机游走的社会化推荐模型[J]. 电子学报, 2023, 51(2): 286-296.
[2]	皮德常, 吴致远, 曹建军. 基于知识图谱表示学习的谣言早期检测方法[J]. 电子学报, 2023, 51(2): 385-395.
[3]	张志昌, 于沛霖, 庞雅丽, 朱林, 曾扬扬. SMGN：用于对话状态跟踪的状态记忆图网络[J]. 电子学报, 2022, 50(8): 1851-1858.
[4]	杜晋华, 尹浩, 冯嵩. 中文电子病历命名实体识别的研究与进展[J]. 电子学报, 2022, 50(12): 3030-3053.
[5]	张帅, 高旻, 文俊浩, 熊庆宇, 唐旭. 基于自监督学习的去流行度偏差推荐方法[J]. 电子学报, 2022, 50(10): 2361-2371.
[6]	黄名选. 关联模式挖掘与词向量学习融合的伪相关反馈查询扩展[J]. 电子学报, 2021, 49(7): 1305-1313.
[7]	张昱, 刘开峰, 张全新, 王艳歌, 高凯龙. 基于组合-卷积神经网络的中文新闻文本分类[J]. 电子学报, 2021, 49(6): 1059-1067.
[8]	郑孝遥, 罗永龙, 汪祥舜, 孙丽萍, 陈付龙, 胡桂银, 汪小寒. 基于位置服务的分布式差分隐私推荐方法研究[J]. 电子学报, 2021, 49(1): 99-110.
[9]	郭景峰, 朱晓松, 李爽. 直播电视推荐系统的评分预测算法研究[J]. 电子学报, 2020, 48(9): 1735-1740.
[10]	杨启萌, 禹龙, 田生伟, 艾山·吾买尔. 基于深度强化学习的维吾尔语人称代词指代消解[J]. 电子学报, 2020, 48(6): 1077-1083.
[11]	马路遥, 夏博, 肖叶, 荀恩东. 面向句法结构的文本检索方法研究[J]. 电子学报, 2020, 48(5): 833-839.
[12]	吴玉佳, 李晶, 宋成芳, 常军. 基于高效用神经网络的文本分类方法[J]. 电子学报, 2020, 48(2): 279-284.
[13]	张志昌, 曾扬扬, 庞雅丽. 融合语义角色和自注意力机制的中文文本蕴含识别[J]. 电子学报, 2020, 48(11): 2162-2169.
[14]	刘露, 胡封晔, 牛亮, 彭涛. 异质网络中基于节点影响力的相似度度量方法[J]. 电子学报, 2019, 47(9): 1929-1936.
[15]	马慧芳, 刘文, 李志欣, 蔺想红. 融合耦合距离区分度和强类别特征的短文本相似度计算方法[J]. 电子学报, 2019, 47(6): 1331-1336.