基于加权超图随机游走的文献关键词提取算法

doi:10.3969/j.issn.0372-2112.2018.06.020

电子学报 ›› 2018, Vol. 46 ›› Issue (6): 1410-1414.DOI: 10.3969/j.issn.0372-2112.2018.06.020

基于加权超图随机游走的文献关键词提取算法

马慧芳, 刘芳, 夏琴, 郝占军

西北师范大学计算机科学与工程学院, 甘肃兰州 730070

收稿日期:2017-01-23 修回日期:2017-07-20 出版日期:2018-06-25
- 作者简介:
- 马慧芳,女,1981年7月出生,甘肃兰州人.博士,硕士生导师,现为西北师范大学计算机科学与工程学院副教授.研究领域为人工智能,数据挖掘与机器学习.E-mail:mahuifang@yeah.net;刘芳,女,1996年12月出生,甘肃平凉人.现为西北师范大学计算机科学与工程学院本科生.研究方向为文本挖掘.E-mail:1554216090@qq.com
- 基金资助:
- 国家自然科学基金 (No.61762078，No.61363058，No.61762079，No.61762080）; 中科院智能信息处理重点实验室开放课题 (No.IIP2014-4）; 广西可信软件重点实验室研究课题 (No.kx201705）

Keywords Extraction Algorithm Based on Weighted Hypergraph Random Walk

MA Hui-fang, LIU Fang, XIA Qin, HAO Zhan-jun

College of Computer Science and Engineering, Northwest Normal University, Lanzhou, Gansu 730070, China

Received:2017-01-23 Revised:2017-07-20 Online:2018-06-25 Published:2018-06-25
- Supported by:
- National Natural Science Foundation of China (No.61762078, No.61363058, No.61762079, No.61762080); Open Project of Key Laboratory of Intelligent Information Processing of Institute of Computing Technology, CAS (No.IIP2014-4); Research Project of Guangxi Key Laboratory of Trusted Software (No.kx201705)

摘要/Abstract

摘要： 针对科技文献类标题短文本关键词提取时，已有自然语言处理算法难以建模文献时间与权威性且短文本词语较少建模往往存在高维稀疏问题，本文提出了一个综合实时性以及权威性的关键词提取算法为研究者进行相关推荐.该方法将文献标题视为超边，将标题中不同词项视为超点来构建超图，并对超图中的超边与超点同时加权，进而设计一种基于加权超图随机游走的关键词提取算法对文献标题的词项进行提取.该模型通过对文献来源，发表年份以及被引次数建模来对超边进行加权，根据节点之间的关联度以及每对节点在特定标题中的共现距离对超点加权.最后，通过超图上的随机游走计算出节点的重要性进而确立可推荐的关键词.实验表明，与三种基准短文本关键词提取算法相比，本文算法在精确率和召回率方面均有所提高.

关键词: 加权超图, 加权策略, 关键词推荐, 随机游走, 自然语言处理, 数据挖掘

Abstract: It is difficult for the existing natural language processing algorithms to model the time and authority of short texts such as paper titles of scientific literature.Besides,the short texts always tend to have fewer words and thus suffer from high dimension and sparsity.A keyword extraction method involving both real-time and authoritativeness is presented.A weighted hyper-graph is constructed where vertexes represent weighted terms and weighted hyper-edges measure the semantic relatedness of both binary relations and nary relations among terms.On one hand,the source of the documents,the year of publication and number of citations are considered for weighting hyper-edges,on the other hand,the degree of association between the nodes and co-occurrence distance for each pair of nodes in particular title are calculated for weighting hyper-vertexes.The random walk approach is performed on the weighted hyper-graph to obtain the recommended keywords.Experimental results demonstrated that compared with three baseline algorithms,the proposed approach is able to extract keywords with higher precision and recall.

Key words: weighted hypergraph, weighting strategy, keywords extraction, random walk, natural language processing, data mining

中图分类号:

TP393.092

马慧芳, 刘芳, 夏琴, 等. 基于加权超图随机游走的文献关键词提取算法[J]. 电子学报, 2018, 46(6): 1410-1414.

MA Hui-fang, LIU Fang, XIA Qin, et al. Keywords Extraction Algorithm Based on Weighted Hypergraph Random Walk[J]. Acta Electronica Sinica, 2018, 46(6): 1410-1414.

参考文献

[1] Ma Hui-fang,Xing Yu-ying,et al.Leveraging term co-occurrence distance and strong classification features for short text feature selection[A].Proceedings of the 10th International Conference on Knowledge Science,Engineering and Management[C].Melbourne,Australia:Springer,2017.303-310.
[2] 刘喜平,万常选等.空间关键词搜索研究综述[J].软件学报,2016,27(2):329-347. Liu Xi-ping,Wan Chang-xuan,et al.Survey on spatial keyword search[J].Journal of Software,2016,27(2):329-347.(in Chinese)
[3] Ugo Erra,Sabrina Senatore,et al.Approximate TF-IDF based on topic extraction from massive message stream using the GPU[J].Information Sciences,2015,292(20):143-161.
[4] Song Shao-xu,Zhu Han,et al,Probabilistic correlation-based similarity measure on text records[J].Information Sciences,2014,289(1):8-24.
[5] Hua Wen,Wang Zhong-yuan,et al.Short text understanding through lexical-semantic analysis[A].Proceedings of the 31st International Conference on Data Engineering[C].Seoul,South Korea:IEEE,2015.495-506.
[6] Blei D M,Ng A Y,Jordan M I.Latent Dirichlet allocation[J].Journal of Machine Learning Research,2003,3(1):993-1022.
[7] Rahim Saeidi,Ramon Fernandez Astudillo,et al.Uncertain LDA:Including observation uncertainties in discriminative transforms[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2016,38(7):1479-1488.
[8] Willyan D Abilhoa,Leandro N de Castro.A keyword extraction method from twitter messages represented as graphs[J].Applied Mathematics and Computation,2014,240(4):308-325.
[9] Zhou Deng-yong,Huang Jia-yuan,et al.Learning with hypergraphs:clustering,classification,and embedding[A].Proceedings of the 20th International Conference on Neural Information Processing Systems[C].Vancouver,Canada:MIT Press,2006.1601-1608.
[10] Li De-cong,Li Su-jian.Hypergraph-based inductive learning for generating implicit key phrases[A].Proceedings of the 20th International Conference on World Wide Web[C].Hyderabad,India:Springer,2011.77-78.
[11] Bellaachia A,Al-Dhelaan M.HG-Rank:A hypergraph-based keyphrase extraction for short documents in dynamic genre[A].Proceedings of the 4th Workshop on Making Sense of Microposts[C].Seoul,Korea:CEUR-WS,2014.42-49.

[1]	曹阳, 高旻, 余俊良, 范琪琳, 荣文戈, 文俊浩. 基于双图混合随机游走的社会化推荐模型[J]. 电子学报, 2023, 51(2): 286-296.
[2]	张少波, 原刘杰, 毛新军, 朱更明. 基于本地差分隐私的K-modes聚类数据隐私保护方法[J]. 电子学报, 2022, 50(9): 2181-2188.
[3]	沈鹏飞, 徐臻, 王英. 基于嵌套生成对抗学习的网络嵌入[J]. 电子学报, 2022, 50(9): 2155-2163.
[4]	张志昌, 于沛霖, 庞雅丽, 朱林, 曾扬扬. SMGN：用于对话状态跟踪的状态记忆图网络[J]. 电子学报, 2022, 50(8): 1851-1858.
[5]	杜晋华, 尹浩, 冯嵩. 中文电子病历命名实体识别的研究与进展[J]. 电子学报, 2022, 50(12): 3030-3053.
[6]	王森, 王煜, 宁德军. 复杂软件系统健康状态智能感知与诊断模型[J]. 电子学报, 2021, 49(9): 1799-1808.
[7]	黄名选. 关联模式挖掘与词向量学习融合的伪相关反馈查询扩展[J]. 电子学报, 2021, 49(7): 1305-1313.
[8]	张昱, 刘开峰, 张全新, 王艳歌, 高凯龙. 基于组合-卷积神经网络的中文新闻文本分类[J]. 电子学报, 2021, 49(6): 1059-1067.
[9]	李青青, 马慧芳, 李举, 李志欣. 属性网络中相似性增强随机游走的多社区搜索[J]. 电子学报, 2021, 49(11): 2096-2100.
[10]	杨启萌, 禹龙, 田生伟, 艾山·吾买尔. 基于深度强化学习的维吾尔语人称代词指代消解[J]. 电子学报, 2020, 48(6): 1077-1083.
[11]	黄名选, 蒋曹清. 基于项权值排序挖掘的跨语言查询扩展[J]. 电子学报, 2020, 48(3): 568-576.
[12]	吴玉佳, 李晶, 宋成芳, 常军. 基于高效用神经网络的文本分类方法[J]. 电子学报, 2020, 48(2): 279-284.
[13]	张志昌, 曾扬扬, 庞雅丽. 融合语义角色和自注意力机制的中文文本蕴含识别[J]. 电子学报, 2020, 48(11): 2162-2169.
[14]	方晨, 郭渊博, 王娜, 甄帅辉, 唐国栋. 基于生成对抗网络的差分隐私数据发布方法[J]. 电子学报, 2020, 48(10): 1983-1992.
[15]	彭慧丽, 金凯忠, 付聪聪, 付楠, 张啸剑. 基于序列格的隐私时序模式挖掘方法[J]. 电子学报, 2020, 48(1): 153-163.

基于加权超图随机游走的文献关键词提取算法

Keywords Extraction Algorithm Based on Weighted Hypergraph Random Walk

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics