一种基于混合神经网络的命名实体识别与共指消解联合模型

doi:10.3969/j.issn.0372-2112.2020.03.004

电子学报 ›› 2020, Vol. 48 ›› Issue (3): 442-448.DOI: 10.3969/j.issn.0372-2112.2020.03.004

一种基于混合神经网络的命名实体识别与共指消解联合模型

郜成胜¹, 张君福¹, 李伟平¹, 赵文², 张世琨²

1. 北京大学软件与微电子学院, 北京 100871;
2. 北京大学软件工程国家工程研究中心, 北京 100871

收稿日期:2018-09-24 修回日期:2018-11-22 出版日期:2020-03-25
- 作者简介:
- 郜成胜 男,1975年出生,山西长治人,现为北京大学软件与微电子学院工程博士研究生,主要研究领域为知识图谱、软件工程.E-mail:gaocs@pku.edu.cn;赵文男,1967年出生,辽宁大连人.现为北京大学软件工程国家工程研究中心研究员、博士生导师,主要研究领域为知识图谱、软件工程、软件安全.E-mail:zhaowen@pku.edu.cn

A Joint Model of Named Entity Recognition and Coreference Resolution Based on Hybrid Neural Network

GAO Cheng-sheng¹, ZHANG Jun-fu¹, LI Wei-ping¹, ZHAO Wen², ZHANG Shi-kun²

1. School of Software and Microelectronics, Peking University, Beijing 100871, China;
2. National Engineering Research Center for Software Engineering, Peking University, Beijing 100871, China

Received:2018-09-24 Revised:2018-11-22 Online:2020-03-25 Published:2020-03-25

摘要/Abstract

摘要： 命名实体识别与共指消解均依赖于对实体相邻文本信息的学习，本文提出一种基于混合神经网络的命名实体识别与共指消解联合模型，共用双向长短时记忆模型LSTM编码层对输入序列中每个词前后方向上下文信息进行编码，并通过训练学习得到上下文信息传递到前馈神经网络FFNN模型以提高共指消解精度，通过将领域文档及篇章语义向量加入FFNN，改进共指消解算法并优化共指消解模型.基于领域文本数据集进行联合模型训练，实验结果表明该联合模型可以有效地提高共指消解精度.

关键词: 神经网络, 命名实体识别, 共指消解, 联合神经网络模型

Abstract: Considering that both named entity recognition and coreference resolution depend on the same context of the entity word, this paper proposes a hybrid neural network model to settle these problems which contains a named entity recognition (NER) module and a coreference resolution (CR) module. NER and CR share the same bidirectional LSTM encoding layer, which is used to encode each input word by taking into account the context on both sides of the word. The contextual information of entities obtained in BiLSTM encoding layer further pass through to FFNN module to improve the coreference resolution. Furthermore, by adding domain documents and chapter semantic vectors to FFNN, the coreference resolution algorithm is improved and the coreference resolution model is optimized. Finally, we conduct experiments on the domain dataset to verify the effectiveness of our method. The joint model can effectively improve the accuracy of coreference resolution task.

Key words: neural network, named entity recognition, coreference resolution, hybrid neural network model

中图分类号:

TP183

郜成胜, 张君福, 李伟平, 等. 一种基于混合神经网络的命名实体识别与共指消解联合模型[J]. 电子学报, 2020, 48(3): 442-448.

GAO Cheng-sheng, ZHANG Jun-fu, LI Wei-ping, et al. A Joint Model of Named Entity Recognition and Coreference Resolution Based on Hybrid Neural Network[J]. Acta Electronica Sinica, 2020, 48(3): 442-448.

参考文献

[1] Luo G,Huang X,Lin C Y,et al.Joint entity recognition and disambiguation[A].Conference on Empirical Methods in Natural Language Processing[C].Austin:EMNLP,2016.879-888.
[2] Denis P,Baldridge J.Global joint models for coreference resolution and named entity classification[J].Procesamiento del Lenguaje Natural,2009,42(1):87-96.
[3] Lample G,Ballesteros M,et al.Neural architectures for named entity recognition[A].Proceedings of NAACL-HLT 2016[C].San Diego:NAACL-HLT,2016.260-270.
[4] Lee K,He L,Lewis M,et al.End-to-end neural coreference resolution[A].Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing[C].Copenhagen:EMNLP,2017.188-197.
[5] Muslea I.Extraction patterns for information extraction tasks:A survey[EB/OL].http://aaai.org/Papers/Workshops/1999/WS-99-11/WS99-11,2018-01-01.
[6] Rau L F.Extracting company names from text[A].Seventh IEEE Conference on Artificial Intelligence Application[C].Miami:IEEE,1991.29-32.
[7] Maynard D,Tablan V,Ursu C.Named entity recognition from diverse Text Types[A].Recent Advances in Natural Language Processing Conference[C].Borovets:RANLP,2001.
[8] Liu X,Zhang S,Wei F,et al.Recognizing named entities in tweets[J].ACL,2011,1:359-367.
[9] Wagstaff K,Cardie C.Clustering with instance-level constraints.[A]Seventeenth International Conference on Machine Learning[C].Stanford:ICML,2000.1103-1110.
[10] Ng V.Unsupervised models for coreference resolution.[A].Conference on Empirical Methods in Natural Language Processing[C].Singapore:EMNLP,2009.6-7.
[11] Haghighi A,Dan K.Coreference resolution in a modular,entity-centered model[A].Human Language Technologies:The 2010 Conference of the North American Chapter of the Association for Computational Linguistics.[C].Los Angeles:NAACL-HLT,2010.385-393.
[12] Haghighi A,Dan K.Unsupervised coreference resolution in a nonparametric bayesian model[A].Meeting of the Association of Computational Linguistics[C].Prague:ACL,2007.848-855.
[13] Passos A,Kumar V,McCallum A.Lexicon infused phrase embeddings for named entity resolution[A].Proceedings of the Eighteenth Conference on Computational Natural Language Learning[C].Michigan:CoNLL,2014.78-86.
[14] Lafferty J D,Mccallum A,Pereira F C N.Conditional random fields:probabilistic models for segmenting and labeling sequence data[A]Eighteenth International Conference on Machine Learning[C].Williamstown:ICML,2001.282-289.
[15] Colmenar J M,Abanades M A,Poza F,et al.On a generalized name entity recognizer based on hidden markov models[A].International Conference on Intelligent Systems Design and Applications[C].Cordoba:ISDA,2011.952-958.
[16] Collobert R,Weston J,Karlen M,et al.Natural language processing (almost) from scratch[J].Journal of Machine Learning Research,2011,12(1):2493-2537.
[17] Chiu J P C,Nichols E.Named entity recognition with bidirectional LSTM-CNNs[J].Transactions of the Association for Computational Linguistics,2016,4(1):357-370.
[18] Ng V.Supervised noun phrase coreference research:the first fifteen years[A].Meeting of the Association for Computational Linguistics[C].Uppsala:ACL,2010.1396-1411.
[19] Raghunathan K,Lee H,Rangarajan S,et al.A multi-pass sieve for coreference resolution.[A].Conference on Empirical Methods in Natural Language Processing[C].Massachusetts:EMNLP,2010.492-501.
[20] Greg Durrett,Dan Klein.Easy victories and uphill battles in coreference resolution[A].Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing[C].Seattle:EMNLP,2013.1971-1982.
[21] Clark K,Manning C D.Improving coreference resolution by learning entity-level distributed representations[A].54th Annual Meeting of the Association for Computational Linguistics[C].Berlin:ACL,2016.643-653.
[22] Mccallum A,Rohanimanesh K,Sutton C.Dynamic conditional random fields for jointly labeling multiple sequences[A].NIPS Workshop on Syntax,Semantics,and Statistics[C].Vancouver:NIPS,2003.
[23] Finkel J R,Manning C D.Joint parsing and named entity recognition[A].Human Language Technologies:Conference of the North American Chapter of the Association of Computational Linguistics,Proceedings[C].Boulder.DBLP,2009.326-334.
[24] Sil A,Yates A.Re-ranking for joint named-entity recognition and linking[A].ACM International Conference on Conference on Information & Knowledge Management[C].San Francisco:CIKM,2013,2369-2374.
[25] Iii H D,Marcu D.A large-scale exploration of effective global features for a joint entity detection and tracking model[A].Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing[C].Vancouver:HLT/EMNLP,2009.97-104.
[26] Tieleman T,Hinton G.Lecture 6.5-rmsprop:Divide the gradient by a running average of its recent magnitude[J].COURSERA:Neural Networks For Machine Learning,2012,4(2):26-31.

一种基于混合神经网络的命名实体识别与共指消解联合模型

A Joint Model of Named Entity Recognition and Coreference Resolution Based on Hybrid Neural Network

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	黄赟, 张帆, 郭威, 陈立, 羊光. 一种基于数据标准差的卷积神经网络量化方法[J]. 电子学报, 2023, 51(3): 639-647.
[2]	张金颢, 周恒, 张守龙, 蒋廷勇, 王胜涛, 刘真. 基于仿真及神经网络的大型电磁脉冲模拟器近区场计算[J]. 电子学报, 2023, 51(3): 712-719.
[3]	吕杭, 蒋明峰, 李杨, 张鞠成, 王志康. 基于混合时频域特征的卷积神经网络心律失常分类方法的研究[J]. 电子学报, 2023, 51(3): 701-711.
[4]	王子为, 鲁继文, 周杰. 基于自适应梯度优化的二值神经网络[J]. 电子学报, 2023, 51(2): 257-266.
[5]	许新征, 李杉. 基于特征膨胀卷积模块的轻量化技术研究[J]. 电子学报, 2023, 51(2): 355-364.
[6]	杨利平, 侯振威, 辜小花, 郝峻永. 弱标签声音事件检测的空间-通道特征表征与自注意池化[J]. 电子学报, 2023, 51(2): 297-306.
[7]	王神龙, 雍宇, 吴晨睿. 基于伪孪生神经网络的低纹理工业零件6D位姿估计[J]. 电子学报, 2023, 51(1): 192-201.
[8]	张永梅, 孙捷. 基于动静态特征双输入神经网络的咳嗽声诊断COVID-19算法[J]. 电子学报, 2023, 51(1): 202-212.
[9]	丁琪, 田萱, 孙国栋. 基于注意力增强的热点感知新闻推荐模型[J]. 电子学报, 2023, 51(1): 93-104.
[10]	袁海英, 成君鹏, 曾智勇, 武延瑞. Mobile_BLNet：基于Big-Little Net的轻量级卷积神经网络优化设计[J]. 电子学报, 2023, 51(1): 180-191.
[11]	王硕, 王坚, 王亚男, 宋亚飞. 一种基于特征融合的恶意代码快速检测方法[J]. 电子学报, 2023, 51(1): 57-66.
[12]	吴靖, 叶晓晶, 黄峰, 陈丽琼, 王志锋, 刘文犀. 基于深度学习的单帧图像超分辨率重建综述[J]. 电子学报, 2022, 50(9): 2265-2294.
[13]	毛国君, 王者浩, 黄山, 王翔. 基于剪边策略的图残差卷积深层网络模型[J]. 电子学报, 2022, 50(9): 2205-2214.
[14]	袁海英, 曾智勇, 成君鹏. 面向灵活并行度的稀疏卷积神经网络加速器[J]. 电子学报, 2022, 50(8): 1811-1818.
[15]	徐兴荣, 刘聪, 李婷, 郭娜, 任崇广, 曾庆田. 基于双向准循环神经网络和注意力机制的业务流程剩余时间预测方法[J]. 电子学报, 2022, 50(8): 1975-1984.