Optimization of Chinese Word Segmentation in Named Entity Recognition and Word Alignment

YIN Cun-yan; HUANG Shu-jian; DAI Xin-yu; CHEN Jia-jun

doi:10.3969/j.issn.0372-2112.2015.08.003

您当前的位置：

首页 >

文章列表页 >

Optimization of Chinese Word Segmentation in Named Entity Recognition and Word Alignment

更新时间：2025-07-16

- Optimization of Chinese Word Segmentation in Named Entity Recognition and Word Alignment
- Acta Electronica Sinica Vol. 43, Issue 8, Pages: 1481-1487(2015)
- 作者机构：
  
  1. 南京大学计算机软件新技术国家重点实验室,江苏,南京,210023
  2. 南京大学计算机科学与技术系,江苏,南京,210023
  3. 南京大学计算机软件新技术国家重点实验室,江苏,南京,210023
  4. 南京大学计算机科学与技术系,江苏,南京,210023
- 作者简介：
- 基金信息：
  
  National Natural Science Foundation of China Outstanding State Key Laboratory Research Project (No.61223003);Youth Fund of National Natural Science Foundation of China (No.61300158)
- DOI：10.3969/j.issn.0372-2112.2015.08.003
  CLC： TP391
- Published：2015
- 稿件说明：
移动端阅览
YIN Cun-yan, HUANG Shu-jian, DAI Xin-yu, et al. Optimization of Chinese Word Segmentation in Named Entity Recognition and Word Alignment[J]. Acta Electronica Sinica, 2015, 43(8): 1481-1487.
DOI：

YIN Cun-yan, HUANG Shu-jian, DAI Xin-yu, et al. Optimization of Chinese Word Segmentation in Named Entity Recognition and Word Alignment[J]. Acta Electronica Sinica, 2015, 43(8): 1481-1487. DOI： 10.3969/j.issn.0372-2112.2015.08.003.

摘要

中文分词结果对中英命名实体识别及对齐有着直接的影响

本文提出了一种命名实体识别及对齐中的中文分词优化方法.该方法利用实体词汇的对齐信息

首先修正命名实体识别结果

然后根据实体对齐结果调整分词粒度、修正错误分词.分词优化后的结果使得双语命名实体尽可能多地实现一一对应

进而提高中英命名实体翻译抽取和统计机器翻译的效果.实验结果表明了本文优化方法的有效性.

Abstract

Bilingual named entity recognition and alignment are important for many natural language processing.Named entity translation can improve a lot the performance of the system like statistical machine translation or cross-language information retrieval.Quality of Chinese word segmentation does have a big impact over named entity (NE) recognition and bilingual NE extraction.Bilingual alignment information provides indications for NE recognition and word segmentation.Accordingly

based on the characteristics of NE recognition

NE alignment

and word segmentation

this paper proposes an optimization algorithm of Chinese word segmentation.By correcting word segmentation error and adjusting word segmentation granularity

the optimization algorithm can enhance extraction effect of Chinese-English NE translation and performance of statistical machine translation.The experimental result on Chinese-English news corpus shows the efficiency of our algorithm.

关键词

Keywords

references

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Research on Evaluation of Token Imbalance Degree in NMT Corpus

Analysis and Detection of Translation-Based Steganography

Research on The Evaluation of Token Imbalance Degree in NMT Corpus

Related Author

WANG Hai-bo

YU Li-li

WANG Hong-wei

MENG Peng

HUANG Liu-sheng

CHEN Zhi-li

YANG Wei

YANG Ming

Related Institution

College of Biomedical Engineering & Instrument Science， Zhejiang University

College of Teacher Education， Zhejiang Normal University

ZJU-UIUC Joint Institute， Zhejiang University， Haining

NHPCC,Department of Computer Science and Technology,USTC

Suzhou Institute for Advanced Study,USTC

⁰