基于LDA的多粒度主题情感混合模型

doi:10.3969/j.issn.0372-2112.2015.09.029

电子学报 ›› 2015, Vol. 43 ›› Issue (9): 1875-1880.DOI: 10.3969/j.issn.0372-2112.2015.09.029

• 科研通信 • 上一篇

基于LDA的多粒度主题情感混合模型

欧阳继红^1,2, 刘燕辉^1,2, 李熙铭^1,2, 周晓堂^1,2

1. 吉林大学计算机科学与技术学院, 吉林长春 130012;
2. 符号计算与知识工程教育部重点实验室, 吉林长春 130012

收稿日期:2014-04-08 修回日期:2014-08-11 出版日期:2015-09-25
- 作者简介:
- 欧阳继红 女,1964年生于吉林长春,教授,博导,研究方向:知识工程与专家系统、空间推理和数据挖掘.E-mail:ouyj@jlu.edu.cn;刘燕辉 男,1989年生于山东德州,硕士,研究方向:文本分类与情感分析.E-mail:sdpy_lyh@163.com
- 基金资助:
- 国家自然科学基金 (No.61170092,No.61133011,No.61103091)

Multi-Grain Sentiment/Topic Model Based on LDA

OUYANG Ji-hong^1,2, LIU Yan-hui^1,2, LI Xi-ming^1,2, ZHOU Xiao-tang^1,2

1. College of Computer Science and Technology, Jilin University, Changchun, Jilin 130012, China;
2. Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin 130012, China

Received:2014-04-08 Revised:2014-08-11 Online:2015-09-25 Published:2015-09-25
- Supported by:
- National Natural Science Foundation of China (No.61170092, No.61133011, No.61103091)

摘要/Abstract

摘要：

主题情感混合模型(Reverse-Joint Sentiment/Topic Model;Joint Sentiment/Topic Model)能够有效地同时抽取文档的主题和情感信息,在情感分析领域受到广泛的关注,因为没有考虑整体分布与局部分布的关系,导致分类效果不佳且不稳定.本文同时考虑两个粒度上的情感/主题分布——文档级和局部,提出多粒度的主题情感混合模型(MG-R-JST;MG-JST).MG-R-JST/MG-JST在文档级分布和局部分布的共同作用下生成单词的情感/主题;使用吉布斯采样进行模型推理,并给出了推理过程;在MR与MDS数据集上进行实验,实验结果表明本文算法分类效果优于主题情感混合模型,且稳定性更好.

关键词: LDA, 主题情感混合模型, 情感分析, 多粒度

Abstract:

The topic and sentiment unification model (Reverse-Joint Sentiment/Topic Model;Joint Sentiment/Topic Model) can effectively extract information of topic and sentiment simultaneously and receives wide attention in the field of sentiment analysis,because it does not consider the relationship between the overall distribution and local distribution,so the classification performance is not good and stable.This paper proposed the multi-grain topic and sentiment unification model (MG-R-JST;MG-JST) by taking into account both grains on sentiment/topic distribution—document-level and local-level.MG-R-JST/MG-JST generated the sentiment/topic of words on the effect of the document-level and local-level distribution.we used Gibbs sampling for model inference and showed the process.Experiments on the dataset of MR and MDS demonstrate the effectiveness of the proposed method,and the classification performance is better and more stable than the topic and sentiment unification model.

Key words: LDA, topic and sentiment unification model, sentiment analysis, multi-grain

中图分类号:

TP391

欧阳继红, 刘燕辉, 李熙铭, 等. 基于LDA的多粒度主题情感混合模型[J]. 电子学报, 2015, 43(9): 1875-1880.

OUYANG Ji-hong, LIU Yan-hui, LI Xi-ming, et al. Multi-Grain Sentiment/Topic Model Based on LDA[J]. Acta Electronica Sinica, 2015, 43(9): 1875-1880.

参考文献

[1] 赵妍妍,秦兵,刘挺.文本情感分析[J].软件学报,2010,21(8):1834-1848. Zhao YY,Qin B,Liu T.Sentiment analysis[J].Journal of Software,2010,21(8):1834-1848.(in Chinese)
[2] Bo Pang,Lillian Lee.Thumbs up? sentiment classification using machine learning techniques[A].Proceedings of the Conference on Empirical Methods in Natural Language Processing[C].Philadelphia PA:EMNLP,2002.79-86.
[3] Fangtao Li,et al.Sentiment analysis with global topics and local dependency[A].Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence[C].Atlanta,USA:AAAI,2010.1371-1376.
[4] Blei D M,et al.Latent dirichlet allocation[J].Journal of Machine Learning Research,2003,3(1):993-1022.
[5] 江雨燕,李平,王清.基于共享背景主题的Labeled LDA模型[J].电子学报,2013,(9):1794-1799. Jang Yu-yan,Li Ping,Wang Qing.Labeled LDA model based on shared background topics[J].Acta Electronica Sinica,2013,(9):1794-1799.(in Chinese)
[6] 王李东,魏宝刚,袁杰.基于概率主题模型的文档聚类[J].电子学报,2012,11(11):2346-2350. Wang Li-dong,Wei Bao-gang,Yuan Jie.Document clustering based on probabilistic topic model[J].Acta Electronica Sinica,2012,11(11):2346-2350.(in Chinese)
[7] Pang B,Lee L.Opinion mining and sentiment analysis[J].Foundations and Trends in Information Retrieval,2008,2(1-2):1-135.
[8] Chenghua Lin,Yulan He.Joint sentiment/topic model for sentiment analysis[A].CKIM[C].Hong Kong,China:ACM,2009.375-384.
[9] Chenghua Lin,Yulan He,Richard Everson.A comparative study of bayesian models for unsupervised sentiment[A].Proceedings of the Fourteenth Conference on Computational Natural Language Learning[C].Uppsala,Sweden:Association for computational linguistics,2010.144-152.
[10] YulanHe,et al.Dynamic joint sentiment-topic model[J].ACM Transactions on Intelligent Systems and Technology (TIST),2013,5(1):6.
[11] Timothy Rubin,America Chambers.Statistical topic models for multi-label document classification[J].Journal of Machine Learning Research,2012,88(1-2):157-208.

[1]	姜春茂, 赵书宝. 基于阴影集的多粒度三支聚类集成[J]. 电子学报, 2021, 49(8): 1524-1532.
[2]	陈杰, 刘学军, 李斌, 章玮. 一种基于用户动态兴趣和社交网络的微博推荐方法[J]. 电子学报, 2017, 45(4): 898-905.
[3]	黄发良, 李超雄, 元昌安, 汪焱, 姚志强. 基于TSCM模型的网络短文本情感挖掘[J]. 电子学报, 2016, 44(8): 1887-1891.
[4]	张清华, 薛玉斌, 胡峰, 于洪. 粗糙集近似集不确定性研究[J]. 电子学报, 2016, 44(7): 1574-1580.
[5]	许文文, 时鹏, 于留宝, 胡长军. 一种在线社交网络的自适应观点引导模型及实现[J]. 电子学报, 2016, 44(7): 1714-1720.
[6]	曹玖新, 陈高君, 吴江林, 刘波, 周涛, 胥帅, 朱子青. 基于多维特征分析的社交网络意见领袖挖掘[J]. 电子学报, 2016, 44(4): 898-905.
[7]	吴斌, 吉佳, 孟琳, 石川, 赵惠东, 李仪清. 基于迁移学习的唐诗宋词情感分析[J]. 电子学报, 2016, 44(11): 2780-2787.
[8]	孙雪, 李昆仑, 韩蕾, 白晓亮. 基于特征项分布的信息熵及特征动态加权概念漂移检测模型[J]. 电子学报, 2015, 43(7): 1356-1361.
[9]	卜湛, 伍之昂, 曹杰, 朱桂祥. 在线评论情感计算与博弈预测[J]. 电子学报, 2015, 43(12): 2530-2535.
[10]	王加阳, 杨正华. 两种结构的商空间模型比较研究[J]. 电子学报, 2013, 41(11): 2262-2269.
[11]	王李冬, 魏宝刚, 袁杰. 基于概率主题模型的文档聚类[J]. 电子学报, 2012, 40(11): 2346-2350.
[12]	郑衍松;佟冬;王克义;程旭. MDCI:基于多粒度动态控制流不变式的硬件故障局部化[J]. 电子学报, 2010, 38(11): 2465-2470.
[13]	吴永辉;王晓龙;丁宇新;徐军;郭鸿志. 基于主题的自适应、在线网络热点发现方法及新闻推荐系统[J]. 电子学报, 2010, 38(11): 2620-2624.
[14]	方娟, 张书杰, 邸瑞华, 黄河. 基于移动Agent的网格资源发现与监控技术的研究[J]. 电子学报, 2005, 33(2): 341-344.
[15]	张宇, 李正斌, 徐安士, 吴德明. 多粒度交换光网络路由和波长分配算法研究[J]. 电子学报, 2004, 32(S1): 93-97.

基于LDA的多粒度主题情感混合模型

Multi-Grain Sentiment/Topic Model Based on LDA

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics