Early Rumor Detection Based on Bert-GNNs Heterogeneous Graph Attention Network

OUYANG Qi; CHEN Hong-chang; LIU Shu-xin; WANG Kai; LI Xing

doi:10.12263/DZXB.20220882

您当前的位置：

首页 >

文章列表页 >

Early Rumor Detection Based on Bert-GNNs Heterogeneous Graph Attention Network

PAPERS | 更新时间：2026-04-10

- Early Rumor Detection Based on Bert-GNNs Heterogeneous Graph Attention Network
- ACTA ELECTRONICA SINICA Vol. 52, Issue 1, Pages: 311-323(2024)
- 作者机构：
  
  中国人民解放军战略支援部队信息工程大学，河南郑州 450001
- 作者简介：
- 基金信息：
  
  Zhongyuan Program of Excellence Project(212101510002)
- DOI：10.12263/DZXB.20220882
  CLC： TP393.1;
- Received：25 July 2022，
  
  Revised：2023-03-29，
  
  Published：25 January 2024
- 稿件说明：
移动端阅览
欧阳祺,陈鸿昶,刘树新,等.基于Bert-GNNs异质图注意力网络的早期谣言检测[J].电子学报,2024,52(01):311-323.

OUYANG Qi, CHEN Hong-chang, LIU Shu-xin, et al.Early Rumor Detection Based on Bert-GNNs Heterogeneous Graph Attention Network[J].Acta Electronica Sinica, 2024, 52(01): 311-323.
欧阳祺,陈鸿昶,刘树新,等.基于Bert-GNNs异质图注意力网络的早期谣言检测[J].电子学报,2024,52(01):311-323. DOI：10.12263/DZXB.20220882

OUYANG Qi, CHEN Hong-chang, LIU Shu-xin, et al.Early Rumor Detection Based on Bert-GNNs Heterogeneous Graph Attention Network[J].Acta Electronica Sinica, 2024, 52(01): 311-323. DOI：10.12263/DZXB.20220882

摘要

网络谣言的广泛传播已经造成了很大的社会危害，因此早期谣言检测任务已成为重要的研究热点.现有谣言检测方法主要从文本内容、用户配置和传播结构中挖掘相关特征，但没有同时利用到文本全局语义关系和局部上下文语义关系.为了克服以上局限性，充分利用到谣言数据中的文本全局-局部上下文语义关系、文本语义内容特征和推文传播的结构特征，本文提出了一种基于Bert-GNNs异质图注意力网络的早期谣言检测算法（Bert-GNNs Heterogeneous Graph Attention Network，BGHGAN）.该方法根据历史谣言集和用户特征构建一个推文-词-用户异质图，通过采用预训练语言模型Bert和图卷积神经网络（Graph Convolutional Network，GCN）结合的方法进行特征学习，以挖掘谣言的文本语义特征和文本之间的关系，并将异质图分解为推文-词子图和推文-用户子图，采用图注意力网络（Graph Attention network，GAT）的方式分别进行特征学习，从而更充分利用文本全局-局部上下文语义关系和传播图的全局结构关系以加强特征表达；最后，通过子图级注意力机制将不同模块的学习集成进行最终的谣言检测.所提算法在真实的Twitter15和Twitter16数据上进行实验，验证了该算法在检测准确率上分别为91.4%和91.9%，较现有最佳模型分别提高了1%和1.4%，也具备在早期阶段对谣言的检测能力；同时，本文通过实验探讨了不同特征对谣言检测的重要性、对异质图构建质量的重要性.

Abstract

The widespread spread of network rumors has caused great harm to the society

so the task of early rumor detection has become an important research focus. The majority of existing methods for rumor detection focus on mining effective features from text contents

user profiles

and patterns of propagation

but these methods do not take full advantage of both global semantic relationship of text and local context semantic relationship. In order to overcome the above limitations and make full use of the text global-local context semantic relationship

text semantic content feature and the structural feature of tweet propagation in the rumor data

this paper puts forward a kind of early rumors detection algorithm based on Bert-GNNs heterogeneous graph attention network (BGHGAN).This method constructs a tweet-word-user heterogeneous graph according to historical rumor sets and user characteristics

using the method of combining Bert and GCN (Graph Convolutional Network) for feature learning to mine the relationship between the text semantic features and the text of rumors. And by decomposing the heterogeneous graph into tweet-word subgraph and tweet-user subgraph

the method uses GAT (Graph Attention network) to perform feature learning respectively

so as to make full use of the global-local context semantic relationship of the text and the global structure relationship of the propagation graph to strengthen the feature expression. Finally

the learning integration of different modules is carried out through the subgraph-level attention mechanism for final rumor detection. The proposed algorithm is experimented on real Twitter15 and Twitter16 data

and verifies that the detection accuracy of the algorithm is 91.4% and 91.9%

respectively

which is 1% and 1.4% higher than the existing best model

and also has the ability to detect rumors in the early stage. And this paper discusses the importance of different features to rumor detection and the importance of the quality of heterogeneous graph construction.

关键词

Keywords

references

刘树新 , 季新生 , 刘彩霞 , 等 . 一种信息传播促进网络增长的网络演化模型 [J]. 物理学报 , 2014 , 63 ( 15 ): 429 - 439 .

LIU S X , JI X S , LIU C X , et al . A complex network evolution model for network growth promoted by information transmission [J]. Acta Physica Sinica , 2014 , 63 ( 15 ): 429 - 439 . (in Chinese)

LIANG G , HE W B , XU C , et al . Rumor identification in microblogging systems based on users’ behavior [J]. IEEE Transactions on Computational Social Systems , 2015 , 2 ( 3 ): 99 - 108 .

GRINBERG N , JOSEPH K , FRIEDLAND L , et al . Fake news on Twitter during the 2016 US presidential election [J]. Science , 2019 , 363 ( 6425 ): 374 - 378 .

POPAT K . Assessing the credibility of claims on the web [C]// Proceedings of the 26th International Conference on World Wide Web Companion . New York : ACM , 2017 : 735 - 739 .

程晓涛 , 刘彩霞 , 刘树新 . 基于关系图特征的微博水军发现方法 [J]. 自动化学报 , 2015 , 41 ( 9 ): 1533 - 1541 .

CHENG X T , LIU C X , LIU S X . Graph-based features for identifying spammers in microblog networks [J]. Acta Automatica Sinica , 2015 , 41 ( 9 ): 1533 - 1541 . (in Chinese)

袁得嵛 , 章逸钒 , 高见 , 等 . 基于用户特征提取的新浪微博异常用户检测方法 [J]. 计算机科学 , 2020 , 47 ( S1 ): 364 - 368, 385 .

YUAN D Y , ZHANG Y F , GAO J , et al . Abnormal user detection method in sina weibo based on user feature extraction [J]. Computer Science , 2020 , 47 ( S1 ): 364 - 368, 385 . (in Chinese)

JIN F , DOUGHERTY E , SARAF P , et al . Epidemiological modeling of news and rumors on Twitter [C]// Proceedings of the 7th Workshop on Social Network Mining and Analysis . New York : ACM , 2013 : 1 - 9 .

SAMPSON J , MORSTATTER F , WU L , et al . Leveraging the implicit structure within social media for emergent rumor detection [C]// Proceedings of the 25th ACM International on Conference on Information and Knowledge Management . New York : ACM , 2016 : 2377 - 2382 .

MA J , GAO W , WONG K F . Detect rumors in microblog posts using propagation structure via kernel learning [C]// Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . Stroudsburg : Association for Computational Linguistics , 2017 : 708 - 717 .

ZHAO Z , RESNICK P , MEI Q Z . Enquiring minds: Early detection of rumors in social media from enquiry posts [C]// Proceedings of the 24th International Conference on World Wide Web . New York : ACM , 2015 : 1395 - 1405 .

FARNAAZ N , JABBAR M A . Random forest modeling for network intrusion detection system [J]. Procedia Computer Science , 2016 , 89 : 213 - 217 .

MA J , GAO W , WONG K F . Rumor detection on twitter with tree-structured recursive neural networks [C]// Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . Stroudsburg : Association for Computational Linguistics , 2018 : 1980 - 1989 .

LI Q Z , ZHANG Q , SI L . Rumor detection by exploiting user credibility information, attention and multi-task learning [C]// Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics . Stroudsburg : Association for Computational Linguistics , 2019 : 1173 - 1179 .

蔡国永 , 林强 , 任凯琪 . 基于域对抗网络和BERT的跨领域文本情感分析 [J]. 山东大学学报(工学版) , 2020 , 50 ( 1 ): 1 - 7, 20 .

CAI G Y , LIN Q , REN K Q . Cross-domain text sentiment classification based on domain-adversarial network and BERT [J]. Journal of Shandong University (Engineering Science) , 2020 , 50 ( 1 ): 1 - 7, 20 . (in Chinese)

MADHAV KOTTETI C M , DONG X S , QIAN L J . Multiple time-series data analysis for rumor detection on social media [C]// 2018 IEEE International Conference on Big Data (Big Data) . Piscataway : IEEE , 2019 : 4413 - 4419 .

马鸣 , 刘云 , 刘地军 , 等 . 基于主题和预防模型的微博谣言检测 [J]. 北京理工大学学报 , 2020 , 40 ( 3 ): 310 - 315 .

MA M , LIU Y , LIU D J , et al . Rumor detection in microblogs based on topic and prevention model [J]. Transactions of Beijing Institute of Technology , 2020 , 40 ( 3 ): 310 - 315 . (in Chinese)

贾硕 , 张宁 , 沈洪洲 . 网络谣言传播与消解的研究进展 [J]. 信息资源管理学报 , 2019 , 9 ( 3 ): 62 - 72 .

JIA S , ZHANG N , SHEN H Z . Overviews on information dissemination and disappearance for online rumor [J]. Journal of Information Resources Management , 2019 , 9 ( 3 ): 62 - 72 . (in Chinese)

高玉君 , 梁刚 , 蒋方婷 , 等 . 社会网络谣言检测综述 [J]. 电子学报 , 2020 , 48 ( 7 ): 1421 - 1435 .

GAO Y J , LIANG G , JIANG F T , et al . Social network rumor detection: A survey [J]. Acta Electronica Sinica , 2020 , 48 ( 7 ): 1421 - 1435 . (in Chinese)

任文静 , 秦兵 , 刘挺 . 基于时间序列网络的谣言检测研究 [J]. 智能计算机与应用 , 2019 , 9 ( 3 ): 300 - 303 .

REN W J , QIN B , LIU T . Rumor detection based on time series model [J]. Intelligent Computer and Applications , 2019 , 9 ( 3 ): 300 - 303 . (in Chinese)

TORSHIZI A S , GHAZIKHANI A . Automatic Twitter rumor detection based on LSTM classifier [C]// Communications in Computer and Information Science . Cham : Springer , 2019 : 291 - 300 .

ZHOU Z Y , QI Y , LIU Z , et al . A C-GRU neural network for rumors detection [C]// 2018 5th IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS) . Piscataway : IEEE , 2019 : 704 - 708 .

JIN Z W , CAO J , GUO H , et al . Multimodal fusion with recurrent neural networks for rumor detection on microblogs [C]// Proceedings of the 25th ACM international conference on Multimedia . New York : ACM , 2017 : 795 - 816 .

MA J , GAO W , MITRA P , et al . Detecting rumors from microblogs with recurrent neural networks [C]// Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence . New York : ACM , 2016 : 3818 - 3824 .

YU F , LIU Q , WU S , et al . A convolutional approach for misinformation identification [C]// 5th International Conference on Learning Representations (ICLR) . Toulon : OpenReview , 2017 : 3901 - 3907 .

IANCU B , RUIZ L , RIBEIRO A , et al . Graph-adaptive activation functions for graph neural networks [C]// 2020 IEEE 30th International Workshop on Machine Learning for Signal Processing (MLSP) . Piscataway : IEEE , 2020 : 1 - 6 .

BIAN T A , XIAO X , XU T Y , et al . Rumor detection on social media with bi-directional graph convolutional networks [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2020 , 34 ( 1 ): 549 - 556 .

YUAN C Y , MA Q W , ZHOU W , et al . Jointly embedding the local and global relations of heterogeneous graph for rumor detection [C]// 2019 IEEE International Conference on Data Mining (ICDM) . Piscataway : IEEE , 2020 : 796 - 805 .

HUANG Q , YU J S , WU J , et al . Heterogeneous graph attention networks for early detection of rumors on twitter [C]// 2020 International Joint Conference on Neural Networks (IJCNN) . Piscataway : IEEE , 2020 : 1 - 8 .

CASTILLO C , MENDOZA M , POBLETE B . Information credibility on twitter [C]// Proceedings of the 20th International Conference on World Wide Web . New York : ACM , 2011 : 675 - 684 .

QAZVINIAN V , ROSENGREN E , RADEV D R , et al . Rumor has it: Identifying misinformation in microblogs [C]// Proceedings of the Conference on Empirical Methods in Natural Language Processing . New York : ACM , 2011 : 1589 - 1599 .

YANG F , LIU Y , YU X H , et al . Automatic detection of rumor on Sina Weibo [C]// Proceedings of the ACM SIGKDD Workshop on Mining Data Semantics . New York : ACM , 2012 : 1 - 7 .

MA J , GAO W , WEI Z Y , et al . Detect rumors using time series of social context information on microblogging websites [C]// Proceedings of the 24th ACM International on Conference on Information and Knowledge Management . New York : ACM , 2015 : 1751 - 1754 .

KWON S , CHA M , JUNG K , et al . Prominent features of rumor propagation in online social media [C]// 2013 IEEE 13th International Conference on Data Mining . Piscataway : IEEE , 2014 : 1103 - 1108 .

CHEN T , LI X , YIN H Z , et al . Call attention to rumors: Deep attention based recurrent neural networks for early rumor detection [C]// Pacific-Asia Conference on Knowledge Discovery and Data Mining . Cham : Springer , 2018 : 40 - 52 .

VAIBHAV V , MANDYAM R , HOVY E . Do sentence interactions matter? Leveraging sentence level representations for fake news classification [C]// Proceedings of the Thirteenth Workshop on Graph-Based Methods for Natural Language Processing (TextGraphs-13) . Stroudsburg : Association for Computational Linguistics , 2019 : 134 - 139 .

SHARMA S , SHARMA R . Identifying possible rumor spreaders on twitter: A weak supervised learning approach [C]// 2021 International Joint Conference on Neural Networks (IJCNN) . Piscataway : IEEE , 2021 : 1 - 8 .

KIPF T N , WELLING M . Semi-supervised classification with graph convolutional networks [C]// 5th International Conference on Learning Representations (ICLR) . Toulon : OpenReview , 2017 : 3294 - 3302 .

SONG W P , XIAO Z P , WANG Y F , et al . Session-based social recommendation via dynamic graph attention networks [C]// Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining . New York : ACM , 2019 : 555 - 563 .

VASWANI A , SHAZEER N , PARMAR N , et al . Attention is all you need [C]// Proceedings of the 31st International Conference on Neural Information Processing Systems . New York : ACM , 2017 : 6000 - 6010 .

MASETTI G , DI GIANDOMENICO F . Analyzing forward robustness of feedforward deep neural networks with LeakyReLU activation function through symbolic propagation [C]// Joint European Conference on Machine Learning and Knowledge Discovery in Databases . Cham : Springer , 2020 : 460 - 474 .

LIU Y , WU Y F . Early detection of fake news on social media through propagation path classification with recurrent and convolutional networks [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2018 , 32 ( 1 ): 354 - 361 .

WEI L W , HU D , ZHOU W , et al . Towards propagation uncertainty: Edge-enhanced Bayesian graph convolutional networks for rumor detection [C]// Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) . Stroudsburg : Association for Computational Linguistics , 2021 : 3845 - 3854 .

WANG G , TAN L , SONG T B , et al . Region-enhanced deep graph convolutional networks for rumor detection [EB/OL]. ( 2022-06-15 )[ 2022-07-25 ]. https://arxiv.org/abs/2206.07665 https://arxiv.org/abs/2206.07665 .

WANG H D , BAI C Z , YAO J L . Federated graph attention network for rumor detection [EB/OL]. ( 2022-06-12 )[ 2022-07-25 ]. https://arxiv.org/abs/2206.05713 https://arxiv.org/abs/2206.05713 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰