Pilot’s Brain Fatigue Detection Based on Deep Topic Model

WU Qi; CHEN Qi-qi; PENG Xian-yong; QIU Feng

doi:10.12263/DZXB.20201267

您当前的位置：

首页 >

文章列表页 >

Pilot’s Brain Fatigue Detection Based on Deep Topic Model

PAPERS | 更新时间：2025-12-08

- Pilot’s Brain Fatigue Detection Based on Deep Topic Model
- ACTA ELECTRONICA SINICA Vol. 50, Issue 8, Pages: 1801-1810(2022)
- 作者机构：
  
  1.上海交通大学自动化系，上海 200240
  2.系统控制与信息处理教育部重点实验，上海 200240
  3.上海工业智能管控工程技术研究中心，上海 200240
  4.中国矿业大学低碳能源与动力工程学院，江苏徐州 221116
- 作者简介：
- 基金信息：
- DOI：10.12263/DZXB.20201267
  CLC： TP181;
- Received：09 November 2020，
  
  Revised：2021-10-18，
  
  Published：25 August 2022
- 稿件说明：
移动端阅览
吴奇,陈琪琦,彭献永等.基于深度主题模型的飞行员脑疲劳检测[J].电子学报,2022,50(08):1801-1810.

WU Qi,CHEN Qi-qi,PENG Xian-yong,et al.Pilot’s Brain Fatigue Detection Based on Deep Topic Model[J].ACTA ELECTRONICA SINICA,2022,50(08):1801-1810.
吴奇,陈琪琦,彭献永等.基于深度主题模型的飞行员脑疲劳检测[J].电子学报,2022,50(08):1801-1810. DOI： 10.12263/DZXB.20201267.

WU Qi,CHEN Qi-qi,PENG Xian-yong,et al.Pilot’s Brain Fatigue Detection Based on Deep Topic Model[J].ACTA ELECTRONICA SINICA,2022,50(08):1801-1810. DOI： 10.12263/DZXB.20201267.

摘要

飞行员脑疲劳状态检测需要解决脑认知图谱生成和脑疲劳检测模型构建问题.针对第一个问题，本文通过等距方位投影法将全脑电极位置的脑疲劳指标映射为二维脑功率图谱，形成一种新型脑认知图谱.针对第二个问题，本文建立一种深度主题学习模型，即深度潜狄利克雷模型（Deep Latent Dirichlet Model，DLDM），解决了飞行员疲劳状态主题学习问题.DLDM深度模型通过多项式分布逐层扩展脑功率图谱中蕴含的概率分布信息，推理脑功率图谱的层次概率分布特征，实现更有效的飞行员疲劳状态主题学习.同时为了避免启发式假设，本文提出一种有效的不同层与主题间自适应学习率的随机梯度下降推断方法，更加高效地推理DLDM网络结构参数.实验结果显示，DLDM网络可以逐层扩展脑功率图谱中蕴含的概率分布信息，推理出更丰富的抽象特征信息，实现脑疲劳认知主题学习.对比其他脑疲劳检测方法，本文方法分类精度可提升2%.

Abstract

The detection of a pilot's brain fatigue state faces two important problems

which are how to generate a brain cognitive map and how to build a brain fatigue detection model. To solve the first problem

this paper uses the isometric azimuth projection to map brain fatigue indicators into a new type of brain power map. To solve the second problem

this work develops a deep latent Dirichlet model(DLDM)

which solves the topic detection problem of pilot fatigue state. DLDM expands the probability distribution information contained in the developed brain power map layer by layer through multiple distributions

infers their hierarchical probability distribution characteristics

and gets more effective topic detection accuracy of pilot fatigue state. In order to avoid heuristic assumptions

this paper also proposes an effective stochastic gradient descent inference method with an adaptive learning rate between different layers and topics to more efficiently infer structure parameters of DLDM. The experimental results show that the DLDM can expand the probability distribution information of the brain power map layer by layer

infer richer abstract feature information

and detect brain fatigue cognitive topic. Compared with other brain fatigue detection methods

the classification accuracy of the proposed method can be improved by 2%.

关键词

Keywords

references

MA J , ZHANG J , GONG Z Y , et al . Study on fatigue driving detection model based on steering operation features and eye movement features [C]// 2018 IEEE 4th International Conference on Control Science and Systems Engineering . Wuhan, China : IEEE , 2018 : 472 - 475 .

SETIAWAN A , WIBAWA A D , PANE E S , et al . EEG-based mental fatigue detection using cognitive tests and RVM classification [C]// 2019 International Conference of Artificial Intelligence and Information Technology(ICAIIT) . Yogyakarta, Indonesia : IEEE , 2019 : 180 - 185 .

KARUPPUSAMY N S , KANG B Y . Multimodal system to detect driver fatigue using EEG, gyroscope, and image processing [J]. IEEE Access , 2020 , 8 : 129645 - 129667 .

JAP B T , LAL S , FISCHER P , et al . Using EEG spectral components to assess algorithms for detecting fatigue [J]. Expert Systems With Applications , 2009 , 36 ( 2 ): 2352 - 2359 .

SIEMIONOW V , FANG Y , CALABRESE L , et al . Altered central nervous system signal during motor performance in chronic fatigue syndrome [J]. Clinical Neurophysiology , 2004 , 115 ( 10 ): 2372 - 2381 .

PAPADELIS C , KOURTIDOU-pAPADELI C , BAMIDIS P D , et al . Indicators of sleepiness in an ambulatory EEG study of night driving [C]// 2006 International Conference of the IEEE Engineering in Medicine and Biology Society . New York, NY, USA : IEEE , 2006 : 6201 - 6204 .

WU Q , DENG P Y , QIU X Y , et al . Detecting fatigue status of pilots based on deep learning network using EEG signals [J]. IEEE Transactions on Cognitive and Developmental Systems , 2021 , 13 ( 3 ): 575 - 585 .

MING Y R , WU D R , WANG Y K , et al . EEG-based drowsiness estimation for driving safety using deep Q-learning [J]. IEEE Transactions on Emerging Topics in Computational Intelligence , 2021 , 5 ( 4 ): 583 - 594 .

LIN C T , CHUANG C H , HUNG Y C , et al . A driving performance forecasting system based on brain dynamic state analysis using 4-D convolutional neural networks [J]. IEEE Transactions on Cybernetics , 2021 , 51 ( 10 ): 4959 - 4967 .

DU G L , WANG Z Y , LI C Q , et al . A TSK-type convolutional recurrent fuzzy network for predicting driving fatigue [J]. IEEE Transactions on Fuzzy Systems , 2021 , 29 ( 8 ): 2100 - 2111 .

ZHENG W L , LU B L . Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks [J]. IEEE Transactions on Autonomous Mental Development , 2015 , 7 ( 3 ): 162 - 175 .

LI J H , STRUZIK Z , ZHANG L Q , et al . Feature learning from incomplete EEG with denoising autoencoder [J]. Neurocomputing , 2015 , 165 : 23 - 31 .

CECOTTI H , GRAESER A . Convolutional neural network with embedded fourier transform for EEG classification [C]// 2008 19th International Conference on Pattern Recognition . Tampa, FL, USA : IEEE , 2008 : 1 - 4 .

ALHUSSEIN M , MUHAMMAD G , Hossain M S . EEG pathology detection based on deep learning [J]. IEEE Access , 2019 , 7 : 27781 - 27788 .

SONG Y G , WANG D L , YUE K , et al . EEG-based motor imagery classification with deep multi-task learning [C]// 2019 International Joint Conference on Neural Networks(IJCNN) . Budapest, Hungary : IEEE , 2019 : 1 - 8 .

BHARDWAJ R , PARAMESWARAN S , BALASUBRAMANIAN V . Performance comparison of machine learning and deep learning while classifying driver's cognitive state [C]// 2018 IEEE 13th International Conference on Industrial and Information Systems . Rupnagar, India : IEEE , 2018 : 89 - 93 .

孙曜 , 文成林 , 韦巍 . 基于脑电和眼电的运动想象多尺度识别方法研究 [J]. 电子学报 , 2018 , 46 ( 3 ): 714 - 720 .

SUN Y , WEN C L , WEI W . Research on EEG and EOG based multiscale recognization method of motor imagery [J]. Acta Electronica Sinica , 2018 , 46 ( 3 ): 714 - 720 . (in Chinese)

张学军 , 景鹏 , 何涛 , 等 . 基于变分模态分解的癫痫脑电信号分类方法 [J]. 电子学报 , 2020 , 48 ( 12 ): 2469 - 2475 .

ZHANG X J , JING P , HE T , et al . An epileptic electroencephalogram signal classification method based on variational mode decomposition [J]. Acta Electronica Sinica , 2020 , 48 ( 12 ): 2469 - 2475 . (in Chinese)

AHMED S , MAURICIO MERINO L , MAO Z , et al . A deep learning method for classification of images RSVP events with EEG data [C]// 2013 IEEE Global Conference on Signal and Information Processing . Austin, TX, USA : IEEE , 2013 : 33 - 36 .

GAO Y B , LEE H J , MEHMOOD R M . Deep learninig of EEG signals for emotion recognition [C]// 2015 IEEE International Conference on Multimedia & Expo Workshops . Turin, Italy : IEEE , 2015 : 1 - 5 .

YANG Y X , GAO Z K , LI Y L , et al . A complex network-based broad learning system for detecting driver fatigue from EEG signals [J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems , 2021 , 51 ( 9 ): 5800 - 5808 .

ZHANG C , SUN L N , CONG F Y , et al . Spatiotemporal dynamical analysis of brain activity during mental fatigue process [J]. IEEE Transactions on Cognitive and Developmental Systems , 2021 , 13 ( 3 ): 593 - 606 .

WU Q , ZHU L M , LI G J , et al . Nonparametric hierarchical hidden semi-Markov model for brain fatigue behavior detection of pilots during flight [J]. IEEE Transactions on Intelligent Transportation Systems , 2021 , 23 ( 6 ): 5245 - 5256 .

CONG Y L , CHEN B , LIU H W , et al . Deep latent dirichlet allocation with topic-layer-adaptive stochastic gradient Riemannian MCMC [C]// ICML'17: Proceedings of the 34th International Conference on Machine Learning-Volume 70 . Sydney, NSW, Australia : ACM . 2017 : 864 - 873 .

GOLUB G H , LOAN C F VAN . Matrix Computations [M]. Washington , D . C , USA : Johns Hopkins University Press , 2012 .

WU X , SPALL J C . Improved Monte Carlo estimation of the fisher information matrix with independent perturbations [C]// 2021 55th Annual Conference on Information Sciences and Systems(CISS) . Baltimore, MD, USA : IEEE , 2021 : 1 - 5 .

SNYDER J P . Map Projections--A working Manual [M]. Washington, DC, USA : US Government Printing Office , 1987 : 55 - 90 .

BENGIO Y , LAMBLIN P , POPOVICI D , et al . Greedy layer-wise training of deep networks [C]// Advances in Neural Information Processing Systems 19: Proceedings of the 2006 Conference . Vancouver , B .C., Canada: MIT Press , 2007 : 153 - 160 .

AMARI S I . Natural gradient works efficiently in learning [J]. Neural Computation , 1998 , 10 ( 2 ): 251 - 276 .

LAWHERN V J , SOLON A J , WAYTOWICH N R , et al . EEGNet: A compact convolutional neural network for EEG-based brain-computer interfaces [J]. Journal of Neural Engineering , 2018 , 15 ( 5 ): 056013 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

No data

Related Author

Qi WU

Qi-qi CHEN

Xian-yong PENG

Feng QIU

Related Institution

Dept of Automation， Shanghai Jiao Tong University

Key Laboratory of System Control and Information Processing， Ministry of Education of China

Shanghai Engineering Research Center of Intelligent

School of Low-Carbon Energy and Power Engineering， China University of Mining and Technology

⁰