HMM Structure Optimization Based on Genetic Nonparametric MDL-BW Method

XU Jia-wei; LUO Qian

doi:10.12263/DZXB.20210870

您当前的位置：

首页 >

文章列表页 >

HMM Structure Optimization Based on Genetic Nonparametric MDL-BW Method

PAPERS | 更新时间：2025-12-08

- HMM Structure Optimization Based on Genetic Nonparametric MDL-BW Method
- ACTA ELECTRONICA SINICA Vol. 50, Issue 11, Pages: 2765-2772(2022)
- 作者机构：
  
  1.北京信息科技大学信息与通信工程学院, 北京 100101
  2.北京信息科技大学光电测试技术及仪器教育部重点实验室, 北京 100101
- 作者简介：
- 基金信息：
- DOI：10.12263/DZXB.20210870
  CLC： TP181
- Received：09 July 2021，
  
  Revised：2021-12-02，
  
  Published：25 November 2022
- 稿件说明：
移动端阅览
徐佳伟,罗倩.基于遗传非参数MDL-BW方法的HMM结构优化[J].电子学报,2022,50(11):2765-2772.

XU Jia-wei,LUO Qian.HMM Structure Optimization Based on Genetic Nonparametric MDL-BW Method[J].ACTA ELECTRONICA SINICA,2022,50(11):2765-2772.
徐佳伟,罗倩.基于遗传非参数MDL-BW方法的HMM结构优化[J].电子学报,2022,50(11):2765-2772. DOI： 10.12263/DZXB.20210870.

XU Jia-wei,LUO Qian.HMM Structure Optimization Based on Genetic Nonparametric MDL-BW Method[J].ACTA ELECTRONICA SINICA,2022,50(11):2765-2772. DOI： 10.12263/DZXB.20210870.

摘要

隐马尔科夫模型（Hidden Markov Model，HMM）广泛用于语音信号等时序信号的建模.HMM的结构优化包括模型参数个数优化和参数值的优化.针对传统的用于训练HMM的鲍姆-韦尔奇（Baum Welch，BW）算法在寻求最优解时容易陷入局部极值以及无法优化HMM参数个数的问题，本文提出了遗传非参数MDL-BW方法.该方法通过结合遗传（Genetic Algorithm，GA）算法随机搜索的特点和自适应思想来扩大HMM参数值解的搜索空间，结合非参数思想帮助自动寻求HMM的合适参数个数，同时以最小描述长度MDL（Minimum Description Length，MDL）作为模型优化准则来寻求HMM在全局上的最优结构.仿真数据、语音数据以及人体动作数据的仿真结果表明遗传非参数MDL-BW方法相较BW方法等同类方法在HMM结构的寻求上具有更好的效果.

Abstract

Hidden Markov model(HMM) is widely used for modeling time series signals such as speech signals. The structural optimization of HMM includes optimization of the number of model parameters and parameter values. Aiming at the problem that the traditional Baum Welch(BW) method used to train HMM is easy to fall into local maxima and the number of parameters cannot be optimized when seeking the optimal solution

genetic nonparametric MDL-BW method was proposed. This method expanded the search space of parameter values of HMM by combining the characteristics of stochastic search of genetic algorithm(GA) with adaptive ideas

and combined nonparametric ideas to help automatically find the appropriate number of HMM parameters

and used minimum description length(MDL) as optimization criterion to find the global optimal structure of HMM. Based on simulation data

speech data and human action data

the results show that the genetic nonparametric MDL-BW method has a better performance in searching for the structure of the HMM comparing with the BW method and other similar methods.

关键词

Keywords

references

刘建伟 , 黎海恩 , 等 . 概率图模型的表示理论综述 [J]. 电子学报 , 2016 , 44 ( 5 ): 1219 ‐ 1226 .

LIU Jian-wei , LI Hai-en , et al . A survey on the representation theory of probabilistic graphical models [J]. Acta Electronica Sinica , 2016 , 44 ( 5 ): 1219 ‐ 1226 . (in Chinese)

SUNDARARAJAN P K . Improving the Performance and Understanding of the Expectation Maximization Algorithm: Evolutionary and Visualization Methods [D]. Pittsburgh, PA : Carnegie Mellon University , 2016 .

张西宁 , 雷威 , 等 . 采用自适应基因粒子群算法优化隐马尔科夫模型的方法及应用 [J]. 西安交通大学学报 , 2018 , 52 ( 8 ): 1 ‐ 8 .

ZHANG Xining , LEI Wei , et al . Adaptive genetic particle swarm algorithm for optimization hidden Markov models with applications [J]. Journal of Xi'an Jiaotong University , 2018 , 52 ( 8 ): 1 ‐ 8 . (in Chinese)

BENMACHICHE A , MAKHLOUF A , BOUHADADA T . Evolutionary learning of HMM with Gaussian mixture densities for automatic speech recognition [C]// Proceedings of the 9th International Conference on Information Systems and Technologies(ICIST) . Cairo, Egypt : ACM , 2019 : 1 ‐ 6 .

MAKHLOUF A , LAZLI L , BENSAKER B . Evolutionary structure of hidden Markov models for audio-visual Arabic speech recognition [J]. International Journal of Signal and Imaging Systems Engineering , 2016 , 9 ( 1 ): 55 ‐ 66 .

崔佳旭 , 杨博 . 贝叶斯优化方法和应用综述 [J]. 软件学报 , 2018 , 29 ( 10 ): 3068 ‐ 3090 .

CUI Jia-xu , YANG Bo . Survey on Bayesian optimization methodology and applications [J]. Journal of Software , 2018 , 29 ( 10 ): 3068 ‐ 3090 . (in Chinese)

杨扬 . 基于最小描述长度的大规模图数据结构分析 [D]. 合肥 : 中国科学技术大学 , 2018 .

YANG Yang . Structure Analysis of Large Graph Data Based on Minimum Description Length [D]. Hefei : University of Science and Technology of China , 2018 . (in Chinese)

王为凯 . 基于GMM-HMM的声学模型训练研究 [D]. 广州 : 华南理工大学 , 2016 .

WANG Weikai . Rearch of the GMM-HMM Based Acoustic Models [D]. Guangzhou : South China University of Technology , 2016 . (in Chinese)

李航 . 统计学习方法 [M]. 北京：清华大学出版社 , 2012 : 181 ‐ 183 .

AMSALU S B , HOMAIFAR A . Driver behavior modeling near intersections using hidden Markov model based on genetic algorithm [C]// IEEE International Conference on Intelligent Transportation Engineering(ICITE) . Singapore : IEEE , 2016 : 193 ‐ 200 .

BISHOP C M . Pattern Recognition and Machine Learning [M]. New York : Springer , 2006 : 627 ‐ 629 .

LEHRMANN A M , GEHLER P V , NOWOZIN S . Efficient nonlinear markov models for human motion [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR) . Columbus, OH, USA : IEEE , 2014 : 1314 ‐ 1321 .

LI Wanqing , ZHANG Zhengyou , LIU Zicheng . Action recognition based on a bag of 3D points [C]// Proceedings of the IEEE Conference on Computer Vision & Pattern Recognition Workshops(CVPRW) . San Francisco, CA, USA : IEEE , 2010 : 9 ‐ 14 .

SOSIAWAN A Y , NOORAENI R , SARI L K . Implementation of using HMM-GA in time series data [J]. Procedia Computer Science , 2021 , 179 : 713 ‐ 720 .

BLEI D M , KUCUKELBIR A , MCAULIFFE J D . Variational inference: a review for statisticians [J]. Journal of the American Statistical Association , 2017 , 112 ( 518 ): 859 ‐ 877 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Differential Evolution Without the Scale Factor F

Genetic-Algorithm-Based Model Parameter Extraction for Sub-100nm SOI MOSFET

A Novel Interval-Genetic Algorithm

Related Author

Qian LUO

Jia-wei XU

MENG Xiang-wei

LIU San-yang

ZHANG Xiao-wei

LIN Yao

ZHANG Xiao-juan

ZHANG Rui-zhi

Related Institution

Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument， Beijing Information Science & Technology University

College of Information and Communication Engineering， Beijing Information Science & Technology University

Naval Aeronautical and Astronautical UniversityYantaiShandong 264001China

Naval Aeronautical and Astronautical University

School of Applied MathematicsUniversity of Electronic Science and Technology of ChinaChengduSichuan 610054China

⁰