LI Huan-zhe, WU Zhi-jian, WANG Shen-wen, et al. The Overview of Learning Mechanism of Covariance Matrix Adaptation Evolution Strategy[J]. Acta Electronica Sinica, 2017, 45(1): 238-245.
DOI:
LI Huan-zhe, WU Zhi-jian, WANG Shen-wen, et al. The Overview of Learning Mechanism of Covariance Matrix Adaptation Evolution Strategy[J]. Acta Electronica Sinica, 2017, 45(1): 238-245. DOI: 10.3969/j.issn.0372-2112.2017.01.033.
The Overview of Learning Mechanism of Covariance Matrix Adaptation Evolution Strategy
The evolution strategy (ES) based on covariance matrix adaptation (CMA) is an excellent
gradient-free stochastic local optimization method.The learning mechanism based on CMA enables evolution strategy algorithm to have invariance to any invertible linear transformation of the search space
and to have outstanding capability for solving the ill-conditioned and/or highly non-separable problems.The learning mechanism of CMA has a solid theoretical foundation in mathematics
which may have a certain reference significance to guide the design of other evolutionary algorithms.This paper aims at analyzing the learning mechanisms of CMA-ES in detail
and providing its main mathematical foundations.Finally
the advantages and disadvantages of various CMA-ES variants are compared by a series of experiments
and the difference in performance is compared seriously between our improved variant and other CMA-ES variants.