A variable structure multi‐model maneuvering target tracking algorithm based on Monte Carlo learning

Abstract A well‐liked maneuvering target tracking algorithm is a variable structure multi‐model (VSMM). One of the crucial elements determining the tracking effect is the successful model set adaptation (MSA). The ability to further enhance tracking accuracy for the conventional VSMM method is constrained by the absence of a mechanism to thoroughly utilise observation and tracking data to optimise MSA. We incorporate the Reinforcement learning (RL) approach into the MSA procedure to address this issue and provide a VSMM algorithm based on Monte Carlo (MC) learning. To formulate the challenge of optimising the number of effective models as a RL problem, we first used the prediction error, the number of effective model sets, and tracking accuracy to build the models of the appropriate state space, decision space, and reward. The number of efficient models was optimised using MC learning, and the entire VSMM algorithm was then created. The proposed approach was compared to the simulated experiment's five maneuvering target tracking algorithms. The outcomes demonstrate that the suggested algorithm has a lower computation scale and accurate tracking accuracy.