This paper investigates the safe optimal control for input-constrained unknown stochastic systems via adaptive dynamic programming (ADP) and generalized fuzzy hyperbolic model (GFHM) and the Lyapunov method is utilized to guarantee the uniform ultimate boundedness of the system states and the weight estimation errors of the critic neural networks.
Abstract
This paper investigates the safe optimal control (SOC) for input-constrained unknown stochastic systems via adaptive dynamic programming (ADP) and generalized fuzzy hyperbolic model (GFHM). Firstly, a GFHM is employed to approximate the unknown nonlinear terms of the stochastic system, thereby eliminating the need for exact system modeling. Secondly, a modified nonquadratic value function is developed to address the problem of asymmetric input constraints (AICs), where a control barrier function (CBF) with a damping factor is incorporated to penalize unsafe behaviors. Thirdly, based on ADP, the optimal control policy is obtained by solving the modified Hamilton-Jacobi-Bellman (HJB) equation. Furthermore, a dynamic event-triggered mechanism (DETM) is proposed to alleviate the computational burden and conserve communication resources. In addition, the Lyapunov method is utilized to guarantee the uniform ultimate boundedness (UUB) of the system states and the weight estimation errors of the critic neural networks (CNNs). Finally, two simulation examples are provided to demonstrate the effectiveness of the proposed control strategy.
A novel follower-type integral barrier Lyapunov function (FIBLF) is proposed to construct full-state dynamic constraint boundaries that translate synchronously with the desired trajectory while maintaining a constant bandwidth.
Wei Zhang, Jian-Feng Li, Ming-Jie Dong et al.· ISA transactions· 0 citations
This paper proposes a novel control scheme based on adaptive dynamic programming (ADP) to address the approximate optimal control problem of asymmetric full‐state and input constraints in general affine nonlinear systems. First, by introducing an asymmetric barrier penalty term into the cost function and constructing...
Yi-Zhuo Liu, Ke-Mao Ma· International Journal of Rob...· 0 citations
A novel mode-free reinforcement learning (RL) algorithm is proposed for the optimal control of unknown nonlinear system presented by the interval type-2 fuzzy (IT2F) model. The optimal control is converted into a zero-sum game, where the control input and the external disturbance are the opposing competitors. Based on...
Runkun Li, Wen-Hai Qi, Guang-Deng Zong et al.· IEEE Transactions on Cyberne...· 0 citations
This article addresses the optimal stabilization of unknown nonlinear networked industrial systems (NISs) with limited communication resources, proposing an innovative self-triggered approximate optimal control framework fused with generalized fuzzy hyperbolic model (GFHM) and reinforcement learning (RL) gradient desce...
Jian Liu, Jingjing Xia, Li-Juan Zha et al.· IEEE Transactions on Industr...· 0 citations
Through rigorous mathematical analysis and numerical simulations, it can be concluded that the proposed control scheme can not only drive all system variables to converge to steady states within a prescribed time in probability, but also make the output track the desired signal without violating the output constraint.
Daohong Zhu, Lian-Di Fang, Hong-Yi Xia· Measurement and control (Lon...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.