title: A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm.
abstract: In this paper, we aim to solve the infinite-time optimal tracking control problem for a class of discrete-time nonlinear systems using the greedy heuristic dynamic programming (HDP) iteration algorithm. A new type of performance index is defined because the existing performance indexes are very difficult in solving this kind of tracking problem, if not impossible. Via system transformation, the optimal tracking problem is transformed into an optimal regulation problem, and then, the greedy HDP iteration algorithm is introduced to deal with the regulation problem with rigorous convergence analysis. Three neural networks are used to approximate the performance index, compute the optimal control policy, and model the nonlinear system for facilitating the implementation of the greedy HDP iteration algorithm. An example is given to demonstrate the validity of the proposed optimal tracking control scheme.
authors.affiliation: School of Information Science and Engineering, and the Key Laboratory of Integrated Automation of Process Industry Northeastern University, Shenyang 110004, China. hgzhang@ieee.org
authors.forename: Huaguang
authors.initials: H
authors.lastname: Zhang
authors.forename: Qinglai
authors.initials: Q
authors.lastname: Wei
authors.forename: Yanhong
authors.initials: Y
authors.lastname: Luo
mesh_terms: D000465:Algorithms; D003198:Computer Simulation; D005246:Feedback; D008962:Models, Theoretical; D017711:Nonlinear Dynamics; D011382:Programming, Linear; D013598:Systems Theory