title: Optimal tracking control for a class of nonlinear discrete-time systems with time delays based on heuristic dynamic programming.
abstract: In this paper, a novel heuristic dynamic programming (HDP) iteration algorithm is proposed to solve the optimal tracking control problem for a class of nonlinear discrete-time systems with time delays. The novel algorithm contains state updating, control policy iteration, and performance index iteration. To get the optimal states, the states are also updated. Furthermore, the "backward iteration" is applied to state updating. Two neural networks are used to approximate the performance index function and compute the optimal control policy for facilitating the implementation of HDP iteration algorithm. At last, we present two examples to demonstrate the effectiveness of the proposed HDP iteration algorithm.
authors: School of Information Science and Engineering, Northeastern University, Shenyang 110004, China. hgzhang@ieee.org
authors: Huaguang
authors: H
authors: Zhang
authors: Ruizhuo
authors: R
authors: Song
authors: Qinglai
authors: Q
authors: Wei
authors: Tieyan
authors: T
authors: Zhang
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D005246:Feedback; D017711:Nonlinear Dynamics; D010363:Pattern Recognition, Automated / Q000379:methods*; D011382:Programming, Linear; D012815:Signal Processing, Computer-Assisted