title: Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with ε-error bound.
abstract: In this paper, we study the finite-horizon optimal control problem for discrete-time nonlinear systems using the adaptive dynamic programming (ADP) approach. The idea is to use an iterative ADP algorithm to obtain the optimal control law which makes the performance index function close to the greatest lower bound of all performance indices within an ε-error bound. The optimal number of control steps can also be obtained by the proposed ADP algorithms. A convergence analysis of the proposed ADP algorithms in terms of performance index function and control policy is made. In order to facilitate the implementation of the iterative ADP algorithms, neural networks are used for approximating the performance index function, computing the optimal control policy, and modeling the nonlinear system. Finally, two simulation examples are employed to illustrate the applicability of the proposed method.
authors.affiliation: Key Laboratory of Complex Systems and Intelligence Science, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China. feiyue.wang@ia.ac.cn
authors.forename: Fei-Yue
authors.initials: FY
authors.lastname: Wang
authors.forename: Ning
authors.initials: N
authors.lastname: Jin
authors.forename: Derong
authors.initials: D
authors.lastname: Liu
authors.forename: Qinglai
authors.initials: Q
authors.lastname: Wei
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D016571:Neural Networks, Computer; D017711:Nonlinear Dynamics; D012984:Software / Q000592:standards*; D013598:Systems Theory