title: An iterative ϵ-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state.
abstract: In this paper, a finite horizon iterative adaptive dynamic programming (ADP) algorithm is proposed to solve the optimal control problem for a class of discrete-time nonlinear systems with unfixed initial state. A new ϵ-optimal control algorithm based on the iterative ADP approach is proposed that makes the performance index function iteratively converge to the greatest lower bound of all performance indices within an error ϵ in finite time. The convergence analysis of the proposed ADP algorithm in terms of performance index function and control policy is conducted. The optimal number of control steps can also be obtained by the proposed ϵ-optimal control algorithm for the unfixed initial state. Neural networks are used to approximate the performance index function, and compute the optimal control policy, respectively, for facilitating the implementation of the ϵ-optimal control algorithm. Finally, a simulation example is given to show the effectiveness of the proposed method.
authors.affiliation: State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR China. qinglaiwei@gmail.com
authors.forename: Qinglai
authors.initials: Q
authors.lastname: Wei
authors.forename: Derong
authors.initials: D
authors.lastname: Liu
mesh_terms: D000465:Algorithms; D003198:Computer Simulation; D016571:Neural Networks, Computer; D017711:Nonlinear Dynamics; D012984:Software