New adapted spectral method for solving stochastic optimal control problem

Optimal control theory is a branch of mathematics. It is developed to find optimal ways to control a dynamic system. In ۱۹۵۷, R.Bellman applied dynamic programming to solve optimal control of discrete-time systems. His procedure resulted in closed-loop,  generally nonlinear, and feedback schemes. Optimal control problems which will be tackled involve the minimization of a cost function subject to constraints on the state vector and the control. Lagrange multipliers provide a method of converting a constrained minimization problem into an unconstrained minimization problem of higher order. The necessary condition for optimality can be obtained as the solution of the unconstrained optimization problem of the Lagrange function and the bordered Hessian matrix is used for the second-derivative test. A spectral method for solving optimal control problems is presented. The method is based on Bernoulli polynomials approximation. By using the Bernoulli operational matrix of integration and the Lagrangian function, stochastic optimal control is transformed into an optimisation problem, where the unknown Bernoulli coefficients are determined by using Newton's iterative method. The convergence analysis of the proposed method is given. The simulation results based on the Monte-Carlo technique prove the performance of the proposed method. Some error estimations are provided and illustrative examples are also included to demonstrate the efficiency and applicability of the proposed method.

Keywords:

Bernoulli polynomial , Open loop , feedback , Optimal control problem , Operational matrix , Brownian motion