Global Path Planning of Quadrotor Using Reinforcement Learning

Publish Year: 1401
نوع سند: مقاله ژورنالی
زبان: English
View: 120

This Paper With 15 Page And PDF Format Ready To Download

  • Certificate
  • من نویسنده این مقاله هستم

استخراج به نرم افزارهای پژوهشی:

لینک ثابت به این Paper:

شناسه ملی سند علمی:

JR_JCR-15-1_006

تاریخ نمایه سازی: 9 مرداد 1401

Abstract:

This paper aims to improve the trajectory by an extended reinforcement learning based method in which a new tracking algorithm is used for mobile robot applications with low-rate control command. There are some trajectories that underactuated robots, like quadrotors, are unable to track; hence a suitable trajectory should be designed with respect to the robot's dynamics. In this paper, the initial trajectory is generated by Rapidly-exploring Random Tree Star algorithm which is not suitable for quadrotor application. Then, the initial trajectory is improved by an extension of Path Integral Policy Improvement with Covariance Matrix Adaption (PI۲-CMA) algorithm. The extension includes improving tracking algorithm and controller performance considering low-rate control command. Our proposed algorithm succeeded to reduce the cost of tracking by designing safer and shorter trajectories which are more suitable for real robots. Furthermore, the results show that the proposed tracking algorithm and controller improve the performance of tracking. The hardware requirements for implementing our proposed method are a webcam and a personal computer; therefore with a low-cost implementation of the proposed method, a suitable trajectory is designed. In this paper, the initial trajectory is improved by an extension of PI۲-CMA algorithm in which the trajectory tracking is performed such that reciprocating motions are avoided. Also, desired velocity and acceleration are used by controller for better tracking.

Keywords:

Quadrotor robot , Path planning , Trajectory tracking and Reinforcement learning

Authors

Mehdi Khakbaz

Department of Electrical Engineering, Sabzevar Branch, Islamic Azad University, Sabzevar, Iran

Majid Anjidani

Department of Computer Engineering and Information Technology, Payame Noor University, Tehran, Iran