Multi-UAV Tactic Switching via Model Predictive Control and Fuzzy Q-Learning
Hafez, A., Givigi, S., Yousefi, S., Iskandarani, M. (2017). Multi-UAV Tactic Switching via Model Predictive Control and Fuzzy Q-Learning. EKB Journal Management System, 1(2), 44-57. doi: 10.21608/ejmtc.2017.437.1012
Ahmed Taimour Hafez; Sidney N. Givigi; Shahram Yousefi; Mohamad Iskandarani. "Multi-UAV Tactic Switching via Model Predictive Control and Fuzzy Q-Learning". EKB Journal Management System, 1, 2, 2017, 44-57. doi: 10.21608/ejmtc.2017.437.1012
Hafez, A., Givigi, S., Yousefi, S., Iskandarani, M. (2017). 'Multi-UAV Tactic Switching via Model Predictive Control and Fuzzy Q-Learning', EKB Journal Management System, 1(2), pp. 44-57. doi: 10.21608/ejmtc.2017.437.1012
Hafez, A., Givigi, S., Yousefi, S., Iskandarani, M. Multi-UAV Tactic Switching via Model Predictive Control and Fuzzy Q-Learning. EKB Journal Management System, 2017; 1(2): 44-57. doi: 10.21608/ejmtc.2017.437.1012

Multi-UAV Tactic Switching via Model Predictive Control and Fuzzy Q-Learning

Journal of Engineering Science and Military Technologies
Article 1, Volume 1, Issue 2, October 2017, Page 44-57  XML PDF (1.06 MB)
Document Type: Original Article
DOI: 10.21608/ejmtc.2017.437.1012
View on SCiNiTO View on SCiNiTO
Authors
Ahmed Taimour Hafez email 1; Sidney N. Givigi2; Shahram Yousefi; Mohamad Iskandarani2
1Head of Aircraft Armament Department
2Royal Military College of Canada
Abstract
Teams of cooperative Unmanned Aerial Vehicles (UAVs) require intelligent and flexible control strategies to allow the accomplishment of a multitude of challenging group tasks. In this paper, we introduce a solution for the problem of tactic switching between the formation flight tactic and the dynamic encirclement tactic for a team of 𝑁 cooperative UAVs using a predictive decentralize control approach. Decentralized Model Predictive Control (MPC) is used to generate tactics for a team of 𝑁 UAVs in simulation and real-world validation. A high-level Linear Model Predictive Control (LMPC) policy is used to control the UAV team during the execution of a desired formation, while a combination of decentralized LMPC and Feedback Linearization (FL) is applied to the UAV team to accomplish dynamic encirclement. The decision of switching from one tactic to the other is derived by a fuzzy logic controller, which, in its turn, is derived by a Reinforcement Learning (RL) approach. The main contributions of this paper are: (i) solution of the problem of tactic switching for a team of cooperative UAVs using LMPC and a fuzzy controller derived via RL; (ii) simulations demonstrating the efficiency of the method; and (iii) implementation of the solution to on-board real-time controllers on Qball-X4 quadrotors.
Keywords
model predictive control; Autonomous robotics; Cooperative robotics; Formation tactic; Dynamic Encirclement tactic
Statistics
Article View: 852
PDF Download: 936