Tang, J;
Zhou, Z;
Feng, W;
Wong, KK;
(2023)
A Distributed and Adaptive Routing Protocol for UAV-aided Emergency Networks.
In:
IEEE Vehicular Technology Conference.
IEEE: Hong Kong, Hong Kong.
Preview |
Text
VTC_final_version.pdf - Accepted Version Download (838kB) | Preview |
Abstract
Due to its strong flexibility, easy deployment, high maneuverability and extensive connectivity, unmanned aerial vehicle (UAV) swarm has been widely used in the construction of emergency communication network in recent years. Among them, packet routing in a resilient and adaptive manner is one of the fundamental problems for cooperation between multiple UAVs to complete search and rescue tasks. Recently, reinforcement learning (RL) technique has provided a new opportunity for network-related applications, including routing. However, most existing RL-based routing protocols suffer from issues such as local optimum, blind exploration and slow convergence speed. Additionally, the routing protocols based on deep reinforcement learning (DRL) has high computational complexity, making them unsuitable for energy-limited emergency relief scenarios. In this paper, we proposed a Q-learning aided resilient routing protocol with hindsight pre-calculation (QR2HPC) in UAV swarm for the construction of the emergency networks. Firstly, a dynamic exploration and exploitation coefficient is proposed based on the number and speed of neighbors. Secondly, a warm-start mechanism is proposed in the exploration phase that modifies the traditional random next hop selection to a routing approach guided by various indicators. Finally, we introduce a hindsight pre-calculation (HPC) mechanism to improve the robustness of Q-table to traffic flow changes. The experimental results manifest that our protocols can make effective routing decisions in dynamic wireless multi-hop networks, thereby enhancing the system performances in terms of packet delivery ratio, end-to-end delay, throughput and network lifetime.
| Type: | Proceedings paper |
|---|---|
| Title: | A Distributed and Adaptive Routing Protocol for UAV-aided Emergency Networks |
| Event: | 2023 IEEE 98th Vehicular Technology Conference (VTC2023-Fall) |
| Dates: | 10 Oct 2023 - 13 Oct 2023 |
| ISBN-13: | 9798350329285 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/VTC2023-Fall60731.2023.10333575 |
| Publisher version: | https://doi.org/10.1109/VTC2023-Fall60731.2023.103... |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | UAV swarm, emergency wireless communication networks, routing protocol, Q-Learning |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10186533 |
Archive Staff Only
 |
View Item |
