Wang, Shuwu;
Yan, Xinping;
Ma, Feng;
Wu, Peng;
Liu, Yuanchang;
(2022)
A novel path following approach for autonomous ships based on fast marching method and deep reinforcement learning.
Ocean Engineering
, 257
, Article 111495. 10.1016/j.oceaneng.2022.111495.
Preview |
Text
Manuscript.pdf - Accepted Version Download (2MB) | Preview |
Abstract
Path following is one of the indispensable tools for autonomous ships, which ensures that autonomous ships are sufficiently capable of navigating in specified collision-free waters. This study proposes a novel path following approach for autonomous ships based on the fast marching (FM) method and deep reinforcement learning (DRL). The proposed approach is capable of controlling a ship to follow different paths and ensuring that the path tracking errors are always within a set range. With the help of the FM method, a grid-based path deviation map is specially produced to indicate the minimum distance between grid points and the path. Besides, a path deviation perceptron is specifically designed to simulate a range sensor for sensing the set path deviation boundaries based on the path deviation map. Afterwards, an agent is trained to control a ship following a circular path based on the DRL. Particularly, the approach is validated and evaluated through simulations. The obtained results show that the proposed method is always capable of maintaining high overall efficiency with the same strategy to follow different paths. Moreover, the ability of this approach exhibits a significant contribution to the development of autonomous ships.
| Type: | Article |
|---|---|
| Title: | A novel path following approach for autonomous ships based on fast marching method and deep reinforcement learning |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1016/j.oceaneng.2022.111495 |
| Publisher version: | https://doi.org/10.1016/j.oceaneng.2022.111495 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Path following Autonomous ships, Fast marching method, Deep reinforcement learning, Navigation brain system |
| UCL classification: | UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Mechanical Engineering UCL > Provost and Vice Provost Offices > UCL BEAMS UCL |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10149427 |
Archive Staff Only
 |
View Item |
