Simultaneous Control and Guidance of an AUV Based on Soft Actor–Critic - ENSTA Bretagne - École nationale supérieure de techniques avancées Bretagne Accéder directement au contenu
Article Dans Une Revue Sensors Année : 2022

Simultaneous Control and Guidance of an AUV Based on Soft Actor–Critic


The marine environment is a hostile setting for robotics. It is strongly unstructured, uncertain, and includes many external disturbances that cannot be easily predicted or modeled. In this work, we attempt to control an autonomous underwater vehicle (AUV) to perform a waypoint tracking task, using a machine learning-based controller. There has been great progress in machine learning (in many different domains) in recent years; in the subfield of deep reinforcement learning, several algorithms suitable for the continuous control of dynamical systems have been designed. We implemented the soft actor–critic (SAC) algorithm, an entropy-regularized deep reinforcement learning algorithm that allows fulfilling a learning task and encourages the exploration of the environment simultaneously. We compared a SAC-based controller with a proportional integral derivative (PID) controller on a waypoint tracking task using specific performance metrics. All tests were simulated via the UUV simulator. We applied these two controllers to the RexROV 2, a six degrees of freedom cube-shaped remotely operated underwater Vehicle (ROV) converted in an AUV. We propose several interesting contributions as a result of these tests, such as making the SAC control and guiding the AUV simultaneously, outperforming the PID controller in terms of energy saving, and reducing the amount of information needed by the SAC algorithm inputs. Moreover, our implementation of this controller allows facilitating the transfer towards real-world robots. The code corresponding to this work is available on GitHub.
Fichier principal
Vignette du fichier
sensors-22-06072-v2.pdf (1.16 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03752054 , version 1 (11-01-2024)



Yoann Sola, Gilles Le Chenadec, Benoit Clement. Simultaneous Control and Guidance of an AUV Based on Soft Actor–Critic. Sensors, 2022, 22 (16), pp.6072. ⟨10.3390/s22166072⟩. ⟨hal-03752054⟩
56 Consultations
3 Téléchargements



Gmail Facebook X LinkedIn More