Robustness Testing of an Industrial Road Object Detection System - ENSTA Bretagne - École nationale supérieure de techniques avancées Bretagne Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Robustness Testing of an Industrial Road Object Detection System

Résumé

As AI-based critical systems are expected to operate in dynamic environments, it is crucial to ensure their reliability under various operational conditions. In computer vision, one way to achieve this is by testing the system's robustness to input image perturbations. However, while many methods have been proposed and evaluated in academic settings, their effectiveness and applicability in practice remain largely unknown. In this paper, we report the results of testing the robustness of an industrial case of an AI-based road object detection system, in a black-box setting. By defining relevant perturbations and metrics, we analyse the system's response to changes in its hardware and software environment, and identify areas for improvement through retraining with data augmentation. We address the key challenges encountered during this evaluation and provide insights that may help practitioners in performing similar tests and guide future research on robustness testing of AI-based object detection systems.
Fichier non déposé

Dates et versions

hal-04241478 , version 1 (13-10-2023)

Identifiants

Citer

Anne-Laure Wozniak, Ngoc Duong, Ian Benderitter, Sarah Leroy, Sergio Segura, et al.. Robustness Testing of an Industrial Road Object Detection System. 2023 IEEE International Conference On Artificial Intelligence Testing (AITest), Jul 2023, Athens, Greece. pp.82-89, ⟨10.1109/AITest58265.2023.00022⟩. ⟨hal-04241478⟩
18 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More