Application of the W-shaped process for a Reinforcement Learning use case on drone navigation

Abstract

The interest in Machine Learning (ML) has spread to safety systems due to its ability to solve tasks that cannot be explicitly programmed, including pattern recognition, object detection, and autonomous control. To ensure the safe integration of ML in avionics, the European Union Aviation Safety Agency (EASA) proposed the W-shaped development process. However, it focuses on supervised learning, leaving aside Reinforcement Learning (RL), which is particularly suitable for decision-making problems. This paper presents a practical analysis of the applicability of the W-shaped process to systems that include RL components. To support this analysis, the W-shaped process is applied to a drone navigation and collision avoidance system under safety requirements on a real-time embedded platform. This paper demonstrates that processes related to learning must be adapted to support the interactive nature of RL, while those related to implementation are agnostic to the ML technique and thus compatible with RL. This paper also proposes concrete adaptations, including scenario-based data management, a reinterpretation of data quality requirements, and the explicit definition of the agent-environment interface before training.