Feature Reduction for Scenario-Based Safety Assessment of Automated Driving Systems

Abstract

Vehicles equipped with an Automated Driving System (ADS) have the potential to significantly reduce road collisions. To enable widespread adoption of ADSs, rigorous safety assessment is essential. Valuable insights for ADS safety validation can be gained by simulating scenarios across a broad range of feature variations. A common challenge in simulating these scenarios is known as the curse of dimensionality, where increasing the number of scenario features requires a near-infinite number of simulations to cover all variations. This issue of complexity presents a need for reducing scenario features. Most related work focuses on identifying important scenario features, while few evaluate how reducing these features impacts ADS failure estimation. The present study aims to address this gap by employing a wide range of feature reduction methods and assessing their effect on ADS failure estimation. Previous research generated datasets for three distinct scenario categories by performing virtual simulations using driver reference models on real-world data. In the present work, the machine learning classifiers such as extreme gradient boosting and random forest are applied to this data for predicting ADS failures. Ten dimensionality reduction techniques, including both feature selection and transformation approaches, are employed to reduce the scenario feature set. The optimal reduced feature set is selected based on classification performance measured by the area under the precision–recall curve. To assess the impact on ADS failure estimation, results are compared against those obtained with the full set of features. The findings indicate that reliable ADS failure estimates can be maintained, and even significantly improved, after substantially reducing the number of scenario features. By reducing scenario features, fewer virtual simulations may be required to reliably estimate ADS failures, which may enable more efficient scenario-based ADS safety assessment. Additionally, this study may offer guidance on selecting suitable dimensionality reduction techniques for scenario-based ADS safety assessment.