Λεπτομέρειες βιβλιογραφικής εγγραφής
| Τίτλος: |
Toward Standardized Benchmarking of Search-Based Scenario Selection Methods in Autonomous System Validation. |
| Συγγραφείς: |
Autenrieth, Daniel, Paland, Daniel, Mentjes, Jan, Zlocki, Adrian |
| Πηγή: |
Journal of Marine Science & Engineering; Aug2026, Vol. 14 Issue 15, p1386, 39p |
| Θεματικοί όροι: |
Benchmark testing (Engineering), Benchmarking (Management), Safety, Autonomous robots, Simulation software, Computer software testing |
| Περίληψη: |
Autonomous systems must demonstrate reliable safety and robustness even under rare, safety-critical conditions. Because the vast range of possible operating situations cannot be exhaustively tested, scenario-based testing has emerged as a structured approach to expose systems to representative and challenging situations. Search-based scenario selection methods (SBSSMs) algorithmically explore the scenario space to identify critical and informative cases. Yet, existing implementations are often tightly coupled to specific domains and simulation environments, hindering reproducibility, comparability, and generalizability across application areas. This paper introduces a benchmarking framework that addresses these limitations by providing a domain-independent environment for the systematic evaluation of SBSSMs. Building on empirical observations from maritime simulation studies and the literature, the framework generates synthetic test instances that mimic the structural patterns found there while abstracting away application-specific semantics. It supplies standardized performance metrics and reference implementations of key method classes, enabling direct comparison of new approaches with established ones under controlled, repeatable conditions. Illustrative demonstrations show how the benchmark reveals characteristic strengths and weaknesses of different methods across diverse structural settings. As a reproducible and extensible baseline, the framework promotes standardized performance assessment and the transfer of methodological advances from maritime navigation to domains such as automotive safety. [ABSTRACT FROM AUTHOR] |
|
Copyright of Journal of Marine Science & Engineering is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Βάση Δεδομένων: |
Complementary Index |