Towards Requirements Specification for Machine-learned Perception Based on Human Performance
| Autor: | Boyue Caroline Hu, Rick Salay, Krzysztof Czarnecki, Marsha Chechik, Gehan M. K. Selim, Mona Rahimi |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Training set
business.industry Computer science media_common.quotation_subject Software requirements specification Machine learning computer.software_genre Task (project management) Range (mathematics) Robustness (computer science) Perception Object detector Artificial intelligence business computer media_common |
| Zdroj: | AIRE@RE |
| DOI: | 10.1109/aire51212.2020.00014 |
| Popis: | The application of machine learning (ML) based perception algorithms in safety-critical systems such as autonomous vehicles have raised major safety concerns due to the apparent risks to human lives. Yet assuring the safety of such systems is a challenging task, in a large part because ML components (MLCs) rarely have clearly specified requirements. Instead, they learn their intended tasks from the training data. One of the most well-studied properties that ensure the safety of MLCs is the robustness against small changes in images. But the range of changes considered small has not been systematically defined. In this paper, we propose an approach for specifying and testing requirements for robustness based on human perception. With this approach, the MLCs are required to be robust to changes that fall within the range defined based on human perception performance studies. We demonstrate the approach on a state-of-the-art object detector. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|