Requirements and software engineering for automotive perception systems : an interview study
(2024) In Requirements Engineering- Abstract
Driving automation systems, including autonomous driving and advanced driver assistance, are an important safety-critical domain. Such systems often incorporate perception systems that use machine learning to analyze the vehicle environment. We explore new or differing topics and challenges experienced by practitioners in this domain, which relate to requirements engineering (RE), quality, and systems and software engineering. We have conducted a semi-structured interview study with 19 participants across five companies and performed thematic analysis of the transcriptions. Practitioners have difficulty specifying upfront requirements and often rely on scenarios and operational design domains (ODDs) as RE artifacts. RE challenges relate... (More)
Driving automation systems, including autonomous driving and advanced driver assistance, are an important safety-critical domain. Such systems often incorporate perception systems that use machine learning to analyze the vehicle environment. We explore new or differing topics and challenges experienced by practitioners in this domain, which relate to requirements engineering (RE), quality, and systems and software engineering. We have conducted a semi-structured interview study with 19 participants across five companies and performed thematic analysis of the transcriptions. Practitioners have difficulty specifying upfront requirements and often rely on scenarios and operational design domains (ODDs) as RE artifacts. RE challenges relate to ODD detection and ODD exit detection, realistic scenarios, edge case specification, breaking down requirements, traceability, creating specifications for data and annotations, and quantifying quality requirements. Practitioners consider performance, reliability, robustness, user comfort, and—most importantly—safety as important quality attributes. Quality is assessed using statistical analysis of key metrics, and quality assurance is complicated by the addition of ML, simulation realism, and evolving standards. Systems are developed using a mix of methods, but these methods may not be sufficient for the needs of ML. Data quality methods must be a part of development methods. ML also requires a data-intensive verification and validation process, introducing data, analysis, and simulation challenges. Our findings contribute to understanding RE, safety engineering, and development methodologies for perception systems. This understanding and the collected challenges can drive future research for driving automation and other ML systems.
(Less)
- author
- Habibullah, Khan Mohammad ; Heyn, Hans Martin ; Gay, Gregory ; Horkoff, Jennifer ; Knauss, Eric ; Borg, Markus LU ; Knauss, Alessia ; Sivencrona, Håkan and Li, Polly Jing
- organization
- publishing date
- 2024
- type
- Contribution to journal
- publication status
- epub
- subject
- keywords
- Autonomous driving, Driving automation systems, Requirements engineering, Software development methodologies, Software quality
- in
- Requirements Engineering
- publisher
- Springer
- external identifiers
-
- scopus:85183045391
- ISSN
- 0947-3602
- DOI
- 10.1007/s00766-023-00410-1
- language
- English
- LU publication?
- yes
- id
- ded1535a-28ab-4e27-a3cd-e131747a214d
- date added to LUP
- 2024-02-21 14:19:38
- date last changed
- 2024-02-21 14:19:38
@article{ded1535a-28ab-4e27-a3cd-e131747a214d,
abstract = {{<p>Driving automation systems, including autonomous driving and advanced driver assistance, are an important safety-critical domain. Such systems often incorporate perception systems that use machine learning to analyze the vehicle environment. We explore new or differing topics and challenges experienced by practitioners in this domain, which relate to requirements engineering (RE), quality, and systems and software engineering. We have conducted a semi-structured interview study with 19 participants across five companies and performed thematic analysis of the transcriptions. Practitioners have difficulty specifying upfront requirements and often rely on scenarios and operational design domains (ODDs) as RE artifacts. RE challenges relate to ODD detection and ODD exit detection, realistic scenarios, edge case specification, breaking down requirements, traceability, creating specifications for data and annotations, and quantifying quality requirements. Practitioners consider performance, reliability, robustness, user comfort, and—most importantly—safety as important quality attributes. Quality is assessed using statistical analysis of key metrics, and quality assurance is complicated by the addition of ML, simulation realism, and evolving standards. Systems are developed using a mix of methods, but these methods may not be sufficient for the needs of ML. Data quality methods must be a part of development methods. ML also requires a data-intensive verification and validation process, introducing data, analysis, and simulation challenges. Our findings contribute to understanding RE, safety engineering, and development methodologies for perception systems. This understanding and the collected challenges can drive future research for driving automation and other ML systems.</p>}},
author = {{Habibullah, Khan Mohammad and Heyn, Hans Martin and Gay, Gregory and Horkoff, Jennifer and Knauss, Eric and Borg, Markus and Knauss, Alessia and Sivencrona, Håkan and Li, Polly Jing}},
issn = {{0947-3602}},
keywords = {{Autonomous driving; Driving automation systems; Requirements engineering; Software development methodologies; Software quality}},
language = {{eng}},
publisher = {{Springer}},
series = {{Requirements Engineering}},
title = {{Requirements and software engineering for automotive perception systems : an interview study}},
url = {{http://dx.doi.org/10.1007/s00766-023-00410-1}},
doi = {{10.1007/s00766-023-00410-1}},
year = {{2024}},
}