Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Critical Scenario Identification for Testing of Autonomous Driving Systems

Song, Qunying LU orcid (2022)
Abstract
Background:
Autonomous systems have received considerable attention from academia and are adopted by various industrial domains, such as automotive, avionics, etc. As many of them are considered safety-critical, testing is indispensable to verify their reliability and safety. However, there is no common standard for testing autonomous systems efficiently and effectively. Thus new approaches for testing such systems must be developed.
Aim:
The objective of this thesis is two-fold. First, we want to present an overview of software testing of autonomous systems, i.e., relevant concepts, challenges, and techniques available in academic research and industry practice. Second, we aim to establish a new approach for testing... (More)
Background:
Autonomous systems have received considerable attention from academia and are adopted by various industrial domains, such as automotive, avionics, etc. As many of them are considered safety-critical, testing is indispensable to verify their reliability and safety. However, there is no common standard for testing autonomous systems efficiently and effectively. Thus new approaches for testing such systems must be developed.
Aim:
The objective of this thesis is two-fold. First, we want to present an overview of software testing of autonomous systems, i.e., relevant concepts, challenges, and techniques available in academic research and industry practice. Second, we aim to establish a new approach for testing autonomous driving systems and demonstrate its effectiveness by using real autonomous driving systems from industry.
Research Methodology:
We conducted the research in three steps using the design science paradigm. First, we explored the existing literature and industry practices to understand the state of the art for testing of autonomous systems. Second, we focused on a particular sub-domain - autonomous driving - and proposed a systematic approach for critical test scenario identification. Lastly, we validated our approach and employed it for testing real autonomous driving systems by collaborating with Volvo Cars.
Results:
We present the results as four papers in this thesis. First, we conceptualized a definition of autonomous systems and classified challenges and approaches, techniques, and practices for testing autonomous systems in general. Second, we designed a systematic approach for critical test scenario identification. We employed the approach for testing two real autonomous driving systems from the industry and have effectively identified critical test scenarios. Lastly, we established a model for predicting the distribution of vehicle-pedestrian interactions for realistic test scenario generation for autonomous driving systems.
Conclusion:
Critical scenario identification is a favorable approach to generate test scenarios and facilitate the testing of autonomous driving systems in an efficient way. Future improvement of the approach includes (1) evaluating the effectiveness of the generated critical scenarios for testing; (2) extending the sub-components in this approach; (3) combining different testing approaches, and (4) exploring the application of the approach to test different autonomous systems. (Less)
Please use this url to cite or link to this publication:
author
supervisor
organization
publishing date
type
Thesis
publication status
published
subject
keywords
Software testing, Critical scenario identification, Autonomous systems, Autonomous driving systems
pages
110 pages
publisher
Lund University
ISBN
978-91-8039-211-2
978-91-8039-212-9
language
English
LU publication?
yes
id
4b7d39b9-0dcd-4a43-9068-4b314e0437b7
date added to LUP
2022-03-08 11:04:20
date last changed
2022-03-15 09:52:01
@misc{4b7d39b9-0dcd-4a43-9068-4b314e0437b7,
  abstract     = {{Background: <br/>Autonomous systems have received considerable attention from academia and are adopted by various industrial domains, such as automotive, avionics, etc. As many of them are considered safety-critical, testing is indispensable to verify their reliability and safety. However, there is no common standard for testing autonomous systems efficiently and effectively. Thus new approaches for testing such systems must be developed.<br/>Aim: <br/>The objective of this thesis is two-fold. First, we want to present an overview of software testing of autonomous systems, i.e., relevant concepts, challenges, and techniques available in academic research and industry practice. Second, we aim to establish a new approach for testing autonomous driving systems and demonstrate its effectiveness by using real autonomous driving systems from industry.<br/>Research Methodology: <br/>We conducted the research in three steps using the design science paradigm. First, we explored the existing literature and industry practices to understand the state of the art for testing of autonomous systems. Second, we focused on a particular sub-domain - autonomous driving - and proposed a systematic approach for critical test scenario identification. Lastly, we validated our approach and employed it for testing real autonomous driving systems by collaborating with Volvo Cars.<br/>Results: <br/>We present the results as four papers in this thesis. First, we conceptualized a definition of autonomous systems and classified challenges and approaches, techniques, and practices for testing autonomous systems in general. Second, we designed a systematic approach for critical test scenario identification. We employed the approach for testing two real autonomous driving systems from the industry and have effectively identified critical test scenarios. Lastly, we established a model for predicting the distribution of vehicle-pedestrian interactions for realistic test scenario generation for autonomous driving systems.  <br/>Conclusion: <br/>Critical scenario identification is a favorable approach to generate test scenarios and facilitate the testing of autonomous driving systems in an efficient way. Future improvement of the approach includes (1) evaluating the effectiveness of the generated critical scenarios for testing; (2) extending the sub-components in this approach; (3) combining different testing approaches, and (4) exploring the application of the approach to test different autonomous systems.}},
  author       = {{Song, Qunying}},
  isbn         = {{978-91-8039-211-2}},
  keywords     = {{Software testing; Critical scenario identification; Autonomous systems; Autonomous driving systems}},
  language     = {{eng}},
  month        = {{03}},
  note         = {{Licentiate Thesis}},
  publisher    = {{Lund University}},
  title        = {{Critical Scenario Identification for Testing of Autonomous Driving Systems}},
  url          = {{https://lup.lub.lu.se/search/files/115272152/Licentiate_Thesis.pdf}},
  year         = {{2022}},
}