Advanced

Specifications of the Evaluation Framework.

Willemsen, Dehlia; Malone, Kerry; Bakri, Taoufik; Fahrenkrog, Felix; Zlocki, Adrian; Blanco, Rosa; Sánchez, David; Koskinen, Sami; Scholliers, Johan and Varhelyi, Andras LU (2011) Deliverable D7.2.
Abstract
This document outlines the specifications for the evaluation framework on the basis of the requirements as described in D7.1. The framework will be further developed in D7.4 (“Test and evaluation plans”).

Based on the use cases from deliverable D1.5 and the requirements from D7.1, hypotheses, indicators and test scenarios are formulated and included in this deliverable D7.2.

Evaluation has, as in D7.1, been divided in three main categories:

• Technical Assessment evaluates the performance of the developed interactIVe functions and collects information and data for safety impact assessment.

• User-Related Assessment assesses the functions from the user perspective, and also to provide further input to... (More)
This document outlines the specifications for the evaluation framework on the basis of the requirements as described in D7.1. The framework will be further developed in D7.4 (“Test and evaluation plans”).

Based on the use cases from deliverable D1.5 and the requirements from D7.1, hypotheses, indicators and test scenarios are formulated and included in this deliverable D7.2.

Evaluation has, as in D7.1, been divided in three main categories:

• Technical Assessment evaluates the performance of the developed interactIVe functions and collects information and data for safety impact assessment.

• User-Related Assessment assesses the functions from the user perspective, and also to provide further input to the safety impact assessment.

• Impact Assessment, estimates how and how much the functions influence traffic safety.

This deliverable has further defined the evaluation framework by:

• Hypotheses definition based on the research questions of D7.1. The hypotheses are set up in two categories per assessment (technical, user related and impact):

o General

o System specific (SECONDS, INCA, and EMIC).

• Indicator definition based on the hypotheses of this deliverable. The indicators are set up per assessment (technical, user related and impact).

• Test scenarios definition based on the use cases defined in D1.5.

Summarizing, the outcome of this deliverable is a list of hypotheses, indicators and test cases, which will be used to define specific test plans for the interactIVe functions in D7.4. The current status of the project is that the functions that will be developed in interactIVe are not yet totally outlined. This document has D1.5 (v16, Annex1 v2 and Annex2 v12) and D1.6 (v0998) as a basis. Meanwhile these documents may have been updated to newer versions, which is not dealt with in this version of D7.2 but will be integrated into D7.4 (due in M22). Moreover a process of reviewing the hypotheses and test scenarios by the VSPs has started (M17) and may result in an update of some of the hypotheses, indicators and test scenarios. These will also be part of D7.4. The results of the April 2011 SP workshop have been mostly integrated into this deliverable, further discussion will lead to other changes which will be reported in D7.4. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Book/Report
publication status
published
subject
volume
Deliverable D7.2
pages
87 pages
publisher
InteractIVe Consortium
language
English
LU publication?
yes
id
ba3dce11-a2a2-478f-bc87-aa11c76d1721 (old id 4466813)
date added to LUP
2014-06-16 11:21:07
date last changed
2016-04-16 10:13:48
@techreport{ba3dce11-a2a2-478f-bc87-aa11c76d1721,
  abstract     = {This document outlines the specifications for the evaluation framework on the basis of the requirements as described in D7.1. The framework will be further developed in D7.4 (“Test and evaluation plans”).<br/><br>
Based on the use cases from deliverable D1.5 and the requirements from D7.1, hypotheses, indicators and test scenarios are formulated and included in this deliverable D7.2. <br/><br>
Evaluation has, as in D7.1, been divided in three main categories: <br/><br>
•	Technical Assessment evaluates the performance of the developed interactIVe functions and collects information and data for safety impact assessment.<br/><br>
•	User-Related Assessment assesses the functions from the user perspective, and also to provide further input to the safety impact assessment.<br/><br>
•	Impact Assessment, estimates how and how much the functions influence traffic safety.<br/><br>
This deliverable has further defined the evaluation framework by:<br/><br>
•	Hypotheses definition based on the research questions of D7.1. The hypotheses are set up in two categories per assessment (technical, user related and impact):<br/><br>
o	General<br/><br>
o	System specific (SECONDS, INCA, and EMIC). <br/><br>
•	Indicator definition based on the hypotheses of this deliverable. The indicators are set up per assessment (technical, user related and impact). <br/><br>
•	Test scenarios definition based on the use cases defined in D1.5.<br/><br>
Summarizing, the outcome of this deliverable is a list of hypotheses, indicators and test cases, which will be used to define specific test plans for the interactIVe functions in D7.4. The current status of the project is that the functions that will be developed in interactIVe are not yet totally outlined. This document has D1.5 (v16, Annex1 v2 and Annex2 v12) and D1.6 (v0998) as a basis. Meanwhile these documents may have been updated to newer versions, which is not dealt with in this version of D7.2 but will be integrated into D7.4 (due in M22). Moreover a process of reviewing the hypotheses and test scenarios by the VSPs has started (M17) and may result in an update of some of the hypotheses, indicators and test scenarios. These will also be part of D7.4. The results of the April 2011 SP workshop have been mostly integrated into this deliverable, further discussion will lead to other changes which will be reported in D7.4.},
  author       = {Willemsen, Dehlia and Malone, Kerry and Bakri, Taoufik and Fahrenkrog, Felix and Zlocki, Adrian and Blanco, Rosa and Sánchez, David and Koskinen, Sami and Scholliers, Johan and Varhelyi, Andras},
  institution  = {InteractIVe Consortium},
  language     = {eng},
  pages        = {87},
  title        = {Specifications of the Evaluation Framework.},
  volume       = {Deliverable D7.2},
  year         = {2011},
}