D6.1: Evaluation framework, plans and material. Deliverable of the Horizon-2020 PANACEA project, Grant Agreement No. 953426

Report, 2022

This deliverable presents the evaluation framework, plans and material for all data collections of the PANACEA project. It describes the objectives of the studies and how they will be realised. The purpose of the PANACEA evaluation framework is to create a common framework to be used in all studies to make sure the data are collected in a way that makes it possible to consolidate the results at the end and to provide what is needed for impact analysis (WP7). This version of the deliverable has its focus on setting the framework and the work process. An update of this deliverable will be done in M22 (D6.2: ‘Evaluation framework, plans and material - an update’). The key content of D6.1 is structured as follows: Chapter 1 is the introduction to the deliverable, specifying its purpose, the intended audience, and interrelations with other project activities. Chapter 2 introduces the project objectives related to the WP6 data collections. Chapter 3 provides a brief overview of each Use Case and Chapter 4 presents the various studies within the project including descriptions of the main actors, environment, vehicles, PANACEA sensors/technologies, and countermeasures. Chapter 5 describes the process of developing the evaluation framework for the project and presents the PANACEA evaluation framework. Chapters 6-18 then follow the steps defined in the evaluation framework. Chapters 6-11 describe the planning phase and present the Use Case Scenarios, Research Questions, Key Performance Indicators, study designs, data gathering tools, and data analysis plan. Chapters 12-14 describe the implementation phase, including pilot site preparations, data collection, and data delivery. Chapters 15-18 describe the data analysis phase and includes chapters about data analysis, results reporting, results consolidation, and impact assessment. Lastly, Chapter 19 provides the conclusions of the deliverable.

The deliverable presents both a horizontal perspective of the pilot sites as well as more detailed descriptions of what will be included in the different studies. The general data gathering tools (objective and subjective) are identified and will be further refined in the update of the deliverable. A set of guidelines on practicalities and ethical aspects to take into consideration before and during data collection are presented.

The update of the deliverable, planned for M22, will include the detailed evaluation protocols, with ready-made templates for pilot sites, questionnaires to use, performance criteria, indicators, log files to use, crucial timelines, etc. In addition, the final pilot and experimental plans will be defined and described per pilot site and type of evaluation activity.