Standards as applied in reality: a case study on the translation of standards in eHealth evaluation practice
Journal article, 2019

BACKGROUND: Application of standards is a way to increase quality in an evaluation study. However, standards are used insufficiently in eHealth evaluation, affecting the generalization of the knowledge generated. This study aimed to explore how standards are used in a practical setting of an eHealth evaluation, and to identify the factors that can hinder their use. METHODS: The data were collected in a multi-national and interdisciplinary eHealth evaluation study targeted at the elderly people suffering from mild cognitive impairment and mild dementia. The study was carried out in four countries and funded by the European Union. The collected data included meeting minutes (n = 8) and e-mail correspondence (n = 261) between partners. The chronological sequence of events related to the use of standards was established. Subsequently, the hindering factors related to the use of standards were identified from the sequence. RESULTS: The use of four standards was described, reflecting a variety of related processes or barriers that emerge during eHealth evaluation. The processes differed based on the type of the standard. Specifically, evaluation frameworks were found to be conceptual standards and they were easy to agree upon, while standardized metrics were more tangible and their use triggered negotiations. Further, the following factors hindered the use of standards in eHealth evaluations: (1) inadequacy of a standard to address a target population or a disease, (2) insufficient resources to use a standard, (3) lack of experience in using a standard, and (4) lack of validation of a standard in a particular location. CONCLUSIONS: Standardization initiatives in eHealth evaluation provide a blueprint for evaluation, but their practical application is problematic. The practical circumstances of an evaluation study can cause deviations in the standards, thus producing heterogeneity in the evaluation methodologies.

Translation

Standard

eHealth

Barriers

Evaluation

Inter-organizational cooperation

Factors

Author

Monika Jurkeviciute

Chalmers, Technology Management and Economics, Service Management and Logistics

Centre for Healthcare Improvement (CHI)

BMC Medical Informatics and Decision Making

1472-6947 (ISSN)

Vol. 19 1 247

Digital Environment for Cognitive Inclusion (DECI)

European Commission (Horizon 2020), 2015-06-01 -- 2018-05-31.

Subject Categories

Other Computer and Information Science

Other Health Sciences

Gerontology, specialising in Medical and Health Sciences

DOI

10.1186/s12911-019-0975-9

PubMed

31783847

More information

Latest update

12/16/2019