Inter- and intra-rater reliability of the OCRA checklist method in video-recorded manual work tasks
Artikel i vetenskaplig tidskrift, 2020

Observation-based risk assessments are often used for evaluation of biomechanical workload and the condition of the workplace ergonomics. However, the inter- and intra-rater reliability of the methods used for the assessments are insufficiently studied. The OCRA checklist method, included as a reference method in the ISO and CEN standards regarding upper limb repetitive risk assessment, was in this study investigated regarding its reliability. Eleven ergonomists were educated within the method. Each ergonomist risk-assessed ten video-recorded manual work tasks, on two occasions. The average inter-rater agreement of the five overall risk levels was 39% and the linearly weighted kappa was 0.43, the intra-rater dittos were 45% and 0.52. Both indicating a moderate reliability, but lower than what could be expected. The levels might be sufficient for coarse surveys. However, for risk assessments before and after an intervention, complementing technical methods should be considered.

Risk assessment

Inter-rater reliability

Observational methods

Intra-rater reliability


Ida-Märta Rhen

Chalmers, Industri- och materialvetenskap, Produktionssystem

Karolinska Institutet

Stockholms läns landsting

Mikael Forsman

Stockholms läns landsting

Karolinska Institutet

Kungliga Tekniska Högskolan (KTH)

Applied Ergonomics

0003-6870 (ISSN) 1872-9126 (eISSN)

Vol. 84 103025


Övrig annan medicin och hälsovetenskap

Miljömedicin och yrkesmedicin

Folkhälsovetenskap, global hälsa, socialmedicin och epidemiologi





Mer information

Senast uppdaterat