title: Assessing the coding reliability of work accidents statistical data: How coders make a difference.
abstract: This study assesses the reliability of the coding procedure for a set of variables belonging to the European Statistics of Accidents at Work (ESAW). The work focused on the Portuguese data and experience with the system. In Portugal, this task has been systematically carried out by GEP (the governmental Cabinet for Strategy and Planning), here defined as the "reference group" or "expert group." However, it is anticipated that this coding task will be performed by non-expert people, since paper-forms will be replaced by e-forms, similarly to what happened in a few EU countries.
  
  
  
  This study aims to: (a) assess the current situation, that is, to quantify reliability of data coded by GEP (reference group), and (b) assess the impact on the reliability level when the coding is carried out by non-experts (two different groups of coders).
  
  
  
  The study comprises the estimation of both intercoder and intracoder reliability for a set of 8 nominal variables. The assessment applies 3 reliability coefficients calculated by 3 software packages.
  
  
  
  The results reveal that the expert group (GEP) holds good to excellent reliability (inter- and intracoder agreements), between 68-98%, while there is a considerable "loss of reliability" (-5% to -39%) when the coding process is transferred to other people, without special training or knowledge in this task.
  
  
  
  This work gives quantified evidence that reliability of coding accident data is substantially affected by the coders' profile. Moreover, certain variables, regardless of the coder, systematically hold a higher level of coding reliability than others, suggesting that certain codes may need improvement. Future studies should assess coding quality across the EU countries using the ESAW protocol.
  
  
  
  Directions for improving the quality of accident data and related statistics; data that is used by researchers and governmental decision-makers to derive prevention strategies.
authors.affiliation: UNIDEMI, Department of Mechanical and Industrial Engineering, Faculty of Science and Technology, Universidade Nova de Lisboa, 2829-516 Caparica, Portugal. Electronic address: mcj@fct.unl.pt.
authors.forename: Celeste
authors.initials: C
authors.lastname: Jacinto
authors.affiliation: Centre for Marine Technology and Ocean Engineering (CENTEC), Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais, 1049-001 Lisboa, Portugal. Electronic address: fernando.santos@centec.tecnico.ulisboa.pt.
authors.forename: Fernando P
authors.initials: FP
authors.lastname: Santos
authors.affiliation: Centre for Marine Technology and Ocean Engineering (CENTEC), Instituto Superior Técnico, Universidade de Lisboa, Av. Rovisco Pais, 1049-001 Lisboa, Portugal. Electronic address: c.guedes.soares@centec.tecnico.ulisboa.pt.
authors.forename: Carlos
authors.initials: C
authors.lastname: Guedes Soares
authors.affiliation: Instituto Universitário de Lisboa (ISCTE-IUL), ISCTE Business School (IBS), Business Research Unit (BRU-IUL), Av. das Forças Armadas, Edifício ISCTE, 1649-026 Lisboa, Portugal. Electronic address: silvia.silva@iscte.pt.
authors.forename: Sílvia A
authors.initials: SA
authors.lastname: Silva
mesh_terms: D000062:Accidents, Occupational / Q000706:statistics & numerical data*; D016208:Databases, Factual / Q000592:standards*; D003657:Decision Making; D006801:Humans; D011174:Portugal; D011996:Records / Q000592:standards*; D015203:Reproducibility of Results
keywords: Accident data; Content analysis; ESAW variables; Intercoder reliability; Reliability coefficients