title: Anticonvulsant teratogenesis 4: inter-rater agreement in assessing minor physical features related to anticonvulsant therapy.
abstract: BACKGROUND
  We report on inter-rater agreement in the assessment of newborn infants with respect to a range of minor physical features in a cohort study of the fetal effects of maternal anticonvulsant use during pregnancy.
  
  
  METHODS
  Infants from three groups (exposed to anticonvulsants, seizure history but no medication exposure, and unexposed controls) were examined by both a pediatrician/teratologist, who was blinded with respect to the mother's exposure status, and an unblinded research assistant. Agreement on assessments for selected anomalies associated with anticonvulsant therapy was measured by kappa-statistics, as well as by more sensitive log-linear modeling techniques, which allow examination of possible covariate effects on the strength of agreement. Although the physician and research assistant agreed on a high proportion of cases (80-90%), kappa values were modest (0.2-0. 5), partly because of the low prevalence of the anomalies considered. To explore how agreement varies within subgroups, we used recently developed methods for studying agreement based on log-linear models.
  
  
  RESULTS
  Log-linear modeling indicated that there was substantial variation in pattern of agreement between different individual research assistants but that other factors (e.g., exposure category, sex, and birthweight) did not appear to be related to agreement. Our results suggest that research assistants with more experience showed the highest degree of agreement with the physicians.
  
  
  CONCLUSIONS
  Our results have implications for both clinical practice and epidemiologic research and underline the importance of thorough training of staff in the definitions to be used and also the need for multiple independent assessments of these subtle anomalies.
authors.affiliation: Clinical Epidemiology and Biostatistics Unit, Royal Children's Hospital Research Institute, Parkville, Victoria 3052, Australia.
authors.forename: J B
authors.initials: JB
authors.lastname: Carlin
authors.forename: L M
authors.initials: LM
authors.lastname: Ryan
authors.forename: E A
authors.initials: EA
authors.lastname: Harvey
authors.forename: L B
authors.initials: LB
authors.lastname: Holmes
mesh_terms: D000014:Abnormalities, Drug-Induced / Q000175:diagnosis* / Q000453:epidemiology / Q000209:etiology; D000015:Abnormalities, Multiple / Q000175:diagnosis* / Q000453:epidemiology / Q000209:etiology; D000328:Adult; D000927:Anticonvulsants / Q000009:adverse effects* / Q000627:therapeutic use; D015331:Cohort Studies; D004827:Epilepsy / Q000188:drug therapy*; D005260:Female; D006801:Humans; D007231:Infant, Newborn; D016014:Linear Models; D008297:Male; D015588:Observer Variation; D010372:Pediatrics; D010820:Physicians / Q000523:psychology; D011247:Pregnancy; D011248:Pregnancy Complications / Q000188:drug therapy*; D012108:Research Personnel / Q000523:psychology; D016037:Single-Blind Method; D018600:Teratology; D014739:Victoria / Q000453:epidemiology
chemical_list: D000927:Anticonvulsants