title: Assessing the suitability of written stroke materials: an evaluation of the interrater reliability of the suitability assessment of materials (SAM) checklist.
abstract: OBJECTIVE
  Written materials are frequently used to provide education to stroke patients and their carers. However, poor quality materials are a barrier to effective information provision. A quick and reliable method of evaluating material quality is needed. This study evaluated the interrater reliability of the Suitability Assessment of Materials (SAM) checklist in a sample of written stroke education materials.
  
  
  METHODS
  Two independent raters evaluated the materials (n = 25) using the SAM, and ratings were analyzed to reveal total percentage agreements and weighted kappa values for individual items and overall SAM rating.
  
  
  RESULTS
  The majority of the individual SAM items had high interrater reliability, with 17 of the 22 items achieving substantial, almost perfect, or perfect weighted kappa value scores. The overall SAM rating achieved a weighted kappa value of 0.60, with a percentage total agreement of 96%.
  
  
  CONCLUSIONS
  Health care professionals should evaluate the content and design characteristics of written education materials before using them with patients. A tool such as the SAM checklist can be used; however, raters should exercise caution when interpreting results from items with more subjective scoring criteria. Refinements to the scoring criteria for these items are recommended. The value of the SAM is that it can be used to identify specific elements that should be modified before education materials are provided to patients.
authors.affiliation: Centre for Research in Evidence-Based Practice, Faculty of Health Sciences and Medicine, Bond University, Gold Coast, Australia.
authors.forename: Tammy
authors.initials: T
authors.lastname: Hoffmann
authors.forename: Yvette
authors.initials: Y
authors.lastname: Ladner
mesh_terms: D057189:Checklist / Q000706:statistics & numerical data*; D004522:Educational Status; D006801:Humans; D015588:Observer Variation; D010174:Pamphlets; D010353:Patient Education as Topic / Q000379:methods* / Q000592:standards*; D011932:Reading; D015203:Reproducibility of Results; D020521:Stroke / Q000523:psychology*; D000071939:Stroke Rehabilitation; D013664:Teaching Materials / Q000592:standards