title: A pilot study to determine the validity and reliability of the Level of Reflection-on-Action Assessment.
abstract: The purpose of this study was to determine the reliability of the Level of Reflection-on-Action Assessment (LORAA). The LORAA is an instrument developed to identify the level of reflection achieved by students on their reflective journal entries and includes prompts for the educator to guide students to higher levels of reflection. The LORAA was developed based on a literature review and was content validated by a panel of three experts in reflective learning. Interrater reliability was achieved when pilot tested using five sample student journal entries rated at 0.67 by three independent raters on four entries and at 0.80 with two raters on all five entries. On further testing using a larger sample of 18 student journal entries, interrater reliability was achieved at 0.94 with two raters. The results suggest that the LORAA can be used to determine the level of reflection achieved by students on reflective journal entries.
authors.affiliation: The Richard Stockton College of New Jersey, Galloway, NJ 08205-9441, USA. mary.padden@stockton.edu
authors.forename: Mary L
authors.initials: ML
authors.lastname: Padden
mesh_terms: D004506:Education, Nursing; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D015588:Observer Variation; D010865:Pilot Projects; D015203:Reproducibility of Results; D012647:Self-Assessment; D013850:Thinking; D014481:United States