A new measure of the cognitive, metacognitive, and experiential aspects of residents' learning.
OBJECTIVE
Psychometric data are presented for the Cognitive Behavior Survey: Residency Level (rCBS), a survey that profiles cognitive, metacognitive, and experiential aspects of residents' learning.


METHODS
The authors asked 963 residents from seven medicine residencies of large academic medical centers to participate in their study and gathered data from the respondents during a three-year period, 2000-2002. A factor analysis cross-validation design guided the development of rCBS's seven scales: memorization, conceptualization, reflection, independent learning, critical thinking, meaningful learning experience, and attitude toward educational experience. Interscale correlations and MANOVA provided preliminary evidence of scale construct validity.


RESULTS
A total of 424 residents (44%) responded. With several minor exceptions, items for each scale loaded .40 or higher. Memorization did not correlate with any other scale, except correlating negatively with critical thinking. Higher-order thinking scales (conceptualization, reflection, independent learning, critical thinking) correlated with one another and with meaningful learning experience and attitude toward educational experience. The one exception: conceptualization did not correlate with critical thinking. MANOVA results reveal that residents who scored in the top 20% on the reflection scale conceptualized, learned independently, and thought critically more than did the bottom 20%.


CONCLUSIONS
Results provide preliminary support for scale reliability and construct validity. As residencies seek to meet expectations of the Accreditation Council for Graduate Medical Education's Outcome Project, rCBS could prove useful in program evaluation, residents' self-assessment, and assessment by serving as a means to explore how residents learn, how residency programs affect learning behavior, and how clinically strong and weak residents differ in learning behaviors.
Mitchell
Rudolph
R
Teaching and Learning Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA. rudy@mit.edu <rudy@mit.edu>
Regan-Smith
Martha
M
Fisher
Melissa A
MA
Knox
Isabella
I
Lambert
David R
DR
D000124:Achievement; D001291:Attitude of Health Personnel; D002983:Clinical Competence / Q000592:standards*; D003071:Cognition; D003479:Curriculum; D003625:Data Collection; D006801:Humans; D007396:Internship and Residency; D011939:Mental Recall; D011340:Problem Solving; D018794:Problem-Based Learning; D011594:Psychometrics / Q000706:statistics & numerical data; D015203:Reproducibility of Results; D011795:Surveys and Questionnaires; D013850:Thinking