The precision of practice analysis results in the professions.
A practice analysis, in which an appropriate sample of professionals is asked to describe what they do in their practices, is considered an essential part of the content-related validity evidence for licensure and certification tests. This article examines the precision of estimates of the mean frequencies for categories of activities in an activity inventory administered on two occasions about 6 weeks apart. In particular, it explores the variability in estimates of the mean frequencies for categories due to the sampling of respondents, activity statements, and occasions. The results suggest that samples of 200 respondents, about 10 to 20 activity statements per category, and one occasion are adequate for estimating the mean frequency for each category.
University of Wisconsin-Madison.
M T
MT
Kane
T
T
Miller
M
M
Trine
C
C
Becker
K
K
Carson
D000704:Analysis of Variance; D002568:Certification; D004046:Dietetics / Q000592:standards* / Q000706:statistics & numerical data; D004521:Educational Measurement; D006302:Health Services Research / Q000379:methods; D007587:Job Description; D008007:Licensure, Medical; D011364:Professional Practice / Q000706:statistics & numerical data*; D013647:Task Performance and Analysis; D014481:United States