The use of concept mapping in measurement development and evaluation: Application and future directions.
The past decade has seen an increase of measurement development research in social and health sciences that featured the use of concept mapping as a core technique. The purpose, application, and utility of concept mapping have varied across this emerging literature. Despite the variety of uses and range of outputs, little has been done to critically review how researchers have approached the application of concept mapping in the measurement development and evaluation process. This article focuses on a review of the current state of practice regarding the use of concept mapping as methodological tool in this process. We systematically reviewed 23 scale or measure development and evaluation studies, and detail the application of concept mapping in the context of traditional measurement development and psychometric testing processes. Although several limitations surfaced, we found several strengths in the contemporary application of the method. We determined concept mapping provides (a) a solid method for establishing content validity, (b) facilitates researcher decision-making, (c) insight into target population perspectives that are integrated a priori, and (d) a foundation for analytical and interpretative choices. Based on these results, we outline how concept mapping can be situated in the measurement development and evaluation processes for new instrumentation.
Concept Systems, Inc., 136 East State Street, Ithaca, NY 14850, United States. Electronic address: srosas@conceptsystems.com.
Scott R
SR
Rosas
The Institute for Clinical Social Work, At Robert Morris Center, 401 South State Street, Suite 822 Chicago, IL 60605, United States.
John W
JW
Ridings
D016000:Cluster Analysis; D003299:Cooperative Behavior; D036262:Empirical Research; D006126:Group Processes; D006801:Humans; D016730:Program Development / Q000379:methods*; D015397:Program Evaluation / Q000379:methods*; D011594:Psychometrics; D015203:Reproducibility of Results; D012107:Research Design
Group concept mapping; Measurement; Psychometric testing; Scale development