Methodological quality of research on cognitive rehabilitation after traumatic brain injury.
OBJECTIVE
To evaluate the methodological quality of research on cognitive rehabilitation after traumatic brain injury (TBI).


METHODS
Secondary analysis of studies identified in prior systematic reviews of cognitive rehabilitation.


METHODS
Randomized controlled trials (RCTs) and observational studies involving exclusively or primarily participants with TBI.


METHODS
Criteria for evaluating methodological quality were adapted from prior reviews of rehabilitation research. These criteria were modified to be relevant to cognitive rehabilitation research. Sixteen criteria for evaluating the quality of RCTs were applied: 8 relating to the internal validity of studies, 5 descriptive criteria, and 3 statistical criteria. Twelve of these criteria were used to evaluate non-RCT observational studies.


RESULTS
Thirty-two RCTs and 21 observational studies were independently reviewed and rated by 2 of the authors. Initial agreement between raters for individual studies ranged from 57% to 100%. Interrater reliabilities based on the kappa statistic indicated moderate to substantial agreement.


CONCLUSIONS
Several high-quality RCTs support the effectiveness of interventions for attention, communication skills, and executive functioning after TBI. Several high-quality observational studies support the effectiveness of comprehensive-holistic rehabilitation after TBI, including improvements in participation outcomes. The proposed criteria appear useful for evaluating the quality of research on cognitive rehabilitation and improving the design and reporting of future research in this area.
Cicerone
Keith D
KD
Department of Cognitive Rehabilitation, JFK-Johnson Rehabilitation Institute, Edison, NJ, USA. kcicerone@solarishs.org
Azulay
Joanne
J
Trott
Charlotte
C
D001930:Brain Injuries / Q000534:rehabilitation*; D003072:Cognition Disorders / Q000534:rehabilitation*; D006801:Humans; D017063:Outcome Assessment, Health Care / Q000592:standards; D016032:Randomized Controlled Trials as Topic; D015203:Reproducibility of Results; D012106:Research / Q000592:standards