title: [Over- and Underestimation of Success Rates].
abstract: The patient reported outcome in interventional studies is often measured with questionnaires at baseline and after the intervention. A person whose difference in outcome exceeds a critical threshold (the minimal important difference, MID) is classified as a responder, otherwise as a non-responder. The generally low reliability of differences causes misclassifications. False positives and false negatives usually do not cancel out: an MID above the average difference results in an overestimated proportion of responders, while an MID below the average difference results in an underestimated proportion of responders. Such misclassifications can be substantial. We introduce a new and simple method for estimating the true proportion of responders which is based on the assumptions of classical test theory. The consequences of the method are demonstrated with empirical data. It is recommended to report the estimates of true responders. This applies to settings with one study group as well as to settings with an additional control group.
authors.affiliation: Institut für Sozialmedizin und Epidemiologie, Universität zu Lübeck.
authors.forename: J
authors.initials: J
authors.lastname: Höder
authors.affiliation: Institut für Krebsepidemiologie, Universität zu Lübeck.
authors.forename: N
authors.initials: N
authors.lastname: Eisemann
authors.affiliation: Institut für Sozialmedizin und Epidemiologie, Universität zu Lübeck.
authors.forename: A
authors.initials: A
authors.lastname: Hüppe
mesh_terms: D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D059026:Diagnostic Self Evaluation; D005188:False Negative Reactions; D005189:False Positive Reactions; D015233:Models, Statistical; D017063:Outcome Assessment, Health Care / Q000379:methods*; D015203:Reproducibility of Results; D057566:Self Report; D012680:Sensitivity and Specificity