Development and evaluation of a quality score for abstracts.
BACKGROUND
The evaluation of abstracts for scientific meetings has been shown to suffer from poor inter observer reliability. A measure was developed to assess the formal quality of abstract submissions in a standardized way.


METHODS
Item selection was based on scoring systems for full reports, taking into account published guidelines for structured abstracts. Interrater agreement was examined using a random sample of submissions to the American Gastroenterological Association, stratified for research type (n = 100, 1992-1995). For construct validity, the association of formal quality with acceptance for presentation was examined. A questionnaire to expert reviewers evaluated sensibility items, such as ease of use and comprehensiveness.


RESULTS
The index comprised 19 items. The summary quality scores showed good interrater agreement (intra class coefficient 0.60 - 0.81). Good abstract quality was associated with abstract acceptance for presentation at the meeting. The instrument was found to be acceptable by expert reviewers.


CONCLUSIONS
A quality index was developed for the evaluation of scientific meeting abstracts which was shown to be reliable, valid and useful.
Timmer
Antje
A
Department of Internal Medicine I, University of Regensburg, 93042 Regensburg, Germany. antje.timmer@klinik.uni-regensburg.de
Sutherland
Lloyd R
LR
Hilsden
Robert J
RJ
D003226:Congresses as Topic; D006801:Humans; D008373:Manuscripts as Topic; D017712:Peer Review, Research / Q000379:methods*; D011643:Publishing / Q000592:standards*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D017749:Total Quality Management / Q000379:methods