Z-score for benchmarking reader competence in a central ECG laboratory.
BACKGROUND
ECGs from thorough QT studies must be read in a central laboratory by trained experts. Standards of expertise are not presently defined. We, therefore, studied the use of Z-scores to define reader competence.


METHODS
Two hundred ECGs were read by 24 experts and the mean and standard deviation (SD) of QT measurements calculated for each ECG. Z-scores ([QT(reader)- mean QT(experts)]/ SD(experts)) for each ECG and mean of absolute Z-scores of all ECGs read by a reader were calculated. The highest mean absolute Z-score of experts was considered the cutoff to define competence. Hundred of these standardized ECGs were used to assess performance of readers from the central laboratory.


RESULTS
All experts had mean absolute Z-scores < or = 1.5. Using this cutoff, one of 28 experienced readers and 7 of 15 trainees had unacceptable Z-scores. After re-training, all achieved Z-scores <1.5. Comparing histograms of actual Z-scores of the 100 ECGs of readers with unacceptable scores with that of the reader with the best Z-score showed two patterns. Readers with histograms having a peak and tails similar to that of the best reader, but with leftward or rightward shift, consistently made shorter or longer QT measurements, respectively. A histogram with a flatter peak and wider tails, suggested that measurements were long in some ECGs and short in others.


CONCLUSIONS
Mean absolute Z-score is useful to assess competence for measuring the QT interval on ECGs. Analysis of histograms can pinpoint problems in QT measurements.
Panicker
Gopi Krishna
GK
Quintiles ECG Services, Mumbai, India. gopi.panicker@quintiles.com
Karnad
Dilip R
DR
Joshi
Rajesh
R
Shetty
Sheetal
S
Vyas
Niraj
N
Kothari
Snehal
S
Narula
Dhiraj
D
D019985:Benchmarking / Q000379:methods*; D002309:Cardiology; D002983:Clinical Competence; D004562:Electrocardiography / Q000379:methods*; D005260:Female; D006801:Humans; D007194:India; D007753:Laboratories; D008133:Long QT Syndrome / Q000175:diagnosis*; D008297:Male; D015588:Observer Variation; D012680:Sensitivity and Specificity; D012815:Signal Processing, Computer-Assisted; D017749:Total Quality Management