Inter- and intra-observer variability analysis of completely automated cIMT measurement software (AtheroEdge™) and its benchmarking against commercial ultrasound scanner and expert Readers.
The purpose of this study was to evaluate the measurement error and inter- and intra-observer variability of completely off-line automated and semi-automated carotid intima-media thickness (cIMT) measurement software (AtheroEdge™). Two hundred carotid ultrasound images from 50 asymptomatic women were analyzed. AtheroEdge™ was benchmarked against a commercial system (Syngo, Siemens) using automated and semi-automated modes. The measurement error and inter- and intra-observer variability of AtheroEdge™ were tested using three readings. The measurement error of AtheroEdge™ compared to the commercial software was 0.002±0.019mm (r=0.99) in the automated mode and -0.001±0.004mm in the semi-automated mode (r=0.99). The measurement error of AtheroEdge™ compared to the mean value of the three expert Readers (cIMT bias) for the automated and semi-automated methods was -0.0004±0.158mm and -0.008±0.157mm, respectively. The Figure-of-Merit was 99.8% and 99.9% when compared to the commercial ultrasound scanner (using the automated and semi-automated method, respectively) and was 99.9% and 98.9% when compared to the mean value of the three expert Readers. Regarding inter- and intra-observer variability, the intra-class correlation coefficient of the three independent users using the semi-automated AtheroEdge™ was 0.98. AtheroEdge™ showed a measurement performance comparable to the commercial ultrasound scanner software and the expert Readers' tracings. AtheroEdge™ belongs to a class of automated systems that could find application in processing large datasets for common carotid arteries, avoiding subjectivity in cIMT measurements.
Department of Radiology, A.U.O. Cagliari, Cagliari, Italy.
Luca
L
Saba
Filippo
F
Molinari
Kristen M
KM
Meiburger
U Rajendra
UR
Acharya
Andrew
A
Nicolaides
Jasjit S
JS
Suri
D000368:Aged; D002339:Carotid Arteries / Q000000981:diagnostic imaging*; D002340:Carotid Artery Diseases / Q000000981:diagnostic imaging*; D059168:Carotid Intima-Media Thickness; D016208:Databases, Factual; D005260:Female; D006801:Humans; D008875:Middle Aged; D015588:Observer Variation; D012984:Software; D017539:Tunica Intima / Q000000981:diagnostic imaging*
Atherosclerosis; Automated segmentation; CC; Carotid Intima-Media Thickness; Commercial system; Correlation Coefficient; DA; Diagnostic Accuracy; Figure-of-Merit; FoM; Intimamedia thickness; LI; Lumen–Intima interface; MA; Media–Adventitia interface; ROI; Region Of Interest; Reproducibility; Ultrasound imaging; cIMT