Inter-rater reliability in the classification of supraspinatus tendon tears using 3D ultrasound - a question of experience?
BACKGROUND
Three-dimensional (3D) ultrasound of the shoulder is characterized by a comparable accuracy to two-dimensional (2D) ultrasound. No studies investigating 2D versus 3D inter-rater reliability in the detection of supraspinatus tendon tears taking into account the level of experience of the raters have been carried out so far.


OBJECTIVE
The aim of this study was to determine the inter-rater reliability in the analysis of 3D ultrasound image sets of the supraspinatus tendon between sonographer with different levels of experience.


METHODS
Non-interventional, prospective, observational pilot study of 2309 images of 127 adult patients suffering from unilateral shoulder pain. 3D ultrasound image sets were scored by three raters independently. The intra-and interrater reliabilities were calculated.


RESULTS
There was an excellent intra-rater reliability of rater A in the overall classification of supraspinatus tendon tears (2D vs 3D κ = 0.892, pairwise reliability 93.81%, 3D scoring round 1 vs 3D scoring round 2 κ = 0.875, pairwise reliability 92.857%). The inter-rater reliability was only moderate compared to rater B on 3D (κ = 0.497, pairwise reliability 70.95%) and fair compared to rater C (κ = 0.238, pairwise reliability 42.38%).


CONCLUSIONS
The reliability of 3D ultrasound of the supraspinatus tendon depends on the level of experience of the sonographer. Experience in 2D ultrasound does not seem to be sufficient for the analysis of 3D ultrasound imaging sets. Therefore, for a 3D ultrasound analysis new diagnostic criteria have to be established and taught even to experienced 2D sonographers to improve reproducibility.
Ultrasound Center and Rheumatology Department, Bethesda Hospital Basel, Switzerland.
Giorgio
G
Tamborrini
Ultrasound Center and Rheumatology Department, Bethesda Hospital Basel, Switzerland.
Christian
C
Marx
University Hospital Zürich, Rheumatology Department, Switzerland.
Raphael
R
Micheroli
3D ultrasound; inter-rater reliability; reproducibility; shoulder rotator cuff; ultrasound
Chirurg. 1997 Nov;68(11):1150-5
9518207
Ann Rheum Dis. 2005 Jul;64(7):1043-9
15640263
Ultraschall Med. 2000 Aug;21(4):180-5
11008318
Am J Sports Med. 2008 Jan;36(1):99-103
17932406
J Ultrasound Med. 2012 Mar;31(3):449-53
22368135
Biometrics. 1977 Jun;33(2):363-74
884196
Skeletal Radiol. 2008 Nov;37(11):979-86
18651142
Eur J Ultrasound. 2000 May;11(2):135-41
10781662
Clin Sports Med. 2013 Jul;32(3):391-408
23773874
Ann Rheum Dis. 2006 Jan;65(1):14-9
15941835
Can Assoc Radiol J. 2012 Aug;63(3):170-6
21975160
J Clin Ultrasound. 2005 Feb;33(2):53-6
15674840
Ultraschall Med. 1990 Dec;11(6):302-5
2087656
Radiology. 1995 Nov;197(2):443-6
7480690
AJR Am J Roentgenol. 1993 Jan;160(1):103-7; discussion 109-10
8416605
Radiographics. 2006 Mar-Apr;26(2):589-604
16549619
Lancet. 1992 Apr 25;339(8800):1062-4
1349095
J Bone Joint Surg Am. 2000 Apr;82(4):498-504
10761940
Eur Radiol. 1997;7(2):192-7
9038113