A comparison of two methods for retrieving ICD-9-CM data: the effect of using an ontology-based method for handling terminology changes.
OBJECTIVE
Most existing controlled terminologies can be characterized as collections of terms, wherein the terms are arranged in a simple list or organized in a hierarchy. These kinds of terminologies are considered useful for standardizing terms and encoding data and are currently used in many existing information systems. However, they suffer from a number of limitations that make data reuse difficult. Relatively recently, it has been proposed that formal ontological methods can be applied to some of the problems of terminological design. Biomedical ontologies organize concepts (embodiments of knowledge about biomedical reality) whereas terminologies organize terms (what is used to code patient data at a certain point in time, based on the particular terminology version). However, the application of these methods to existing terminologies is not straightforward. The use of these terminologies is firmly entrenched in many systems, and what might seem to be a simple option of replacing these terminologies is not possible. Moreover, these terminologies evolve over time in order to suit the needs of users. Any methodology must therefore take these constraints into consideration, hence the need for formal methods of managing changes. Along these lines, we have developed a formal representation of the concept-term relation, around which we have also developed a methodology for management of terminology changes. The objective of this study was to determine whether our methodology would result in improved retrieval of data.


METHODS
Comparison of two methods for retrieving data encoded with terms from the International Classification of Diseases (ICD-9-CM), based on their recall when retrieving data for ICD-9-CM terms whose codes had changed but which had retained their original meaning (code change).


METHODS
Recall and interclass correlation coefficient.


RESULTS
Statistically significant differences were detected (p<0.05) with the McNemar test for two terms whose codes had changed. Furthermore, when all the cases are combined in an overall category, our method also performs statistically significantly better (p<0.05).


CONCLUSIONS
Our study shows that an ontology-based ICD-9-CM data retrieval method that takes into account the effects of terminology changes performs better on recall than one that does not in the retrieval of data for terms whose codes had changed but which retained their original meaning.
Department of Biomedical Informatics, Columbia University, New York, NY, USA. alex.yu@dbmi.columbia.edu
Alexander C
AC
Yu
James J
JJ
Cimino
D016247:Information Storage and Retrieval / Q000379:methods*; D038801:International Classification of Diseases; D009626:Terminology as Topic; D018875:Vocabulary, Controlled
Methods Inf Med. 2000 Dec;39(4-5):278-90
11191695
N Engl J Med. 1997 Feb 13;336(7):480-6
9017942
Proc AMIA Symp. 1998;:46-52
9929181
Methods Inf Med. 1996 Sep;35(3):202-10
8952304
Psychol Bull. 1979 Mar;86(2):420-8
18839484
J Am Med Inform Assoc. 2000 May-Jun;7(3):288-97
10833166
J Am Med Inform Assoc. 2005 Mar-Apr;12(2):225-8
15561784
Stroke. 2002 Apr;33(4):901-6
11935034
Ann Intern Med. 1997 Oct 15;127(8 Pt 2):666-74
9382378
JAMA. 2001 Jun 27;285(24):3116-22
11427140
MD Comput. 2000 Nov-Dec;17(6):29
11189756
Methods Inf Med. 1998 Nov;37(4-5):394-403
9865037
Proc AMIA Annu Fall Symp. 1997;:640-4
9357704
Ann Intern Med. 1993 Oct 15;119(8):844-50
8018127
J Am Med Inform Assoc. 1994 May-Jun;1(3):218-32
7719805
J Am Med Inform Assoc. 2005 Nov-Dec;12(6):618-29
16049227
Psychometrika. 1947 Jun;12(2):153-7
20254758
Methods Inf Med. 1998 Nov;37(4-5):426-39
9865041