title: Towards a repository for standardized medical image and signal case data annotated with ground truth.
abstract: Validation of medical signal and image processing systems requires quality-assured, representative and generally acknowledged databases accompanied by appropriate reference (ground truth) and clinical metadata, which are composed laboriously for each project and are not shared with the scientific community. In our vision, such data will be stored centrally in an open repository. We propose an architecture for a standardized case data and ground truth information repository supporting the evaluation and analysis of computer-aided diagnosis based on (a) the Reference Model for an Open Archival Information System (OAIS) provided by the NASA Consultative Committee for Space Data Systems (ISO 14721:2003), (b) the Dublin Core Metadata Initiative (DCMI) Element Set (ISO 15836:2009), (c) the Open Archive Initiative (OAI) Protocol for Metadata Harvesting, and (d) the Image Retrieval in Medical Applications (IRMA) framework. In our implementation, a portal bunches all of the functionalities that are needed for data submission and retrieval. The complete life cycle of the data (define, create, store, sustain, share, use, and improve) is managed. Sophisticated search tools make it easier to use the datasets, which may be merged from different providers. An integrated history record guarantees reproducibility. A standardized creation report is generated with a permanent digital object identifier. This creation report must be referenced by all of the data users. Peer-reviewed e-publishing of these reports will create a reputation for the data contributors and will form de-facto standards regarding image and signal datasets. Good practice guidelines for validation methodology complement the concept of the case repository. This procedure will increase the comparability of evaluation studies for medical signal and image processing methods and applications.
authors.affiliation: Dept. of Medical Informatics, RWTH Aachen University, Pauwelsstraße 30, 52074, Aachen, Germany. deserno@ieee.org
authors.forename: Thomas M
authors.initials: TM
authors.lastname: Deserno
authors.forename: Petra
authors.initials: P
authors.lastname: Welter
authors.forename: Alexander
authors.initials: A
authors.lastname: Horsch
mesh_terms: D003628:Database Management Systems / Q000592:standards*; D016208:Databases, Factual / Q000592:standards*; D003936:Diagnosis, Computer-Assisted / Q000592:standards*; D006801:Humans; D007091:Image Processing, Computer-Assisted / Q000379:methods* / Q000592:standards; D016247:Information Storage and Retrieval / Q000379:methods* / Q000592:standards; D011785:Quality Assurance, Health Care; D011873:Radiology Information Systems; D012815:Signal Processing, Computer-Assisted; D012984:Software; D018511:Systems Integration; D014584:User-Computer Interface
references.citation: Comput Med Imaging Graph. 2007 Jun-Jul;31(4-5):198-211
references.pmid: 17349778
references.citation: Methods Inf Med. 2004;43(4):354-61
references.pmid: 15472746
references.citation: Stud Health Technol Inform. 2003;95:281-5
references.pmid: 14664000
references.citation: Comput Med Imaging Graph. 2004 Sep;28(6):295-305
references.pmid: 15294308
references.citation: Methods Inf Med. 2004;43(4):409-12
references.pmid: 15472755
references.citation: Int J Comput Assist Radiol Surg. 2011 Nov;6(6):749-67
references.pmid: 21448711
references.citation: Yearb Med Inform. 2008;:55-63
references.pmid: 18660877
references.citation: J Digit Imaging. 2008 Sep;21(3):280-9
references.pmid: 17497197
references.citation: Radiographics. 2011 May-Jun;31(3):881-7
references.pmid: 21357413
references.citation: J Am Med Inform Assoc. 2011 Jul-Aug;18(4):506-10
references.pmid: 21672913
references.citation: J Am Coll Radiol. 2006 Apr;3(4):296-8
references.pmid: 17412063
references.citation: J Digit Imaging. 2009 Apr;22(2):202-15
references.pmid: 18239964
references.citation: J Digit Imaging. 2011 Apr;24(2):208-22
references.pmid: 20376525
references.citation: Rofo. 2002 May;174(5):541-50
references.pmid: 11997852
references.citation: Radiographics. 2008 Jul-Aug;28(4):933-45
references.pmid: 18635622
references.citation: J Digit Imaging. 2010 Apr;23(2):217-25
references.pmid: 19294468
references.citation: Int J Med Inform. 2007 Feb-Mar;76(2-3):252-9
references.pmid: 16600671
references.citation: Radiographics. 2004 May-Jun;24(3):891-6
references.pmid: 15143238
references.citation: Algorithms. 2009 Jun 1;2(2):828-849
references.pmid: 20305801