title: Analysis of the quality of hospital information systems Audit Trails.
abstract: BACKGROUND
  Audit Trails (AT) are fundamental to information security in order to guarantee access traceability but can also be used to improve Health information System's (HIS) quality namely to assess how they are used or misused. This paper aims at analysing the existence and quality of AT, describing scenarios in hospitals and making some recommendations to improve the quality of information.
  
  
  METHODS
  The responsibles of HIS for eight Portuguese hospitals were contacted in order to arrange an interview about the importance of AT and to collect audit trail data from their HIS. Five institutions agreed to participate in this study; four of them accepted to be interviewed, and four sent AT data. The interviews were performed in 2011 and audit trail data sent in 2011 and 2012. Each AT was evaluated and compared in relation to data quality standards, namely for completeness, comprehensibility, traceability among others. Only one of the AT had enough information for us to apply a consistency evaluation by modelling user behaviour.
  
  
  RESULTS
  The interviewees in these hospitals only knew a few AT (average of 1 AT per hospital in an estimate of 21 existing HIS), although they all recognize some advantages of analysing AT. Four hospitals sent a total of 7 AT - 2 from Radiology Information System (RIS), 2 from Picture Archiving and Communication System (PACS), 3 from Patient Records. Three of the AT were understandable and three of the AT were complete. The AT from the patient records are better structured and more complete than the RIS/PACS.
  
  
  CONCLUSIONS
  Existing AT do not have enough quality to guarantee traceability or be used in HIS improvement. Its quality reflects the importance given to them by the CIO of healthcare institutions. Existing standards (e.g. ASTM:E2147, ISO/TS 18308:2004, ISO/IEC 27001:2006) are still not broadly used in Portugal.
authors.affiliation: CINTESIS - Centre for Research in Health Technologies and Information Systems, Faculdade de Medicina da Universidade do Porto, Porto, Portugal. ricardo.jc.correia@gmail.com.
authors.forename: Ricardo
authors.initials: R
authors.lastname: Cruz-Correia
authors.forename: Isabel
authors.initials: I
authors.lastname: Boldt
authors.forename: Luís
authors.initials: L
authors.lastname: Lapão
authors.forename: Cátia
authors.initials: C
authors.lastname: Santos-Pereira
authors.forename: Pedro Pereira
authors.initials: PP
authors.lastname: Rodrigues
authors.forename: Ana Margarida
authors.initials: AM
authors.lastname: Ferreira
authors.forename: Alberto
authors.initials: A
authors.lastname: Freitas
mesh_terms: D000328:Adult; D006751:Hospital Information Systems / Q000592:standards*; D006761:Hospitals / Q000592:standards*; D006801:Humans; D007406:Interview, Psychological; D008485:Medical Audit / Q000592:standards*; D011174:Portugal
references.citation: Acad Emerg Med. 2004 Nov;11(11):1162-9
references.pmid: 15528580
references.citation: BMC Med Inform Decis Mak. 2010 Mar 16;10:15
references.pmid: 20233389
references.citation: Methods Inf Med. 2007;46(4):500-2
references.pmid: 17694247
references.citation: Pediatr Crit Care Med. 2009 Jan;10(1):23-8
references.pmid: 19057443
references.citation: Ann Emerg Med. 2006 Oct;48(4):426-32
references.pmid: 16997679
references.citation: J Am Med Inform Assoc. 1997 Nov-Dec;4(6):458-64
references.pmid: 9391933
references.citation: J Am Med Inform Assoc. 2013 Jan 1;20(1):144-51
references.pmid: 22733976
references.citation: J AHIMA. 2009 Sep;80(9):44-5; quiz 47-8
references.pmid: 19750906
references.citation: J Biomed Inform. 2012 Dec;45(6):1185-90
references.pmid: 22925724
references.citation: Clin Trials. 2009 Aug;6(4):378-85
references.pmid: 19625330
references.citation: JAMA. 1990 May 16;263(19):2631-3
references.pmid: 2184266
references.citation: J Am Med Inform Assoc. 2007 Mar-Apr;14(2):235-8
references.pmid: 17213496
references.citation: AMIA Annu Symp Proc. 2011;2011:858-67
references.pmid: 22195144
references.citation: Int J Med Inform. 2007 May-Jun;76(5-6):438-41
references.pmid: 17067851
references.citation: Conf Proc IEEE Eng Med Biol Soc. 2005;2006:562-3
references.pmid: 17282242
references.citation: Stud Health Technol Inform. 2008;136:229-34
references.pmid: 18487736