title: Pattern mining of user interaction logs for a post-deployment usability evaluation of a radiology PACS client.
abstract: OBJECTIVE
  To perform a post-deployment usability evaluation of a radiology Picture Archiving and Communication System (PACS) client based on pattern mining of user interaction log data, and to assess the usefulness of this approach compared to a field study.
  
  
  METHODS
  All user actions performed on the PACS client were logged for four months. A data mining technique called closed sequential pattern mining was used to automatically extract frequently occurring interaction patterns from the log data. These patterns were used to identify usability issues with the PACS. The results of this evaluation were compared to the results of a field study based usability evaluation of the same PACS client.
  
  
  RESULTS
  The interaction patterns revealed four usability issues: (1) the display protocols do not function properly, (2) the line measurement tool stays active until another tool is selected, rather than being deactivated after one use, (3) the PACS's built-in 3D functionality does not allow users to effectively perform certain 3D-related tasks, (4) users underuse the PACS's customization possibilities. All usability issues identified based on the log data were also found in the field study, which identified 48 issues in total.
  
  
  CONCLUSIONS
  Post-deployment usability evaluation based on pattern mining of user interaction log data provides useful insights into the way users interact with the radiology PACS client. However, it reveals few usability issues compared to a field study and should therefore not be used as the sole method of usability evaluation.
authors.affiliation: University of Groningen, University Medical Center Groningen, Dept. Radiology, Hanzeplein 1, 9713 GZ Groningen, The Netherlands. Electronic address: w.jorritsma01@umcg.nl.
authors.forename: Wiard
authors.initials: W
authors.lastname: Jorritsma
authors.affiliation: University of Groningen, Institute of Artificial Intelligence and Cognitive Engineering, Nijenborgh 9, 9747 AG Groningen, The Netherlands.
authors.forename: Fokie
authors.initials: F
authors.lastname: Cnossen
authors.affiliation: University of Groningen, University Medical Center Groningen, Dept. Radiology, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; University of Groningen, University Medical Center Groningen, Dept. Nuclear Medicine and Molecular Imaging, Hanzeplein 1, 9713 GZ Groningen, The Netherlands.
authors.forename: Rudi A
authors.initials: RA
authors.lastname: Dierckx
authors.affiliation: University of Groningen, University Medical Center Groningen, Dept. Radiology, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; Center for Medical Imaging North East Netherlands, Hanzeplein 1, 9713 GZ Groningen, The Netherlands.
authors.forename: Matthijs
authors.initials: M
authors.lastname: Oudkerk
authors.affiliation: University of Groningen, University Medical Center Groningen, Dept. Radiology, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; Center for Medical Imaging North East Netherlands, Hanzeplein 1, 9713 GZ Groningen, The Netherlands.
authors.forename: Peter M A
authors.initials: PM
authors.lastname: van Ooijen
mesh_terms: D006801:Humans; D013902:Radiography, Thoracic; D011871:Radiology / Q000295:instrumentation*; D011873:Radiology Information Systems
keywords: Data mining; Picture archiving and communication system; Usability; User interaction log data; User-computer interface