title: PIZZARO: Forensic analysis and restoration of image and video data.
abstract: This paper introduces a set of methods for image and video forensic analysis. They were designed to help to assess image and video credibility and origin and to restore and increase image quality by diminishing unwanted blur, noise, and other possible artifacts. The motivation came from the best practices used in the criminal investigation utilizing images and/or videos. The determination of the image source, the verification of the image content, and image restoration were identified as the most important issues of which automation can facilitate criminalists work. Novel theoretical results complemented with existing approaches (LCD re-capture detection and denoising) were implemented in the PIZZARO software tool, which consists of the image processing functionality as well as of reporting and archiving functions to ensure the repeatability of image analysis procedures and thus fulfills formal aspects of the image/video analysis work. Comparison of new proposed methods with the state of the art approaches is shown. Real use cases are presented, which illustrate the functionality of the developed methods and demonstrate their applicability in different situations. The use cases as well as the method design were solved in tight cooperation of scientists from the Institute of Criminalistics, National Drug Headquarters of the Criminal Police and Investigation Service of the Police of the Czech Republic, and image processing experts from the Czech Academy of Sciences.
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: kamenik@utia.cas.cz.
authors.forename: Jan
authors.initials: J
authors.lastname: Kamenicky
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: bartos@utia.cas.cz.
authors.forename: Michal
authors.initials: M
authors.lastname: Bartos
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: flusser@utia.cas.cz.
authors.forename: Jan
authors.initials: J
authors.lastname: Flusser
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: mahdian@utia.cas.cz.
authors.forename: Babak
authors.initials: B
authors.lastname: Mahdian
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: kotera@utia.cas.cz.
authors.forename: Jan
authors.initials: J
authors.lastname: Kotera
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: novozamsky@utia.cas.cz.
authors.forename: Adam
authors.initials: A
authors.lastname: Novozamsky
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: ssaic@utia.cas.cz.
authors.forename: Stanislav
authors.initials: S
authors.lastname: Saic
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: sroubekf@utia.cas.cz.
authors.forename: Filip
authors.initials: F
authors.lastname: Sroubek
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: sorel@utia.cas.cz.
authors.forename: Michal
authors.initials: M
authors.lastname: Sorel
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: zita@utia.cas.cz.
authors.forename: Ales
authors.initials: A
authors.lastname: Zita
authors.affiliation: Institute of Information Theory and Automation, The Czech Academy of Sciences, Pod vodárenskou vezi 4, Prague, Czech Republic. Electronic address: zitova@utia.cas.cz.
authors.forename: Barbara
authors.initials: B
authors.lastname: Zitova
authors.affiliation: Institute of Criminalistics, Audio-Video Department, Prague, Czech Republic. Electronic address: zdenek.sima1@pcr.cz.
authors.forename: Zdenek
authors.initials: Z
authors.lastname: Sima
authors.affiliation: Institute of Criminalistics, Audio-Video Department, Prague, Czech Republic. Electronic address: pizzaro@utia.cas.cz.
authors.forename: Petr
authors.initials: P
authors.lastname: Svarc
authors.affiliation: National Drug Headquarters of the Criminal Police and Investigation Service of the Police of the Czech Republic, Informatics Department, Prague, Czech Republic. Electronic address: jan.horinek@seznam.cz.
authors.forename: Jan
authors.initials: J
authors.lastname: Horinek
keywords: Image forensic analysis; Image restoration; Image source identification; Image tampering detection