title: Real-time photoacoustic and ultrasound dual-modality imaging system facilitated with graphics processing unit and code parallel optimization.
abstract: Photoacoustic tomography (PAT) offers structural and functional imaging of living biological tissue with highly sensitive optical absorption contrast and excellent spatial resolution comparable to medical ultrasound (US) imaging. We report the development of a fully integrated PAT and US dual-modality imaging system, which performs signal scanning, image reconstruction, and display for both photoacoustic (PA) and US imaging all in a truly real-time manner. The back-projection (BP) algorithm for PA image reconstruction is optimized to reduce the computational cost and facilitate parallel computation on a state of the art graphics processing unit (GPU) card. For the first time, PAT and US imaging of the same object can be conducted simultaneously and continuously, at a real-time frame rate, presently limited by the laser repetition rate of 10 Hz. Noninvasive PAT and US imaging of human peripheral joints in vivo were achieved, demonstrating the satisfactory image quality realized with this system. Another experiment, simultaneous PAT and US imaging of contrast agent flowing through an artificial vessel, was conducted to verify the performance of this system for imaging fast biological events. The GPU-based image reconstruction software code for this dual-modality system is open source and available for download from http://sourceforge.net/projects/patrealtime.
authors.affiliation: Nanjing University, School of Electronic Science and Engineering, Nanjing 210093, China.
authors.forename: Jie
authors.initials: J
authors.lastname: Yuan
authors.forename: Guan
authors.initials: G
authors.lastname: Xu
authors.forename: Yao
authors.initials: Y
authors.lastname: Yu
authors.forename: Yu
authors.initials: Y
authors.lastname: Zhou
authors.forename: Paul L
authors.initials: PL
authors.lastname: Carson
authors.forename: Xueding
authors.initials: X
authors.lastname: Wang
authors.forename: Xiaojun
authors.initials: X
authors.lastname: Liu
mesh_terms: D000465:Algorithms; D003196:Computer Graphics / Q000295:instrumentation*; D003199:Computer Systems; D054459:Elasticity Imaging Techniques / Q000295:instrumentation*; D004867:Equipment Design; D019544:Equipment Failure Analysis; D007089:Image Enhancement / Q000295:instrumentation / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000295:instrumentation* / Q000379:methods*; D064847:Multimodal Imaging / Q000379:methods*; D019047:Phantoms, Imaging; D061088:Photoacoustic Techniques / Q000295:instrumentation*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012984:Software
references.citation: Ann Biomed Eng. 2012 Feb;40(2):422-37
references.pmid: 22048668
references.citation: Philos Trans A Math Phys Eng Sci. 2011 Nov 28;369(1955):4644-50
references.pmid: 22006911
references.citation: Opt Express. 2010 Aug 30;18(18):18625-32
references.pmid: 20940754
references.citation: Opt Express. 2008 May 26;16(11):7915-28
references.pmid: 18545502
references.citation: Phys Rev E Stat Nonlin Soft Matter Phys. 2005 Jan;71(1 Pt 2):016706
references.pmid: 15697763
references.citation: Int J Colorectal Dis. 2003 Jan;18(1):63-72
references.pmid: 12458384
references.citation: J Biomed Opt. 2010 Jan-Feb;15(1):010509
references.pmid: 20210422
references.citation: Biomed Opt Express. 2011 Sep 1;2(9):2540-50
references.pmid: 21991546
references.citation: Biomed Opt Express. 2010 Sep 1;1(2):658-75
references.pmid: 21258498
references.citation: Ultrasound Med Biol. 2011 Mar;37(3):484-92
references.pmid: 21276653
references.citation: J Biomed Opt. 2009 Mar-Apr;14(2):020502
references.pmid: 19405708
references.citation: IEEE Trans Med Imaging. 2005 Apr;24(4):436-40
references.pmid: 15822801
references.citation: J Biomed Opt. 2012 Jun;17(6):061208
references.pmid: 22734738
references.citation: J Biomed Opt. 2012 May;17(5):056016
references.pmid: 22612139
references.citation: J Biomed Opt. 2008 Sep-Oct;13(5):050510
references.pmid: 19021380
references.citation: Nat Biotechnol. 2003 Jul;21(7):803-6
references.pmid: 12808463