title: Live, video-rate super-resolution microscopy using structured illumination and rapid GPU-based parallel processing.
abstract: Structured illumination fluorescence microscopy is a powerful super-resolution method that is capable of achieving a resolution below 100 nm. Each super-resolution image is computationally constructed from a set of differentially illuminated images. However, real-time application of structured illumination microscopy (SIM) has generally been limited due to the computational overhead needed to generate super-resolution images. Here, we have developed a real-time SIM system that incorporates graphic processing unit (GPU) based in-line parallel processing of raw/differentially illuminated images. By using GPU processing, the system has achieved a 90-fold increase in processing speed compared to performing equivalent operations on a multiprocessor computer--the total throughput of the system is limited by data acquisition speed, but not by image processing. Overall, more than 350 raw images (16-bit depth, 512 × 512 pixels) can be processed per second, resulting in a maximum frame rate of 39 super-resolution images per second. This ultrafast processing capability is used to provide immediate feedback of super-resolution images for real-time display. These developments are increasing the potential for sophisticated super-resolution imaging applications.
authors.affiliation: The National Institute of Standards and Technology, Gaithersburg, Maryland 20899, USA.
authors.forename: Jonathan
authors.initials: J
authors.lastname: Lefman
authors.forename: Keana
authors.initials: K
authors.lastname: Scott
authors.forename: Stephan
authors.initials: S
authors.lastname: Stranick
mesh_terms: D003196:Computer Graphics / Q000295:instrumentation*; D007091:Image Processing, Computer-Assisted / Q000295:instrumentation / Q000379:methods*; D008856:Microscopy, Fluorescence / Q000295:instrumentation* / Q000379:methods; D018715:Microscopy, Video / Q000295:instrumentation* / Q000379:methods