title: A comparative study of energy minimization methods for Markov random fields with smoothness-based priors.
abstract: Among the most exciting advances in early vision has been the development of efficient energy minimization algorithms for pixel-labeling tasks such as depth or texture computation. It has been known for decades that such problems can be elegantly expressed as Markov random fields, yet the resulting energy minimization problems have been widely viewed as intractable. Recently, algorithms such as graph cuts and loopy belief propagation (LBP) have proven to be very powerful: for example, such methods form the basis for almost all the top-performing stereo methods. However, the tradeoffs among different energy minimization algorithms are still not well understood. In this paper we describe a set of energy minimization benchmarks and use them to compare the solution quality and running time of several common energy minimization algorithms. We investigate three promising recent methods graph cuts, LBP, and tree-reweighted message passing in addition to the well-known older iterated conditional modes (ICM) algorithm. Our benchmark problems are drawn from published energy functions used for stereo, image stitching, interactive segmentation, and denoising. We also provide a general-purpose software interface that allows vision researchers to easily switch between optimization methods. Benchmarks, code, images, and results are available at http://vision.middlebury.edu/MRF/.
authors.affiliation: Microsoft Research, One Microsoft Way, Redmond, WA 98052-6399, USA. szeliski@microsoft.com
authors.forename: Richard
authors.initials: R
authors.lastname: Szeliski
authors.forename: Ramin
authors.initials: R
authors.lastname: Zabih
authors.forename: Daniel
authors.initials: D
authors.lastname: Scharstein
authors.forename: Olga
authors.initials: O
authors.lastname: Veksler
authors.forename: Vladimir
authors.initials: V
authors.lastname: Kolmogorov
authors.forename: Aseem
authors.initials: A
authors.lastname: Agarwala
authors.forename: Marshall
authors.initials: M
authors.lastname: Tappen
authors.forename: Carsten
authors.initials: C
authors.lastname: Rother
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D008390:Markov Chains; D015233:Models, Statistical; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity