Objective comparison of particle tracking methods.
Particle tracking is of key importance for quantitative analysis of intracellular dynamic processes from time-lapse microscopy image data. Because manually detecting and following large numbers of individual particles is not feasible, automated computational methods have been developed for these tasks by many groups. Aiming to perform an objective comparison of methods, we gathered the community and organized an open competition in which participating teams applied their own methods independently to a commonly defined data set including diverse scenarios. Performance was assessed using commonly defined measures. Although no single method performed best across all scenarios, the results revealed clear differences between the various approaches, leading to notable practical conclusions for users and developers.
1] Institut Pasteur, Unité d'Analyse d'Images Quantitative, Centre National de la Recherche Scientifique Unité de Recherche Associée 2582, Paris, France. [2] Biomedical Imaging Group, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland. [3] New York University Neuroscience Institute, New York University Medical Center, New York, New York, USA. [4].
Nicolas
N
Chenouard
1] Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, The Netherlands. [2] Department of Radiology, Erasmus University Medical Center, Rotterdam, The Netherlands. [3].
Ihor
I
Smal
1] Institut Pasteur, Unité d'Analyse d'Images Quantitative, Centre National de la Recherche Scientifique Unité de Recherche Associée 2582, Paris, France. [2].
Fabrice
F
de Chaumont
1] Center for Applied Medical Research, University of Navarra, Pamplona, Spain. [2] Centre for Biomedical Image Analysis, Masaryk University, Brno, Czech Republic. [3].
Martin
M
Maška
MOSAIC Group, Max Planck Institute of Molecular Cell Biology and Genetics, Dresden, Germany.
Ivo F
IF
Sbalzarini
MOSAIC Group, Max Planck Institute of Molecular Cell Biology and Genetics, Dresden, Germany.
Yuanhao
Y
Gong
MOSAIC Group, Max Planck Institute of Molecular Cell Biology and Genetics, Dresden, Germany.
Janick
J
Cardinale
Compunetix Inc., Monroeville, Pennsylvania, USA.
Craig
C
Carthel
Compunetix Inc., Monroeville, Pennsylvania, USA.
Stefano
S
Coraluppi
Department of Electrical and Computer Engineering, Drexel University, Philadelphia, Pennsylvania, USA.
Mark
M
Winter
Department of Electrical and Computer Engineering, Drexel University, Philadelphia, Pennsylvania, USA.
Andrew R
AR
Cohen
1] Department of Bioinformatics and Functional Genomics, Institute of Pharmacy and Molecular Biotechnology, University of Heidelberg, Heidelberg, Germany. [2] Division of Theoretical Bioinformatics, German Cancer Research Center, Heidelberg, Germany.
William J
WJ
Godinez
1] Department of Bioinformatics and Functional Genomics, Institute of Pharmacy and Molecular Biotechnology, University of Heidelberg, Heidelberg, Germany. [2] Division of Theoretical Bioinformatics, German Cancer Research Center, Heidelberg, Germany.
Karl
K
Rohr
1] Max Planck Institute of Molecular Cell Biology and Genetics, Dresden, Germany. [2] Belozersky Institute of Physico-Chemical Biology, Moscow State University, Moscow, Russia.
Yannis
Y
Kalaidzidis
Department of Electrical Engineering, Yale University, New Haven, Connecticut, USA.
Liang
L
Liang
Department of Electrical Engineering, Yale University, New Haven, Connecticut, USA.
James
J
Duncan
Department of Cell Biology, Yale University, New Haven, Connecticut, USA.
Hongying
H
Shen
Department of Biomedical Engineering, Zhejiang University, Hangzhou, China.
Yingke
Y
Xu
Department of Signal Processing, ACCESS Linnaeus Centre, KTH Royal Institute of Technology, Stockholm, Sweden.
Klas E G
KE
Magnusson
Department of Signal Processing, ACCESS Linnaeus Centre, KTH Royal Institute of Technology, Stockholm, Sweden.
Joakim
J
Jaldén
Baxter Laboratory for Stem Cell Biology, Department of Microbiology and Immunology, Stanford University School of Medicine, Stanford, California, USA.
Helen M
HM
Blau
Cell and Tissue Imaging Facility, Institut Curie, Paris, France.
Perrine
0000000339034841
P
Paul-Gilloteaux
Inria Rennes, Bretagne Atlantique, Rennes, France.
Philippe
P
Roudot
Inria Rennes, Bretagne Atlantique, Rennes, France.
Charles
C
Kervrann
Cell and Tissue Imaging Facility, Institut Curie, Paris, France.
François
F
Waharte
Plateforme d'Imagerie Dynamique, Imagopole, Institut Pasteur, Paris, France.
Jean-Yves
JY
Tinevez
Plateforme d'Imagerie Dynamique, Imagopole, Institut Pasteur, Paris, France.
Spencer L
SL
Shorte
Molecular Biotechnology Group, Institute of Biology, Leiden University, Leiden, The Netherlands.
Joost
J
Willemse
Molecular Biotechnology Group, Institute of Biology, Leiden University, Leiden, The Netherlands.
Katherine
K
Celler
Molecular Biotechnology Group, Institute of Biology, Leiden University, Leiden, The Netherlands.
Gilles P
0000000303411561
GP
van Wezel
Department of Biomedical Engineering, Chung Yuan Christian University, Chung Li City, Taiwan, China.
Han-Wei
HW
Dan
Department of Biomedical Engineering, Chung Yuan Christian University, Chung Li City, Taiwan, China.
Yuh-Show
YS
Tsai
Center for Applied Medical Research, University of Navarra, Pamplona, Spain.
Carlos
C
Ortiz de Solórzano
1] Institut Pasteur, Unité d'Analyse d'Images Quantitative, Centre National de la Recherche Scientifique Unité de Recherche Associée 2582, Paris, France. [2].
Jean-Christophe
JC
Olivo-Marin
1] Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, The Netherlands. [2] Department of Radiology, Erasmus University Medical Center, Rotterdam, The Netherlands. [3].
Erik
E
Meijering
D007090:Image Interpretation, Computer-Assisted / Q000592:standards; D008856:Microscopy, Fluorescence / Q000379:methods* / Q000592:standards