title: The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models.
abstract: Gene expression data from microarrays are being applied to predict preclinical and clinical endpoints, but the reliability of these predictions has not been established. In the MAQC-II project, 36 independent teams analyzed six microarray data sets to generate predictive models for classifying a sample with respect to one of 13 endpoints indicative of lung or liver toxicity in rodents, or of breast cancer, multiple myeloma or neuroblastoma in humans. In total, >30,000 models were built using many combinations of analytical methods. The teams generated predictive models without knowing the biological meaning of some of the endpoints and, to mimic clinical reality, tested the models on data that had not been used for training. We found that model performance depended largely on the endpoint and team proficiency and that different approaches generated models of similar performance. The conclusions and recommendations from MAQC-II should be useful for regulatory agencies, study committees and independent investigators that evaluate methods for global gene expression analysis.
authors.affiliation: National Center for Toxicological Research, US Food and Drug Administration, Jefferson, Arkansas, USA.
authors.forename: Leming
authors.initials: L
authors.lastname: Shi
authors.forename: Gregory
authors.initials: G
authors.lastname: Campbell
authors.forename: Wendell D
authors.initials: WD
authors.lastname: Jones
authors.forename: Fabien
authors.initials: F
authors.lastname: Campagne
authors.forename: Zhining
authors.initials: Z
authors.lastname: Wen
authors.forename: Stephen J
authors.initials: SJ
authors.lastname: Walker
authors.forename: Zhenqiang
authors.initials: Z
authors.lastname: Su
authors.forename: Tzu-Ming
authors.initials: TM
authors.lastname: Chu
authors.forename: Federico M
authors.initials: FM
authors.lastname: Goodsaid
authors.forename: Lajos
authors.initials: L
authors.lastname: Pusztai
authors.forename: John D
authors.initials: JD
authors.lastname: Shaughnessy
authors.forename: André
authors.initials: A
authors.lastname: Oberthuer
authors.forename: Russell S
authors.initials: RS
authors.lastname: Thomas
authors.forename: Richard S
authors.initials: RS
authors.lastname: Paules
authors.forename: Mark
authors.initials: M
authors.lastname: Fielden
authors.forename: Bart
authors.initials: B
authors.lastname: Barlogie
authors.forename: Weijie
authors.initials: W
authors.lastname: Chen
authors.forename: Pan
authors.initials: P
authors.lastname: Du
authors.forename: Matthias
authors.initials: M
authors.lastname: Fischer
authors.forename: Cesare
authors.initials: C
authors.lastname: Furlanello
authors.forename: Brandon D
authors.initials: BD
authors.lastname: Gallas
authors.forename: Xijin
authors.initials: X
authors.lastname: Ge
authors.forename: Dalila B
authors.initials: DB
authors.lastname: Megherbi
authors.forename: W Fraser
authors.initials: WF
authors.lastname: Symmans
authors.forename: May D
authors.initials: MD
authors.lastname: Wang
authors.forename: John
authors.initials: J
authors.lastname: Zhang
authors.forename: Hans
authors.initials: H
authors.lastname: Bitter
authors.forename: Benedikt
authors.initials: B
authors.lastname: Brors
authors.forename: Pierre R
authors.initials: PR
authors.lastname: Bushel
authors.forename: Max
authors.initials: M
authors.lastname: Bylesjo
authors.forename: Minjun
authors.initials: M
authors.lastname: Chen
authors.forename: Jie
authors.initials: J
authors.lastname: Cheng
authors.forename: Jing
authors.initials: J
authors.lastname: Cheng
authors.forename: Jeff
authors.initials: J
authors.lastname: Chou
authors.forename: Timothy S
authors.initials: TS
authors.lastname: Davison
authors.forename: Mauro
authors.initials: M
authors.lastname: Delorenzi
authors.forename: Youping
authors.initials: Y
authors.lastname: Deng
authors.forename: Viswanath
authors.initials: V
authors.lastname: Devanarayan
authors.forename: David J
authors.initials: DJ
authors.lastname: Dix
authors.forename: Joaquin
authors.initials: J
authors.lastname: Dopazo
authors.forename: Kevin C
authors.initials: KC
authors.lastname: Dorff
authors.forename: Fathi
authors.initials: F
authors.lastname: Elloumi
authors.forename: Jianqing
authors.initials: J
authors.lastname: Fan
authors.forename: Shicai
authors.initials: S
authors.lastname: Fan
authors.forename: Xiaohui
authors.initials: X
authors.lastname: Fan
authors.forename: Hong
authors.initials: H
authors.lastname: Fang
authors.forename: Nina
authors.initials: N
authors.lastname: Gonzaludo
authors.forename: Kenneth R
authors.initials: KR
authors.lastname: Hess
authors.forename: Huixiao
authors.initials: H
authors.lastname: Hong
authors.forename: Jun
authors.initials: J
authors.lastname: Huan
authors.forename: Rafael A
authors.initials: RA
authors.lastname: Irizarry
authors.forename: Richard
authors.initials: R
authors.lastname: Judson
authors.forename: Dilafruz
authors.initials: D
authors.lastname: Juraeva
authors.forename: Samir
authors.initials: S
authors.lastname: Lababidi
authors.forename: Christophe G
authors.initials: CG
authors.lastname: Lambert
authors.forename: Li
authors.initials: L
authors.lastname: Li
authors.forename: Yanen
authors.initials: Y
authors.lastname: Li
authors.forename: Zhen
authors.initials: Z
authors.lastname: Li
authors.forename: Simon M
authors.initials: SM
authors.lastname: Lin
authors.forename: Guozhen
authors.initials: G
authors.lastname: Liu
authors.forename: Edward K
authors.initials: EK
authors.lastname: Lobenhofer
authors.forename: Jun
authors.initials: J
authors.lastname: Luo
authors.forename: Wen
authors.initials: W
authors.lastname: Luo
authors.forename: Matthew N
authors.initials: MN
authors.lastname: McCall
authors.forename: Yuri
authors.initials: Y
authors.lastname: Nikolsky
authors.forename: Gene A
authors.initials: GA
authors.lastname: Pennello
authors.forename: Roger G
authors.initials: RG
authors.lastname: Perkins
authors.forename: Reena
authors.initials: R
authors.lastname: Philip
authors.forename: Vlad
authors.initials: V
authors.lastname: Popovici
authors.forename: Nathan D
authors.initials: ND
authors.lastname: Price
authors.forename: Feng
authors.initials: F
authors.lastname: Qian
authors.forename: Andreas
authors.initials: A
authors.lastname: Scherer
authors.forename: Tieliu
authors.initials: T
authors.lastname: Shi
authors.forename: Weiwei
authors.initials: W
authors.lastname: Shi
authors.forename: Jaeyun
authors.initials: J
authors.lastname: Sung
authors.forename: Danielle
authors.initials: D
authors.lastname: Thierry-Mieg
authors.forename: Jean
authors.initials: J
authors.lastname: Thierry-Mieg
authors.forename: Venkata
authors.initials: V
authors.lastname: Thodima
authors.forename: Johan
authors.initials: J
authors.lastname: Trygg
authors.forename: Lakshmi
authors.initials: L
authors.lastname: Vishnuvajjala
authors.forename: Sue Jane
authors.initials: SJ
authors.lastname: Wang
authors.forename: Jianping
authors.initials: J
authors.lastname: Wu
authors.forename: Yichao
authors.initials: Y
authors.lastname: Wu
authors.forename: Qian
authors.initials: Q
authors.lastname: Xie
authors.forename: Waleed A
authors.initials: WA
authors.lastname: Yousef
authors.forename: Liang
authors.initials: L
authors.lastname: Zhang
authors.forename: Xuegong
authors.initials: X
authors.lastname: Zhang
authors.forename: Sheng
authors.initials: S
authors.lastname: Zhong
authors.forename: Yiming
authors.initials: Y
authors.lastname: Zhou
authors.forename: Sheng
authors.initials: S
authors.lastname: Zhu
authors.forename: Dhivya
authors.initials: D
authors.lastname: Arasappan
authors.forename: Wenjun
authors.initials: W
authors.lastname: Bao
authors.forename: Anne Bergstrom
authors.initials: AB
authors.lastname: Lucas
authors.forename: Frank
authors.initials: F
authors.lastname: Berthold
authors.forename: Richard J
authors.initials: RJ
authors.lastname: Brennan
authors.forename: Andreas
authors.initials: A
authors.lastname: Buness
authors.forename: Jennifer G
authors.initials: JG
authors.lastname: Catalano
authors.forename: Chang
authors.initials: C
authors.lastname: Chang
authors.forename: Rong
authors.initials: R
authors.lastname: Chen
authors.forename: Yiyu
authors.initials: Y
authors.lastname: Cheng
authors.forename: Jian
authors.initials: J
authors.lastname: Cui
authors.forename: Wendy
authors.initials: W
authors.lastname: Czika
authors.forename: Francesca
authors.initials: F
authors.lastname: Demichelis
authors.forename: Xutao
authors.initials: X
authors.lastname: Deng
authors.forename: Damir
authors.initials: D
authors.lastname: Dosymbekov
authors.forename: Roland
authors.initials: R
authors.lastname: Eils
authors.forename: Yang
authors.initials: Y
authors.lastname: Feng
authors.forename: Jennifer
authors.initials: J
authors.lastname: Fostel
authors.forename: Stephanie
authors.initials: S
authors.lastname: Fulmer-Smentek
authors.forename: James C
authors.initials: JC
authors.lastname: Fuscoe
authors.forename: Laurent
authors.initials: L
authors.lastname: Gatto
authors.forename: Weigong
authors.initials: W
authors.lastname: Ge
authors.forename: Darlene R
authors.initials: DR
authors.lastname: Goldstein
authors.forename: Li
authors.initials: L
authors.lastname: Guo
authors.forename: Donald N
authors.initials: DN
authors.lastname: Halbert
authors.forename: Jing
authors.initials: J
authors.lastname: Han
authors.forename: Stephen C
authors.initials: SC
authors.lastname: Harris
authors.forename: Christos
authors.initials: C
authors.lastname: Hatzis
authors.forename: Damir
authors.initials: D
authors.lastname: Herman
authors.forename: Jianping
authors.initials: J
authors.lastname: Huang
authors.forename: Roderick V
authors.initials: RV
authors.lastname: Jensen
authors.forename: Rui
authors.initials: R
authors.lastname: Jiang
authors.forename: Charles D
authors.initials: CD
authors.lastname: Johnson
authors.forename: Giuseppe
authors.initials: G
authors.lastname: Jurman
authors.forename: Yvonne
authors.initials: Y
authors.lastname: Kahlert
authors.forename: Sadik A
authors.initials: SA
authors.lastname: Khuder
authors.forename: Matthias
authors.initials: M
authors.lastname: Kohl
authors.forename: Jianying
authors.initials: J
authors.lastname: Li
authors.forename: Li
authors.initials: L
authors.lastname: Li
authors.forename: Menglong
authors.initials: M
authors.lastname: Li
authors.forename: Quan-Zhen
authors.initials: QZ
authors.lastname: Li
authors.forename: Shao
authors.initials: S
authors.lastname: Li
authors.forename: Zhiguang
authors.initials: Z
authors.lastname: Li
authors.forename: Jie
authors.initials: J
authors.lastname: Liu
authors.forename: Ying
authors.initials: Y
authors.lastname: Liu
authors.forename: Zhichao
authors.initials: Z
authors.lastname: Liu
authors.forename: Lu
authors.initials: L
authors.lastname: Meng
authors.forename: Manuel
authors.initials: M
authors.lastname: Madera
authors.forename: Francisco
authors.initials: F
authors.lastname: Martinez-Murillo
authors.forename: Ignacio
authors.initials: I
authors.lastname: Medina
authors.forename: Joseph
authors.initials: J
authors.lastname: Meehan
authors.forename: Kelci
authors.initials: K
authors.lastname: Miclaus
authors.forename: Richard A
authors.initials: RA
authors.lastname: Moffitt
authors.forename: David
authors.initials: D
authors.lastname: Montaner
authors.forename: Piali
authors.initials: P
authors.lastname: Mukherjee
authors.forename: George J
authors.initials: GJ
authors.lastname: Mulligan
authors.forename: Padraic
authors.initials: P
authors.lastname: Neville
authors.forename: Tatiana
authors.initials: T
authors.lastname: Nikolskaya
authors.forename: Baitang
authors.initials: B
authors.lastname: Ning
authors.forename: Grier P
authors.initials: GP
authors.lastname: Page
authors.forename: Joel
authors.initials: J
authors.lastname: Parker
authors.forename: R Mitchell
authors.initials: RM
authors.lastname: Parry
authors.forename: Xuejun
authors.initials: X
authors.lastname: Peng
authors.forename: Ron L
authors.initials: RL
authors.lastname: Peterson
authors.forename: John H
authors.initials: JH
authors.lastname: Phan
authors.forename: Brian
authors.initials: B
authors.lastname: Quanz
authors.forename: Yi
authors.initials: Y
authors.lastname: Ren
authors.forename: Samantha
authors.initials: S
authors.lastname: Riccadonna
authors.forename: Alan H
authors.initials: AH
authors.lastname: Roter
authors.forename: Frank W
authors.initials: FW
authors.lastname: Samuelson
authors.forename: Martin M
authors.initials: MM
authors.lastname: Schumacher
authors.forename: Joseph D
authors.initials: JD
authors.lastname: Shambaugh
authors.forename: Qiang
authors.initials: Q
authors.lastname: Shi
authors.forename: Richard
authors.initials: R
authors.lastname: Shippy
authors.forename: Shengzhu
authors.initials: S
authors.lastname: Si
authors.forename: Aaron
authors.initials: A
authors.lastname: Smalter
authors.forename: Christos
authors.initials: C
authors.lastname: Sotiriou
authors.forename: Mat
authors.initials: M
authors.lastname: Soukup
authors.forename: Frank
authors.initials: F
authors.lastname: Staedtler
authors.forename: Guido
authors.initials: G
authors.lastname: Steiner
authors.forename: Todd H
authors.initials: TH
authors.lastname: Stokes
authors.forename: Qinglan
authors.initials: Q
authors.lastname: Sun
authors.forename: Pei-Yi
authors.initials: PY
authors.lastname: Tan
authors.forename: Rong
authors.initials: R
authors.lastname: Tang
authors.forename: Zivana
authors.initials: Z
authors.lastname: Tezak
authors.forename: Brett
authors.initials: B
authors.lastname: Thorn
authors.forename: Marina
authors.initials: M
authors.lastname: Tsyganova
authors.forename: Yaron
authors.initials: Y
authors.lastname: Turpaz
authors.forename: Silvia C
authors.initials: SC
authors.lastname: Vega
authors.forename: Roberto
authors.initials: R
authors.lastname: Visintainer
authors.forename: Juergen
authors.initials: J
authors.lastname: von Frese
authors.forename: Charles
authors.initials: C
authors.lastname: Wang
authors.forename: Eric
authors.initials: E
authors.lastname: Wang
authors.forename: Junwei
authors.initials: J
authors.lastname: Wang
authors.forename: Wei
authors.initials: W
authors.lastname: Wang
authors.forename: Frank
authors.initials: F
authors.lastname: Westermann
authors.forename: James C
authors.initials: JC
authors.lastname: Willey
authors.forename: Matthew
authors.initials: M
authors.lastname: Woods
authors.forename: Shujian
authors.initials: S
authors.lastname: Wu
authors.forename: Nianqing
authors.initials: N
authors.lastname: Xiao
authors.forename: Joshua
authors.initials: J
authors.lastname: Xu
authors.forename: Lei
authors.initials: L
authors.lastname: Xu
authors.forename: Lun
authors.initials: L
authors.lastname: Yang
authors.forename: Xiao
authors.initials: X
authors.lastname: Zeng
authors.forename: Jialu
authors.initials: J
authors.lastname: Zhang
authors.forename: Li
authors.initials: L
authors.lastname: Zhang
authors.forename: Min
authors.initials: M
authors.lastname: Zhang
authors.forename: Chen
authors.initials: C
authors.lastname: Zhao
authors.forename: Raj K
authors.initials: RK
authors.lastname: Puri
authors.forename: Uwe
authors.initials: U
authors.lastname: Scherf
authors.forename: Weida
authors.initials: W
authors.lastname: Tong
authors.forename: Russell D
authors.initials: RD
authors.lastname: Wolfinger
mesh_terms: D000818:Animals; D001943:Breast Neoplasms / Q000175:diagnosis / Q000235:genetics; D004195:Disease Models, Animal; D005260:Female; D020869:Gene Expression Profiling / Q000379:methods / Q000592:standards; D017408:Guidelines as Topic; D006801:Humans; D008107:Liver Diseases / Q000209:etiology / Q000235:genetics* / Q000473:pathology; D008171:Lung Diseases / Q000209:etiology / Q000235:genetics* / Q000473:pathology; D009101:Multiple Myeloma / Q000175:diagnosis / Q000235:genetics; D009369:Neoplasms / Q000175:diagnosis / Q000235:genetics* / Q000401:mortality*; D009447:Neuroblastoma / Q000175:diagnosis / Q000235:genetics; D020411:Oligonucleotide Array Sequence Analysis / Q000379:methods* / Q000592:standards*; D011237:Predictive Value of Tests; D011786:Quality Control; D051381:Rats; D016019:Survival Analysis