title: Validated intraclass correlation statistics to test item performance models.
abstract: A new method, with an application program in Matlab code, is proposed for testing item performance models on empirical databases. This method uses data intraclass correlation statistics as expected correlations to which one compares simple functions of correlations between model predictions and observed item performance. The method rests on a data population model whose validity for the considered data is suitably tested and has been verified for three behavioural measure databases. Contrarily to usual model selection criteria, this method provides an effective way of testing under-fitting and over-fitting, answering the usually neglected question "does this model suitably account for these data?"
authors.affiliation: Laboratoire de Psychologie Cognitive, UMR CNRS 6146, Université de Provence, Centre Saint Charles, Bat. 9, Case D, 3 Place Victor Hugo, 13331, Marseille cedex 3, France. pierre.courrieu@univ-provence.fr
authors.forename: Pierre
authors.initials: P
authors.lastname: Courrieu
authors.forename: Muriele
authors.initials: M
authors.lastname: Brand-D'abrescia
authors.forename: Ronald
authors.initials: R
authors.lastname: Peereman
authors.forename: Daniel
authors.initials: D
authors.lastname: Spieler
authors.forename: Arnaud
authors.initials: A
authors.lastname: Rey
mesh_terms: D000465:Algorithms; D000704:Analysis of Variance; D001525:Behavioral Sciences / Q000706:statistics & numerical data; D019336:Cognitive Science / Q000706:statistics & numerical data; D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D005260:Female; D006801:Humans; D008297:Male; D015233:Models, Statistical; D009483:Neuropsychological Tests / Q000592:standards* / Q000706:statistics & numerical data*; D011153:Population; D011597:Psychomotor Performance; D011930:Reaction Time / Q000502:physiology; D012044:Regression Analysis; D015203:Reproducibility of Results; D012494:Sampling Studies; D055815:Young Adult