On the risk of extracting relevant information from random data.
This comment constitutes a re-assessment of a recent study in which near-infrared spectroscopy (NIRS) was used to decode decision making. In the original study, the process of feature selection was carried out on all of the data, and those features which displayed the greater classification accuracy were selected, but no independent assessment or validation of the result was performed on a separated set of trials. In order to show the risk of this procedure, the same methodology was applied here to a set of random and independent time series instead of actual NIRS signals. This simulation produced statistically similar results to the original experimental study. It is my opinion that, from the reported classification accuracy of the original paper, no relevant or useful information is really obtained.
Dominguez
Luis Garcia
LG
The Hospital for Sick Children, Toronto, Ontario, Canada. l.garcia.d@gmail.com
D003201:Computers; D003627:Data Interpretation, Statistical; D003657:Decision Making / Q000502:physiology*; D016002:Discriminant Analysis; D005260:Female; D005518:Food Preferences / Q000502:physiology; D006801:Humans; D008297:Male; D017397:Prefrontal Cortex / Q000502:physiology; D019265:Spectroscopy, Near-Infrared / Q000379:methods*; D014584:User-Computer Interface; D055815:Young Adult