Cognitive skills assessment during robot-assisted surgery: separating the wheat from the chaff.
OBJECTIVE
To investigate the utility of cognitive assessment during robot-assisted surgery (RAS) to define skills in terms of cognitive engagement, mental workload, and mental state; while objectively differentiating between novice and expert surgeons.


METHODS
In all, 10 surgeons with varying operative experience were assigned to beginner (BG), combined competent and proficient (CPG), and expert (EG) groups based on the Dreyfus model. The participants performed tasks for basic, intermediate and advanced skills on the da Vinci Surgical System. Participant performance was assessed using both tool-based and cognitive metrics.


RESULTS
Tool-based metrics showed significant differences between the BG vs CPG and the BG vs EG, in basic skills. While performing intermediate skills, there were significant differences only on the instrument-to-instrument collisions between the BG vs CPG (2.0 vs 0.2, P = 0.028), and the BG vs EG (2.0 vs 0.1, P = 0.018). There were no significant differences between the CPG and EG for both basic and intermediate skills. However, using cognitive metrics, there were significant differences between all groups for the basic and intermediate skills. In advanced skills, there were no significant differences between the CPG and the EG except time (1116 vs 599.6 s), using tool-based metrics. However, cognitive metrics revealed significant differences between both groups.


CONCLUSIONS
Cognitive assessment of surgeons may aid in defining levels of expertise performing complex surgical tasks once competence is achieved. Cognitive assessment may be used as an adjunct to the traditional methods for skill assessment during RAS.
Department of Urology, Roswell Park Cancer Institute, Buffalo, NY, USA.
Khurshid A
KA
Guru
Ehsan T
ET
Esfahani
Syed J
SJ
Raza
Rohit
R
Bhat
Katy
K
Wang
Yana
Y
Hammond
Gregory
G
Wilding
James O
JO
Peabody
Ashirwad J
AJ
Chowriappa
D000328:Adult; D002983:Clinical Competence; D003071:Cognition / Q000502:physiology*; D004521:Educational Measurement / Q000379:methods; D004569:Electroencephalography; D006801:Humans; D008875:Middle Aged; D065287:Robotic Surgical Procedures / Q000193:education* / Q000379:methods; D066231:Surgeons / Q000193:education* / Q000592:standards*; D013647:Task Performance and Analysis
EEG; brain-computer interface; cognitive assessment; expertise; robot-assisted surgery