This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Similar articles in PubMed Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Vassiliou, M. C. Articles by Fried, G. M. Search for Related Content PubMed PubMed Citation Articles by Vassiliou, M. C. Articles by Fried, G. M. Social Bookmarking                         What's this?

Evaluating Intraoperative Laparoscopic Skill: Direct Observation Versus Blinded Videotaped Performances

Department of Surgery, McGill University, Montreal, Canada, Steinberg-Bernstein Centre for Minimally Invasive Surgery McGill University, Montreal, Canada

Liane S. Feldman, MD

Department of Surgery, McGill University, Montreal, Canada, Steinberg-Bernstein Centre for Minimally Invasive Surgery McGill University, Montreal, Canada

Shannon A. Fraser, MD, MSc

Department of Surgery, McGill University, Montreal, Canada, Steinberg-Bernstein Centre for Minimally Invasive Surgery McGill University, Montreal, Canada

Patrick Charlebois, MD

Department of Surgery, McGill University, Montreal, Canada

Prosanto Chaudhury, MD

Department of Surgery, McGill University, Montreal, Canada

Donna D. Stanbridge, RN

Steinberg-Bernstein Centre for Minimally Invasive Surgery McGill University, Montreal, Canada

Gerald M. Fried, MD

Department of Surgery, McGill University, Montreal, Canada, gerald.fried{at}mcgill.ca, Steinberg-Bernstein Centre for Minimally Invasive Surgery McGill University, Montreal, Canada

The Global Operative Assessment of Laparoscopic Skill (GOALS) has been shown to meet high standards for direct observation. The purpose of this study was to investigate the reliability and validity of GOALS when applied to blinded, videotaped performances. Five novice surgeons and 5 experienced surgeons were each evaluated by 2 observers during a laparoscopic cholecystectomy. Subsequently, 4 laparoscopists (V1 to V4) evaluated the videotaped procedures using GOALS. Two of the raters (V1 and V3) had prior experience using GOALS. The interrater reliabilities between video raters (VRs) and between VRs and direct raters (DRs) were calculated using the intraclass correlation coefficient. Construct validity was assessed using 2-way analysis of variance. Interrater reliability between the 4 VRs and the 2 DRs was 0.72. The intraclass correlation coefficient for the 4 VRs was 0.68 and for each VR compared with the mean DR was 0.86, 0.39, 0.94, and 0.76, respectively. All raters, except V2, differentiated between novice and experienced groups (P values ranged from .01 to .05). These data suggest that GOALS can be used to assess laparoscopic skill based on videotaped performances but that rater training may play an important role in ensuring the reliability and validity of the instrument. Experience with the tool in the operating room may improve the reliability of video rating and could be of value in training evaluators.

Key Words: intraoperative assessment • laparoscopic skills • surgical training • video assessment • feedback • GOALS

Surgical Innovation, Vol. 14, No. 3, 211-216 (2007)
DOI: 10.1177/1553350607308466


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?