Abstract
Objective The lack of a standard technique may be a relevant issue in teaching endoscopic endonasal surgery (EES) to novice surgeons. The objective of this article is to compare different endoscope positioning and microsurgical dissection techniques in EES training.
Methods A comparative trial was designed to evaluate three techniques: group A, one surgeon performing binarial two-hands dissection using an endoscope holder (rigid endoscopy); group B, two surgeons performing a combined binarial two- and three-handed dissection with one surgeon guiding the endoscope (dynamic endoscopy); and group C, two surgeons performing a binarial two-hands dissection with one surgeon dedicated to endoscope positioning and the other dedicated to a two-handed dissection. Trainees were randomly assigned to these groups and oriented to complete surgical tasks in a validated training model for EES. A global rating scale, and a specific-task checklist for EES were used to assess surgical skills.
Results The mean scores of the global rating scale and the specific-task checklist were higher (p = 0.001 and 0.002, respectively) for group C, reflecting the positive impact of dynamic endoscopy and bimanual dissection on training performance.
Conclusions We found that dynamic endoscopic and bimanual-binarial microdissection techniques had a significant positive impact on EES training.
Keywords: endoscopic endonasal surgery, surgical technique, surgical training, performance assessment
Introduction
Endoscopic endonasal surgery (EES) of the pituitary and cranial base is associated with a long learning curve.1 2 3 4 A structured program based on the difficulty of the surgical approach,4 combined with a modular anatomical approach, has being used for surgical training and to minimize surgical morbidity.5 6 7 By following this program, trainees must incrementally acquire surgical skills to master simple procedures before proceeding to the next level of difficulty.
These procedures are usually performed in close collaboration between neurosurgeons and otolaryngologists. Nonetheless, peer-reviewed literature and national and international presentations reveal there is no standard technique used for this type of surgery. Three different techniques have been commonly and successfully applied: one single surgeon performing bimanual-binarial dissection using a mechanical holder for endoscope positioning; two surgeons performing a combined two-to three-handed dissection, where one surgeon guides the endoscope and simultaneously performs a one-hand dissection while the second surgeon performs uni- or bimanual-uninarial dissection; and two surgeons, one fully dedicated to endoscope positioning and another one fully dedicated to bimanual-binarial dissection.3 8
Teaching safe and efficient technique is one of the most important steps of any surgical training program. The lack of a standard technique for (EES) may limit progression along this long learning curve. We consider standardization an important tool to establish instructional methods that may be more universally applied. Therefore, the main objective of this article is to compare different endoscope positioning and microsurgical dissection techniques in EES training.
Material and Methods
This study was conducted at the Surgical Neuroanatomy Laboratory of the University of Pittsburgh. A randomized comparative trial was designed to evaluate objectively the three previously mentioned surgical techniques used for EES as follows (Fig. 1):
Fig. 1.

Schematic drawing showing the different surgical techniques. Group A shows rigid endoscopy by using an endoscope holder (H) on the right nostril and one single surgeon (D1) performing bimanual-binarial dissection. Group B shows dynamic endoscopy (E1). Note that the surgeon who guides the endoscope also performs one-hand dissection (D1). The second surgeon performs uni- or bimanual uninarial dissection (D2). Group C shows the division of labor between the two surgeons. While one surgeon is dedicated to endoscope positioning (E1), the second surgeon performs bimanual-binarial dissection (D2).
Group A: One single surgeon performing binarial two-hands dissection using an endoscope holder (rigid endoscopy). If desired, the surgeon could change the position of the endoscope at any time during the exercise.
Group B: Two surgeons performing a combined binarial two- and three-handed dissection with one surgeon guiding the endoscope (dynamic endoscopy).
Group C: Two surgeons performing a binarial two-hands dissection with one surgeon fully dedicated to endoscope positioning and the other one fully dedicated to a two-handed dissection.
Participant Trainees and Training Session
Twelve trainees without any or very limited experience (< 10 surgeries) with EES volunteered to participate in this study. They were randomly assigned to three groups and oriented to complete surgical tasks in a validated training model for EES: the chicken wing training model (CWTM).9 Thereafter, the training sessions were randomly performed five times for each trainee (three times dissecting and two times dynamically guiding the endoscope) to minimize intervention biases (e.g., proficiency bias). A total of 36 procedures were recorded and evaluated.
The CWTM and the four tasks previously described were used for soft tissue dissection.9 To simulate a bony dissection, the trainees were asked to drill the shell of a chicken egg without compromising its inner membrane (Fig. 2).
Fig. 2.

Chicken wing training model (CWTM): surgical tasks. Endoscopic view. (A) Egg drilling as a simulation of bony dissection; CWTM showing different aspects of dissection. (B) Skin opening. (C) Initial exposure of the perivasculonervous sheath. (D) Final exposure of the perivasculonervous sheath. (E) Opening of the perivasculonervous sheath. (F) Neurovascular dissection.
Assessment Tools
All procedures were time monitored, video recorded, and randomly submitted for a blind evaluation done by an expert in EES with the intention of minimizing expectation and experimenter bias as well as to evaluate the reliability of the model and its measurement tools. Two scoring methods were used for objective assessment of the surgical skills: a recognized global rating scale10 slightly simplified for the aim of this study (Fig. 3) and a newly developed specific-task checklist for EES (Fig. 4). Higher scores indicate improved performance.
Fig. 3.

Scoring of specific-task checklist for endoscopic endonasal surgery.
Fig. 4.

Simplified global rating scale of operative performance.
The scores for each specific activity were grouped in three different categories (endoscope positioning, surgical exposure, and microsurgical dissection) and graded to provide meaningful benchmarks and minimize systematic errors of evaluation. The expert determined, subjectively, how a specific activity was executed. The levels determined were “correct” when the task could be accomplished efficiently with no or very few errors; “satisfactory” when some errors occurred but the task could be accomplished without any major errors; and “incorrect” when several mistakes could be observed or the task was incompletely performed.
Lastly, a self-assessment questionnaire using a Likert scale was provided to all trainees to provide further validation of the training session (Fig. 5). The Kruskal-Wallis test was used for statistical analysis. A p value < 0.05 was considered significant.
Fig. 5.

Self-assessment questionnaire.
Results
Detailed results are depicted in Table 1 and Fig. 6. The mean scores of the global rating scale and the specific-task checklist for EES were 24.83 and 12.58 for group A, 22.83 and 12.08 for group B, and 31.42 and 14.58 for group C (p = 0.001 and 0.002, respectively) reflecting the positive impact of dynamic endoscopy and bimanual dissection on training performance. The mean time to complete the training session was 58.2 minutes for group A, 72 minutes for group B, and 45 minutes for group C (p = 0.092). The mean score of the self-assessment questionnaire was 27.7 (range: 24–30). All trainees subjectively agreed that the CWTM was a useful tool for surgical training, and they emphasized that working with a partner significantly increased their confidence and performance.
Table 1. Evaluation of training performance.
| Video no. | Specific performance (maximum score: 16) | General performance (maximum score: 35) | Time | Technique |
|---|---|---|---|---|
| V1 | 11 | 19 | 111 min, 53 s | A |
| V2 | 14 | 30 | 26 min, 27 s | A |
| V3 | 13 | 22 | 52 min, 04 s | A |
| V4 | 12 | 26 | 60 min, 24 s | C |
| V5 | 15 | 29 | 49 min, 43 s | B |
| V6 | 10 | 21 | 36 min, 40 s | B |
| V7 | 16 | 35 | 59 min, 48 s | C |
| V8 | 13 | 29 | 29 min, 44 s | B |
| V9 | 15 | 34 | 28 min, 20 s | C |
| V10 | 14 | 23 | 68 min, 51 s | C |
| V11 | 13 | 27 | 46 min, 40 s | B |
| V12 | 13 | 25 | 44 min, 47 s | C |
| V13 | 13 | 19 | 183 min,14 s | B |
| V14 | 16 | 35 | 43 min,10 s | A |
| V15 | 13 | 27 | 52 min, 04 s | A |
| V16 | 11 | 19 | 100 min, 41 s | B |
| V17 | 12 | 23 | 49 min, 55 s | A |
| V18 | 11 | 21 | 92 min, 30 s | B |
| V19 | 10 | 21 | 57 min, 01 s | B |
| V20 | 14 | 27 | 61 min, 01 s | A |
| V21 | 14 | 32 | 55 min, 07 s | C |
| V22 | 16 | 34 | 33 min, 27 s | C |
| V23 | 14 | 27 | 70 min, 29 s | B |
| V24 | 15 | 34 | 32 min, 14 s | C |
| V25 | 11 | 21 | 59 min, 47 s | A |
| V26 | 11 | 23 | 55 min, 02s | A |
| V27 | 12 | 20 | 45 min, 23 s | B |
| V28 | 16 | 35 | 45 min, 59 s | C |
| V29 | 13 | 26 | 61 min, 10 s | A |
| V30 | 12 | 22 | 92 min, 12 s | B |
| V31 | 13 | 31 | 42 min, 26 s | C |
| V32 | 12 | 25 | 37 min, 12 | A |
| V33 | 15 | 33 | 29 min, 13 s | C |
| V34 | 11 | 19 | 62 min, 40 s | B |
| V35 | 16 | 35 | 38 min, 49 s | C |
| V36 | 11 | 20 | 87 min, 42 s | A |
Fig. 6.

Graphical analysis of main data. Box and whisker plots illustrating scores of the global rating scale (left) and specific-task checklist for endoscopic endonasal surgery (center) for each group. The training performance was significantly better on group C compared with groups A and B; Right: box and whisker plot illustrating operative time, in hours, for each group. This difference was not statistically significant.
The analysis of each subcategory of the specific-task checklist for EES showed a mean score of 4.42, 4.25, and 5.67 for “endoscope guidance” (p = 0.0001); 5.25, 5.17, and 5.17 for “surgical exposure” (p = 0.930); and 2.92, 2.67, and 3.75 for “microsurgical dissection” (p = 0.002) with groups A, B, and C, respectively (Fig. 7).
Fig. 7.

Graphical analysis of specific-task checklist for endoscopic endonasal surgery. Box and whisker plots illustrating scores of endoscope positioning (left), surgical exposure (center), and microsurgical dissection (right) for each group. Endoscope positioning and microsurgical dissection performances were significantly better for group C compared with groups A and B.
Discussion
The goal of surgical training is the acquisition of knowledge, attitudes, and skills to decrease morbidity, improve outcomes, and promote efficiency. Attempts at improving surgical education began in Paris about ad 1210 at the Collège de Saint-Côme and were followed by a remarkable evolution in surgical education over the ensuing centuries. Most recently, many factors such as increased concerns for patient safety, limited resident working hours, financial pressure, development of new technologies, and early specialization have forced a paradigm shift in surgical training programs. Many different models have been proposed to optimize the effectiveness of training programs by promoting a faster and safer acquisition of surgical skills. However, the effectiveness depends on a variety of factors including characteristics of the learner, learning objectives, and features of the training system, for example, the peculiarities of the surgical technique being trained.11 12 13 14 15 16
Over the past 20 years, endoscopic endonasal approaches have been increasingly adopted as part of the armamentarium of the skull base surgeon with many different surgical techniques currently applied. The lack of a standard technique, however, may limit the development of educational programs to ensure its safety and efficacy.3 A comparison of different surgical techniques performed by different surgeons at different sites does not provide a truly valid and reliable assessment of surgical safety and efficacy.16 Therefore, to overcome these difficulties, we conducted this laboratory investigation with inexperienced surgeons to assess the impact of dynamic endoscopy and bimanual-binarial dissection on EES training.
Assessment of Surgical Techniques
Performance assessments may establish cut-off points and ensure standards to be used in surgical practice. However, the measurement of surgical performance is an extraordinarily complex task. Assessment tools need to be valid, reliable, and properly aligned to a suitable surgical training model. The combination of rating scales and self-assessment questionnaires has proven to be a useful tool in evaluating surgical skills and the feasibility of training models.11 12 13 14 15 16 Using this approach, along with the CWTM, we were able to simulate an adequate training environment for EES.
Global rating scales are useful in measuring the overall quality of a surgical procedure, but they are unable to specify a skill deficiency. In contrast, procedure-specific scales are designed to cover in detail all relevant aspects of an operation to identify at which part a deficiency may be present. Combining both types of rating scales helps identify the factors that may be responsible for an overall poor performance.16 As supported by our data, the use of dynamic endoscopy and bimanual-binarial dissection in an EES training model had a positive impact on trainee's performance.
Broadbent proposed the concept that an individual has a finite capacity for attention.17 Based on it, Galagher et al described a conceptual framework on learning modules where a master surgeon has significantly more attentional resources than a novice surgeon.14 Furthermore, Hsu et al demonstrated that distraction may significantly impair the surgical abilities of novice surgeons.18 They suggest that experienced surgeons had achieved a higher level of automatization to the point where a cognitive distractor (e.g., multiple tasks) was not able to affect their performance. Complex manual skills are actually acquired in three sequential steps: a cognitive stage, an associative stage, and an autonomous stage.
The same concepts may be applied to our study to understand the results. Trainees (novice surgeons) have less attentional resources and may be more easily distracted during a surgical procedure. During an endoscopic endonasal procedure, multitasking is constantly demanded. The surgeon must be able to guide the endoscope to provide an optimal view of the operative field and avoid interference with other surgical instruments as well as to perform dissection under endoscopic visualization (bidimensional image with loss of depth perception) through a relative narrow surgical corridor. Work in conjunction with an active partner may be an additional challenge because surgical maneuvers should be perfectly coordinated. In our study, when trainees were focused on only one activity, especially endoscope positioning or microsurgical dissection, their performance was significantly better. In fact, dynamic endoscopy, combined with bimanual dissection, is able to provide visual and haptic feedback to surgeons to increase their efficiency. The trainees were also able to complete all training tasks in a shorter period of time when using the same technique (p = 0.092). Therefore, our results suggest that adopting an educational program where basic techniques are emphasized, to decrease the complexity of the learned tasks, may shorten the long learning curve for EES by fostering a faster transition from the cognitive to the autonomous stage.
Study Limitations
To our knowledge, this study is the first to evaluate objectively the impact of different surgical techniques in EES training. Importantly, the trainees enrolled in this study were internally recruited, and, despite their lack of experience with EES, they might be more familiar with the surgical technique used at our institution (dynamic endoscopy and bimanual-binarial dissection), which may have contributed to a selection bias. The technique used in our institution may also have contributed to an evaluation bias, despite our efforts to perform a blind evaluation of the videos (group A could be potentially identified by the evaluator). In addition, the CWTM, despite its utility, is not able to recreate all the aspects of a real EES, and the development of more precise training models may be desirable. In our study, we used only human assessment methods for measuring procedure performance. The use of other objective parameters, such as dexterity metrics, may provide additional data and increase our knowledge of how to teach endoscopic endonasal techniques to novice surgeons.
This study does not apply to active experienced surgeons who may be facile with whatever technique they may have applied for an extensive period of time. The conclusions can only be applied to untrained surgeons and their learning curve.
Future Perspectives
Surgical education is an exciting and rapidly evolving field of medicine. The development of new surgical techniques, supported by tremendous technological innovation, has expanded the skills needed for surgery. Developing these skills in the setting of increased operational, financial, and technical restraints is a real challenge. Therefore, we should understand the theoretical framework behind the acquisition of surgical skills and identify the best training methods to maximize learning and skill transfer to the operative room.
We believe that a combination of apprenticeship-based training, proficiency-based curricula, valid assessment tools, training models, and new technologies (e.g., surgical simulators) is of foremost importance to improve training in EES. Training interventions should be rigorously investigated and validated by assessing their impact on surgical outcomes.
Conclusions
Endoscopic endonasal pituitary and cranial base surgery have been successfully performed using a variety of different surgical techniques. The lack of a standard technique, however, may be a relevant issue in teaching endoscopic endonasal techniques to novice surgeons. By using a laboratory-training model (CWTM), we conducted a blind evaluation of a comparative trial where three commonly used techniques were assessed by an expert in EES. We found that dynamic endoscopic and bimanual-binarial microdissection techniques had a significant positive impact on performance during EES training.
Acknowledgments
The authors wish to thank Wendy Fellows-Mayle, PhD, for her invaluable assistance during the dissections, and all trainees who were willing to perform the dissections.
Conflict of Interest The authors report no conflict of interest concerning the materials or methods used in this study or the findings specified in this article.
Note
Portions of this work were presented at the 24th Annual North American Skull Base Society Meeting in San Diego, California, on February 15, 2014.
References
- 1.Koc K Anik I Ozdamar D Cabuk B Keskin G Ceylan S The learning curve in endoscopic pituitary surgery and our experience Neurosurg Rev 2006294298–305.; discussion 305 [DOI] [PubMed] [Google Scholar]
- 2.Leach P, Abou-Zeid A H, Kearney T, Davis J, Trainer P J, Gnanalingham K K. Endoscopic transsphenoidal pituitary surgery: evidence of an operative learning curve. Neurosurgery. 2010;67(5):1205–1212. doi: 10.1227/NEU.0b013e3181ef25c5. [DOI] [PubMed] [Google Scholar]
- 3.Prevedello D M, Kassam A B, Snyderman C. et al. Endoscopic cranial base surgery: ready for prime time? Clin Neurosurg. 2007;54:48–57. [PubMed] [Google Scholar]
- 4.Snyderman C, Kassam A, Carrau R, Mintz A, Gardner P, Prevedello D M. Acquisition of surgical skills for endonasal skull base surgery: a training program. Laryngoscope. 2007;117(4):699–705. doi: 10.1097/MLG.0b013e318031c817. [DOI] [PubMed] [Google Scholar]
- 5.Kassam A, Snyderman C H, Mintz A, Gardner P, Carrau R L. Expanded endonasal approach: the rostrocaudal axis. Part I. Crista galli to the sella turcica. Neurosurg Focus. 2005;19(1):E3. [PubMed] [Google Scholar]
- 6.Kassam A, Snyderman C H, Mintz A, Gardner P, Carrau R L. Expanded endonasal approach: the rostrocaudal axis. Part II. Posterior clinoids to the foramen magnum. Neurosurg Focus. 2005;19(1):E4. [PubMed] [Google Scholar]
- 7.Kassam A B, Gardner P, Snyderman C, Mintz A, Carrau R. Expanded endonasal approach: fully endoscopic, completely transnasal approach to the middle third of the clivus, petrous bone, middle cranial fossa, and infratemporal fossa. Neurosurg Focus. 2005;19(1):E6. [PubMed] [Google Scholar]
- 8.Mamelak A N, Carmichael J, Bonert V H, Cooper O, Melmed S. Single-surgeon fully endoscopic endonasal transsphenoidal surgery: outcomes in three-hundred consecutive cases. Pituitary. 2013;16(3):393–401. doi: 10.1007/s11102-012-0437-1. [DOI] [PubMed] [Google Scholar]
- 9.Jusue-Torres I, Sivakanthan S, Pinheiro-Neto C D, Gardner P A, Snyderman C H, Fernandez-Miranda J C. Chicken wing training model for endoscopic microsurgery. J Neurol Surg B Skull Base. 2013;74(5):286–291. doi: 10.1055/s-0033-1348026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Martin J A, Regehr G, Reznick R. et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84(2):273–278. doi: 10.1046/j.1365-2168.1997.02502.x. [DOI] [PubMed] [Google Scholar]
- 11.Cannon-Bowers J A, Bowers C, Procci K. Optimizing learning in surgical simulations: guidelines from the science of learning and human performance. Surg Clin North Am. 2010;90(3):583–603. doi: 10.1016/j.suc.2010.02.006. [DOI] [PubMed] [Google Scholar]
- 12.Franzese C B Stringer S P The evolution of surgical training: perspectives on educational models from the past to the future Otolaryngol Clin North Am 20074061227–1235., vii [DOI] [PubMed] [Google Scholar]
- 13.Filho F V, Coelho G, Cavalheiro S, Lyra M, Zymberg S T. Quality assessment of a new surgical simulator for neuroendoscopic training. Neurosurg Focus. 2011;30(4):E17. doi: 10.3171/2011.2.FOCUS10321. [DOI] [PubMed] [Google Scholar]
- 14.Gallagher A G, Ritter E M, Champion H. et al. Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg. 2005;241(2):364–372. doi: 10.1097/01.sla.0000151982.85062.80. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Sanfey H, Dunnington G. Verification of proficiency: a prerequisite for clinical experience. Surg Clin North Am. 2010;90(3):559–567. doi: 10.1016/j.suc.2010.02.008. [DOI] [PubMed] [Google Scholar]
- 16.Sugden C, Aggarwal R. Assessment and feedback in the skills laboratory and operating room. Surg Clin North Am. 2010;90(3):519–533. doi: 10.1016/j.suc.2010.02.009. [DOI] [PubMed] [Google Scholar]
- 17.Broadbent D E. Selective and control processes. Cognition. 1981;10(1–3):53–58. doi: 10.1016/0010-0277(81)90024-x. [DOI] [PubMed] [Google Scholar]
- 18.Hsu K E, Man F Y, Gizicki R A, Feldman L S, Fried G M. Experienced surgeons can do more than one thing at a time: effect of distraction on performance of a simple laparoscopic and cognitive task by experienced and novice surgeons. Surg Endosc. 2008;22(1):196–201. doi: 10.1007/s00464-007-9452-0. [DOI] [PubMed] [Google Scholar]
