Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2014 Jun 12.
Published in final edited form as: Endoscopy. 2011 Mar 21;43(5):394–399. doi: 10.1055/s-0030-1256241

Image Registered Gastroscopic Ultrasound (IRGUS) in Human Subjects: A Pilot Study to Assess Feasibility

Keith L Obstein 1, Raúl San José Estépar 2, Jagadeesan Jayender 3, Vaibhav D Patil 3, Inbar S Spofford 4, Michele B Ryan 5, Balazs I Lengyel 2, Ramtin Shams 6, Kirby G Vosburgh 2,3, Christopher C Thompson 5
PMCID: PMC4054821  NIHMSID: NIHMS586635  PMID: 21425041

Abstract

Background and study aims

EUS is a complex procedure due to subtleties of ultrasound interpretation, the small field of observation, and the uncertainty of probe position and orientation. Animal studies demonstrated that Image Registered Gastroscopic Ultrasound (IRGUS) is feasible and may be superior to conventional EUS in efficiency and image interpretation. This study explores whether these attributes of IRGUS will be evident in human subjects with an aim of assessing the feasibility, effectiveness, and efficiency of IRGUS in patients with suspected pancreatic lesions.

Patients and methods

Prospective feasibility study at a tertiary care academic medical center in human patients withpancreatic lesions on CT scan who were scheduled to undergo conventional EUS were randomly chosen to undergo their procedure with IRGUS. Main outcome measures include feasibility, ease of use, systemfunction, validated task load (TLX) assessment instrument and IRGUS experience questionnaire.

Results

Five subjects underwent IRGUS without complication. Localization of pancreatic lesions was accomplished efficiently and accurately (TLX temporal demand 3.7%; TLX effort 8.6%). Image synchronization and registration was accomplished in real-time without procedure delay. Mean assessment score for endoscopist experience with IRGUS was positive (66.6±29.4). Real-time display of CT images in the EUS plane and echoendoscope orientation were the most beneficial characteristic.

Conclusions

IRGUS appears feasible and safe in human subjects, and efficient and accurate at identification of probe position and image interpretation. IRGUS has the potential to broaden adoption of EUS techniques and shorten EUS learning curves. Clinical studies comparing IRGUS to conventional EUS are ongoing.

Keywords: Endosonography, Pancreatic Neoplasms, Three-Dimensional Imaging, Image-Guided Surgery

Introduction

Image guidance technology has revolutionized diagnostic and therapeutic modalities by providing physicians with the means to navigate throughout the body guided by three-dimensional (3D) images [1, 2]. Image guidance has been shown to improve traditional surgical disease management in the abdomen through more accurate intra-operative definition of therapeutic targets and by reducing the aggressiveness of treatment [315].

Image data can be constructed, registered, and displayed to provide easily used and intuitive support in endoscopic procedures. Image guidance technology has been utilized in endoscopy in a porcine model through the Image Registered Gastroscopic Ultrasound (IRGUS) system that was found to be superior to conventional endoscopic ultrasound (EUS) in accuracy of endoscope position and in image interpretation [16]. Additionally, the IRGUS system demonstrated the potential to shorten the EUS learning curve and to broaden the adoption of EUS technique by gastroenterologists [16]. The current study aims to explore whether the attributes of the IRGUS system will be effective, efficient and feasible in human patients with pancreatic lesions scheduled to undergo EUS.

Patients/Materials and Methods

Patients scheduled for EUS with suspected pancreatic lesions on Computed Tomography (CT) scan were identified. From these patients, five who were scheduled to undergo conventional EUS were randomly chosen to undergo their procedure with the IRGUS system [Table 1]. The IRGUS system provides clinicians with a real-time display that shows endoscope position and ultrasound (US) plane orientation within the pre-procedure volumetric CT images. For these five patients, two synthetic images (a 3D model of the reference anatomy and a single oblique planar slice that matches the plane sampled by the US transducer) were created from the CT images utilizing advanced customized visualization software (3D Slicer, www.slicer.org).

Table 1.

Patient characteristics

Patient Age (years) Sex Race Indication for EUS
1 53 Female Caucasian 57 × 43 mm mixed density lesion in the head of the pancreas
2 68 Male Caucasian 39 × 32 mm ill defined hypodense mass within the head of the pancreas
3 86 Male Caucasian 31 × 14 mm predominately hypodense lesion in the tail of the pancreas extending anteriorly
4 40 Female Caucasian 29 mm low attenuation lesion with thick rim and lack of obvious enhancement in the tail of the pancreas
5 54 Male Caucasian 7 mm hypodense lesion projecting superiorly in the neck of the pancreas

The IRGUS system uses established techniques for the visualization of the probe position and image registration, but implements them in real-time by using recent advances in miniaturized position-tracking technology (microBIRD; Ascension Technology Corp, Milton, VT). The tracking sensors are small (1 mm diameter, 6 mm length) and have been tested to meet International Electrotechnical Commission (IEC) 60601-01 standards [Figure 1]. The mini-sensors were sterilized within 24 hours of the procedure according to the guidelines for surgical instruments and equipment at our center by using the STERRAD® sterilization system (Advanced Sterilization Products, Irvine, CA). All components (tracker system, interfaces, personal computer with displays) are commercially available, with a total cost, depending on the size of the display, of under $19,000 (USD).

Figure 1.

Figure 1

Tracking Sensor

Prior to the procedure, a standard patient stretcher was outfitted with an electromagnetic flat-plate transmitter [Figure 2]. The patient was then placed over the embedded transmitter and immediately prior to patient sedation in the endoscopy suite, one miniature sensor was attached to the distal tip of a standard linear echoendoscope (GF-UC-140P-AL5, Olympus, Tokyo, Japan) using a combination of Steri-Strips and Tegaderms (3M, St. Paul, MN) that was then inserted into an Aloka SSD-α10 ultrasound console (Aloka Inc., Tokyo, Japan) [Figure 3]. The echoendoscope with attached sensor was then calibrated using an additional non-attached sensor. The calibration defines the coordinates of the US plane with respect to the coordinate frame of the attached sensor. Calibration was performed by touching the distal point of the echoendoscope to the non-attached sensor. The 3D body model of the patient was then registered to the CT coordinate system by scanning the patient’s torso with the non-attached sensor to obtain a series of points. Those points are aligned to a 3D model of the patients skin extracted from the CT using the iterative closest point algorithm [17].

Figure 2.

Figure 2

Standard patient stretcher outfitted with the electromagnetic flat-plate transmitter. (A) The transmitter (white arrow) is positioned on the stretcher. (B) Padding is then used to cover the transmitter making it comfortable for patients to lie upon.

Figure 3.

Figure 3

Tracking sensor (arrow) attached to the distal tip of a standard linear echoendoscope

The Echoendoscope with the IRGUS system was then utilized for the endoscopic examination of the five patients by a single attending physician skilled in EUS and advanced endoscopic techniques. Following each procedure, a validated task load (TLX) assessment instrument (NASA Task Load Index v1.0, NASA Ames Research Center, Moffett Field, CA, USA) and an IRGUS experience questionnaire were completed. The TLX is a subjective workload assessment technique commonly used in human factors research to assess perceived workload based on a multidimensional construct of six subscales: mental demand (how much mental and perceptual activity was required?), physical demand (how much physical activity was required?), temporal demand (how hurried or rushed was the pace of the task?), performance (how successful were you in accomplishing what you were asked to do?), effort (how hard did you have to work to accomplish your level of performance?), and frustration level (how insecure, discouraged, irritated, stressed and annoyed were?) [1820]. The TLX has been used to assess workload in transportation (ground and aviation), endurance tasks, healthcare, teaching, and power plants [2027]. The TLX can be weighted or unweighted and each subscale ranges from 0 to 100. We chose to use the unweighted TLX subscale scores in this research study, as they have been more commonly used and there is high correlation between the weighted and unweighted scores [28, 29]. All cases were recorded in .avi format, deidentified, and stored on a secure, encrypted, workstation at the medical center for review and analysis.

This research study was approved by the center’s Institutional Review Board (IRB) and was funded through a grant from the National Cancer Institute under award R42 CA115112-03, the National Center for Image Guided Therapy under award U41 RR019703 and the Center for Integration of Medicine and Innovative Technology (CIMIT).

Results

The five human patients underwent their procedure with use of the IRGUS system safely and without complication. All procedures were performed in the endoscopy suite with intravenous sedation (Propofol administered by an Anesthesiologist (n=2) or Midazolam and Fentanyl administered by the endoscopyteam (n=3)). Endoscopic examination (including doppler evaluation) was carried out with complete exploration of the pancreas (head, body, and tail). Localization of the pancreatic lesion was accomplished efficiently and accurately [Table 2].

Table 2.

Unweighted Task Load Index subscale rating for IRGUS. All subscales range from 0 (“very low”) to 100 (“very high”); the exception is the subscale for performance where 0 is “perfect” and 100 is “failure.”

Subscale Unweighted Rating (Median [Range])
Mental Demand 65 [25, 90]
Physical Demand 45 [20, 75]
Temporal Demand 55 [25, 75]
Performance 30 [10, 80]
Effort 35 [20, 80]
Frustration 20 [15, 80]

Image synchronization and registration was accomplished by a short calibration process at the beginning of the procedure, prior to the insertion of the echoendoscope. Synchronization was accomplished in 3 to 4 seconds and registration was accomplished in 2 to 4 minutes. Retroperitoneal structures remained localized in position relative to stable structures such as the aorta. The precise registration of the 3D image and endoscope position was minimally distorted for structures in the right upper quadrant when thepatient was in the left -lateral decubitus position. The distortion or targeting error, defined as the distance between the line defined by the needle and the lesion center, was 12.23±0.45 mm for a lesion diameter of 21.38 mm. The accuracy of registration in the pancreas was affected by endoscope location, with improved registration in the stomach when compared to registration in the duodenum.

The mean assessment score for endoscopist experience with IRGUS was positive (66.6 ± 29.4) and IRGUS was favored as providing an advantage over conventional EUS (65 ± 26.5). Real-time display of CT images in the EUS plane and echoendoscope orientation were the most beneficial characteristics of IRGUS [Figure 4, Figure 5].

Figure 4.

Figure 4

The actual IRGUS system real-time display with US image (A), reformatted CT image in the US defined plane (B) and 3D CT based model of the patient (C) all on the same monitor for navigation and orientation. The US image plane (*) cuts directly through the pancreatic lesion (arrows). [k = left kidney, s = spleen, stm = stomach]

Figure 5.

Figure 5

The actual IRGUS system real-time display (alternate patient than that shown in figure 4). (A) The EUS probe tip, ultrasound plane (US plane), pancreatic lesion (PL), FNA needle (FNA), lungs (blue), aorta (red), and kidneys (brown) are clearly visualized. (B) The spleen (white arrows) can be seen on the CT image, 3D model, and ultrasound image in the same plane as the ultrasound. (C) The aorta is demonstrated in the image plane (white arrows). (D) The left kidney is clearly visualized in the image plane (white arrows). [R = right, S = superior]

Discussion

In the current study, IRGUS appears feasible and safe in human subjects. All patients tolerated the examination well with out procedural delay. The system did not encumber the endoscopist or the endoscopy suite staff. The system uses pre-existing equipment in the endoscopy suite (patient stretchers, echoendoscopes, mouth-guards) and was simple to assemble immediately prior to the procedure without difficulty. In short, the IRGUS system has the potential to be practical in the “real-life” high-volume endoscopy suite setting.

The IRGUS system was efficient and accurate at identification of probe position and image interpretation. This allowed the endoscopist to quickly visualize anatomic structures without losing echoendoscope image orientation (especially when the echoendosonigraphic image is degraded by calcifications, artifacts, or poor surface contact). This may promote shortened procedure times, therefore decreasing sedation requirements, and improving patient safety. Use of the IRGUS system may also lead to improvement in lesion targeting for echoendoscopic biopsy or fine needle aspiration with the potential to enhance tissue sampling for better diagnosis of disease.

While retroperitoneal structures remained localized in position, the precise registration of the 3D image and endoscope position were minimally distorted (12.23±0.45 mm for a lesion diameter of 21.38 mm)for structures in the right upper quadrant when the patient was in the left-lateral decubitus position. This distortion or target error is within the bounds that can make the guidance system clinically useful. A detailed validation study of targeting accuracy is currently underway. The precision of registration was also affected by endoscope endoluminal location, with improved registration in the stomach when compared to registration in the duodenum.

The 3D reconstruction (segmentation) process for the procedure is semi-automatic (a supervised combination of imaging techniques) and may be accomplished by an individual with basic computer literacy. Based on the system used for this research study, the time for segmentation ranges from 30 minutes to 1.5 hours, depending on the file size of the images. This time may be streamlined to approximately 15 minutes by increasing computer processor speed and system memory. The 3D reconstruction simplifies image interpretation (both CT images and US images) for the endoscopist and may promote shortened procedure times. Due to the intuitive nature in visualizing the 3D anatomy, no learning curve was demonstrated and no additional training in 3D anatomy is necessary to use the image guidance system.

A potential technical limitation was the registration error of the synthesized oblique CT image to the US image planes of approximately 5 mm. IRGUS capability does not depend on absolute image registration accuracy, therefore this minimal shift was found to be sufficient as most targets for orientation are considerably larger and slight misregistrations did not appear to hamper the use of the system. Since the systems 3D and CT images are based on a pre-procedure CT scan, they are static. Therefore, when a pancreatic cyst is drained, it resolves on the US image, however remains on the 3D reconstruction and CT images. While it would provide further information to have dynamic radiologic images, it would also expose the patient to additional unnecessary radiation and be more difficult for widespread system adoption. Not having the dynamic images may also prove to be an advantage, as the endosonographer is able to visualize the site of intervention as it looked before intervention. This may assist the endoscopist in maintaining orientation and allowing for a careful exam of the area that was known to have the finding of interest.

We also anticipated that the motion of organs induced by respiration and gravity would compromise the utility of the comparison of the preoperative CT image with the real-time US image. This was not the case as very little relative motion (~3 mm) between the CT oblique image and the US image was observed. When the patient was in the left-lateral decubitus position, gravity did cause minimal distortion between the CT image and the real time US image for structures that were in the left upper quadrant. However, all retroperitoneal structures and structures in the right side remained in position without distortion. Lastly, the current study was a feasibility study of five human subjects and a single endoscopist. Larger, randomized, clinical studies comparing IRGUS to conventional EUS with multiple operators are ongoing.

In summary, IRGUS appears feasible and may be superior to conventional EUS in accuracy of probe positioning and in image interpretation; however, these comparisons are limited in the current feasibility study. When considering these results, as well as the intuitive interface and the ease of implementation, it is anticipated that such systems could find utility in many diagnostic and therapeutic endoscopic procedures—including the potential for the development of new procedures with novel indications. These preliminary results also suggest that IRGUS technology may shorten the EUS learning curve and could broaden adoption of EUS techniques.

Acknowledgments

Grant Support: National Cancer Institute under award R42 CA115112-03, National Center for Image Guided Therapy under award U41 RR019703 and the Center for Integration of Medicine and Innovative Technology (CIMIT).

Reference List

  • 1.Peters T, Cleary K, editors. Image-Guided Interventions: Technology and Applications. 1. New York: Springer Science+Business Media, LLC; 2008. P1 -560. [Google Scholar]
  • 2.Vosburgh KG, Jolesz FA. The concept of image-guided therapy. Acad Radiol. 2003;10:176–9. doi: 10.1016/s1076-6332(03)80042-9. [DOI] [PubMed] [Google Scholar]
  • 3.Brugge WR. Fine needle aspiration of pancreatic masses: the clinical impact. Am J Gastroenterol. 2002;97:2701–2. doi: 10.1111/j.1572-0241.2002.07088.x. [DOI] [PubMed] [Google Scholar]
  • 4.Kane R. Intraoperative ultrasonography: history, current state of the art, and future directions. J Ultrasound Med. 2004;23:1407–20. doi: 10.7863/jum.2004.23.11.1407. [DOI] [PubMed] [Google Scholar]
  • 5.Rösch T, Lorenz R, Braig C, et al. Endoscopic ultrasound in pancreatic tumor diagnosis. Gastrointest Endosc. 1991;37:347–52. doi: 10.1016/s0016-5107(91)70729-3. [DOI] [PubMed] [Google Scholar]
  • 6.Di Stasi M, Lencioni R, Solmi L. Ultrasound-guided fine needle biopsy of pancreatic masses: results of a multicenter study. Am J Gastroenterol. 1998;93:1329–33. doi: 10.1111/j.1572-0241.1998.443_m.x. [DOI] [PubMed] [Google Scholar]
  • 7.Rattner DW, Fernandez-del Castillo C, Brugge WR, et al. Defining the criteria for local resection of ampullary neoplasms. Arch Surg. 1996;131:366–71. doi: 10.1001/archsurg.1996.01430160024003. [DOI] [PubMed] [Google Scholar]
  • 8.Ellsmere J, Stoll J, Wells W, 3rd, et al. A new visualization technique for laparoscopic ultrasonography. Surgery. 2004;136:84–92. doi: 10.1016/j.surg.2004.03.005. [DOI] [PubMed] [Google Scholar]
  • 9.Ambardar S, Arnell TD, Whelan RL, et al. A preliminary, prospective study of the usefulness of a magnetic endoscope locating device during colonoscopy. Surg Endosc. 2005;19:897–901. doi: 10.1007/s00464-004-8948-0. [DOI] [PubMed] [Google Scholar]
  • 10.Shah SG, Brooker JC, Thapar C, et al. Effect of magnetic endoscope imaging on patient tolerance and sedation requirements during colonoscopy: a randomized controlled trial. Gastrointest Endosc. 2002;55:832–7. doi: 10.1067/mge.2002.124097. [DOI] [PubMed] [Google Scholar]
  • 11.Shah SG, Saunders BP, Brooker JC, et al. Magnetic imaging of colonoscopy: an audit of looping, accuracy and ancillary maneuvers. Gastrointest Endosc. 2000;52:1–8. doi: 10.1067/mge.2000.107296. [DOI] [PubMed] [Google Scholar]
  • 12.Schwarz Y, Mehta AC, Ernst A, et al. Electromagnetic Navigation during Flexible Bronchoscopy. Respiration. 2003;70:516–22. doi: 10.1159/000074210. [DOI] [PubMed] [Google Scholar]
  • 13.Herth FJ, Ernst A, Eberhardt R, et al. Endobronchial ultrasound-guided transbronchial needle aspiration of lymph nodes in the radiologically normal mediastinum. Eur Respir J. 2006;28:910–4. doi: 10.1183/09031936.06.00124905. [DOI] [PubMed] [Google Scholar]
  • 14.Shen SH, Fennessy F, McDannold N, et al. Image-guided thermal therapy of uterine fibroids. Semin Ultrasound CT MR. 2009;30:91–104. doi: 10.1053/j.sult.2008.12.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Dimaio SP, Archip N, Hata N, et al. Image-guided neurosurgery at Brigham and Women’s Hospital. IEEE Eng Med Biol Mag. 2006;25:67–73. doi: 10.1109/memb.2006.1705749. [DOI] [PubMed] [Google Scholar]
  • 16.Vosburgh KG, Stylopoulos N, San Jose Estepar R, et al. EUS with CT improves efficiency and structure identification over conventional EUS. Gastrointest Endosc. 2007;65:866–70. doi: 10.1016/j.gie.2006.09.021. [DOI] [PubMed] [Google Scholar]
  • 17.Besl P, McKay N. A method for Registration of 3-D Shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 1992;14:239–56. [Google Scholar]
  • 18.Cao A, Chintamani KK, Pandya AK, Ellis RD. NASA TLX: Software for assessing subject mental workload. Behavior Research Methods. 109(41):113–117. doi: 10.3758/BRM.41.1.113. [DOI] [PubMed] [Google Scholar]
  • 19.Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In: Hancock PA, Meshkati N, editors. Human mental workload. Amsterdam: Elsevier; 1988. pp. 139–183. [Google Scholar]
  • 20.Saleem JJ, Patterson ES, Militello L, Anders S, et al. Impact of clinical reminder redesign on learnability, efficiency, usability, and workload for ambulatory clinic nurses. J Am Med Inform Assoc. 2007;14:632–640. doi: 10.1197/jamia.M2163. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Temple JG, Warm JS, Dember WN, Jones KS, et al. The effects of signal salience and caffeine on performance, workload, and stress in an abbreviated vigilance task. Hum Factors. 200;42:183–194. doi: 10.1518/001872000779656480. [DOI] [PubMed] [Google Scholar]
  • 22.Hakan A, Nilsson L. The effects of a mobile telephone task on driver behavior in a car following situation. Acc Anal Prev. 1995;27:707–715. doi: 10.1016/0001-4575(95)00026-v. [DOI] [PubMed] [Google Scholar]
  • 23.Averty P, Collet C, Dittmar A, Athenes S, et al. Mental workload in air traffic control: an index constructed from field tests. Aviat Space Environ Med. 2004;75:333–41. [PubMed] [Google Scholar]
  • 24.Park J, Jung W. A study on the validity of task complexity measure of emergency operating procedures of nuclear power plants—Comparing with a subjective workload. IEEE Trans Nucl Sci. 2006;53:2962–70. [Google Scholar]
  • 25.Oginska H, Fafrowicz M, Golonka K, Marek T, et al. Chronotype, sleep loss, and diurnal pattern of salivary cortisol in a simulated daylong driving. Chronobiology International. 2010;27:959–974. doi: 10.3109/07420528.2010.489412. [DOI] [PubMed] [Google Scholar]
  • 26.Carswell CM, Lio CH, Grant R, Klein MI, et al. Hands-free administration of subjective workload scales: Acceptability in a surgical training environment. Appl Ergon. 2010 Jul 12; doi: 10.1016/j.apergo.2010.06.003. Epub. [DOI] [PubMed] [Google Scholar]
  • 27.Levin S, France DJ, Hemphill R, Jones I, et al. Tracking workload in the emergency department. Hum Factors. 2006;48:526–39. doi: 10.1518/001872006778606903. [DOI] [PubMed] [Google Scholar]
  • 28.Byers JC, Bittner AC, Hill SG. Traditional and raw task load index (TLX) correlations: Are paired comparisons necessary? In: Mital A, editor. Advances in industrial ergonomics and safety. Vol. 1. London: Taylor & Francis; 1989. pp. 481–85. [Google Scholar]
  • 29.Moroney WF, Biers DW, Eggemeier FT, Mitchell JA. A comparison of two scoring procedures with the NASA Task Load Index in a simulated flight task. Proceedings of the IEEE. 1992;2:734–740. [Google Scholar]

RESOURCES