Skip to main content
International Journal of Biomedical Imaging logoLink to International Journal of Biomedical Imaging
editorial
. 2007 Jun 3;2007:45353. doi: 10.1155/2007/45353

Multimodal Imaging and Hybrid Scanners

Haim Azhari 1,*, Robert R Edelman 2, David Townsend 3
PMCID: PMC1986844  PMID: 18256733

There is an old tale of three blind men who were brought to the zoo for the first time and allowed to touch the elephant. On their way home, they shared this exciting experience. “An elephant is a long, flexible, and cylindrical creature,” said the man who had touched the elephant's trunk. “No! It is a thin and flat creature,” said the man who had touched the elephant's ear. “No, no! An elephant is rough and rigid like a tree stem,” disagreed the third person who had touched the elephant's leg. And the truth is that all three men were right!

When trying to see the invisible with our medical imaging systems, we are much like those three blind men. With each imaging modality, we shed some light on a different aspect of the general physiological picture. Although in some cases one modality may suffice to provide a definitive clinical answer, this is not the case in many other situations. Multimodal imaging (MMI) is needed for three basic reasons: (a) to acquire complementary information which may be needed to reach a definitive diagnostic conclusion, exclude certain pathologies, or obtain quantitative values (e.g., [1, 2]); (b) to create synergism by data fusion (i.e., to provide added information and new images which are more informative than the individual source images); (c) to plan therapeutic procedures and monitor treatment (e.g., [3, 4]).

An ideal MMI system or method should be capable of performing all three tasks mentioned above. Naturally, that requirement might be too demanding in terms of technological capabilities and operational considerations. Hence, diagnostic and therapeutic systems are commonly separated. However, one may see in the near future more system integration in the form of image-guided therapy.

There are several technical issues that are associated with MMI. A prerequisite is to obtain effective fusion and display of the data (e.g., [57]). Accurate spatial (and maybe also temporal) alignment is crucial for effective data fusion. There are basically two approaches for achieving coregistration. The first, which may be called the “hardware” approach, utilizes a hybrid design comprising two (or more) imaging modalities that are contained within a single device. The advantage of this approach is that the imaging modalities acquire data sequentially while the patient lies on the bed. The disadvantage is the need for dedicated MMI equipment which may be cumbersome or costly.

The second approach for achieving coregistration is the “software-” based approach. With this approach, image properties and tissue geometry and texture are used as clues for aligning the data sets. Alignment is thus achieved by manipulating the acquired data under certain optimization constraints or 3D model to achieve the best (most probable) match (e.g., [811]). Of course this approach is susceptible to noise and artifacts, but on the other hand it allows better versatility, and in many cases may be applied successfully to scans performed on different occasions and at different locations. Nevertheless, it is now widely recognized that the merger of information is more efficiently achieved by the hardware approach. The recent (2001) introduction of hybrid scanners has led to an expansion of this approach through the rapid adoption of the technology into the clinical arena.

One of the most promising examples of MMI hybrid systems that is currently demonstrating a significant clinical impact is the combination of CT with nuclear imaging, and specifically positron emission tomography (PET). Following the development of a prototype in the late 1990s [12], the first commercial combined PET/CT scanner was introduced in 2001 and since then, close to 2000 of such devices from different vendors have been installed in clinics worldwide. Both CT and PET technologies continue to advance and since 2006, new PET scanners are now only available in combination with CT. The MMI technology available clinically has demonstrated particular impact in staging malignant disease [13, 14] and in monitoring response of the disease to therapy. The recent incorporation of high-speed, multislice CT scanners with PET also opens up the potential for applying this technology to cardiac disease.

Another attractive modality for MMI is MRI. Although MRI imposes severe restrictions on the imaging environment, it offers a broad spectrum of scan types and image contrast. Compared with CT, MRI offers greater soft-tissue contrast, better capability for quantitation of function (e.g., measurement of blood flow or tissue metabolism), and potentially new types of molecularly targeted contrast agents. Efforts for combining MRI with other modalities (e.g., PET/MRI and ultrasound/MRI) are currently under development.

Another aspect of MMI is the development of multimodal contrast enhancing materials. Such materials can be used in the form of a “fit-all” type of marker (e.g., [15]). Thus, their signals can be used as control points for 3D alignment. Alternatively, they can be used as standard contrast agents used for disease detection and characterization (e.g., [16]).

In conclusion, considering the current tends in radiology, it can be expected that MMI devices will become increasingly available in the clinical arena. PET/CT has already made an important clinical contribution to patient care for oncology, while the new combined SPECT/CT designs are enhancing SPECT applications and improving physicians' confidence with image interpretation. No doubt, new combinations of hybrid devices will appear in the clinical arena and in many situations. As demonstrated by PET/CT in the oncology field, they will become the primary imaging option. A PET/MR design for simultaneous acquisition of PET and MR has recently acquired the first patient images, and a combined PET and ultrasound device is also under development for breast imaging. For many reasons, therefore, hybrid imaging devices are finding widespread acceptance within the clinical environment and some are already contributing to patient care and management. There is little doubt that this trend will continue in the future with an increasing reliance on MMI devices for medical imaging, thereby ensuring that all involved can be satisfied that they will eventually obtain a true and consistent picture of the elephant.

Haim Azhari Haim Azhari

Robert R. Edelman Robert R. Edelman

David Townsend David Townsend

References

  • 1.Kauczor H-U. Multimodal imaging and computer assisted diagnosis for functional tumour characterisation. Cancer Imaging. 2005;5(1):46–50. doi: 10.1102/1470-7330.2005.0013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Theodorou DJ, Malizos KN, Beris AE, Theodorou SJ, Soucacos PN. Multimodal imaging quantitation of the lesion size in osteonecrosis of the femoral head. Clinical Orthopaedics and Related Research. 2001;(386):54–63. doi: 10.1097/00003086-200105000-00007. [DOI] [PubMed] [Google Scholar]
  • 3.Sabbah P, Foehrenbach H, Dutertre G, et al. Multimodal anatomic, functional, and metabolic brain imaging for tumor resection. Clinical Imaging. 2002;26(1):6–12. doi: 10.1016/s0899-7071(01)00313-8. [DOI] [PubMed] [Google Scholar]
  • 4.Lopez R, Payoux P, Gantet P, Esquerré JP, Boutault F, Paoli JR. Multimodal image registration for localization of sentinel nodes in head and neck squamous cell carcinoma. Journal of Oral and Maxillofacial Surgery. 2004;62(12):1497–1504. doi: 10.1016/j.joms.2004.02.017. [DOI] [PubMed] [Google Scholar]
  • 5.Stokking R, Zubal IG, Viergever MA. Display of fused images: methods, interpretation, and diagnostic improvements. Seminars in Nuclear Medicine. 2003;33(3):219–227. doi: 10.1053/snuc.2003.127311. [DOI] [PubMed] [Google Scholar]
  • 6.Pietrzyk U, Herholz K, Schuster A, von Stockhausen H-M, Lucht H, Heiss W-D. Clinical applications of registration and fusion of multimodality brain images from PET, SPECT, CT, and MRI. European Journal of Radiology. 1996;21(3):174–182. doi: 10.1016/0720-048x(95)00713-z. [DOI] [PubMed] [Google Scholar]
  • 7.Rubello D, Casara D, Fiore D, Muzzio P, Zonzin G, Shapiro B. An ectopic mediastinal parathyroid adenoma accurately located by a single-day imaging protocol of Tc-99m pertechnetate-MIBI subtraction scintigraphy and MIBI-SPECT-computed tomographic image fusion. Clinical Nuclear Medicine. 2002;27(3):186–190. doi: 10.1097/00003072-200203000-00008. [DOI] [PubMed] [Google Scholar]
  • 8.Hellier P, Barillot C. A hierarchical parametric algorithm for deformable multimodal image registration. Computer Methods and Programs in Biomedicine. 2004;75(2):107–115. doi: 10.1016/j.cmpb.2004.01.002. [DOI] [PubMed] [Google Scholar]
  • 9.Bernon JL, Boudousq V, Rohmer JF, et al. A comparative study of Powell's and Downhill Simplex algorithms for a fast multimodal surface matching in brain imaging. Computerized Medical Imaging and Graphics. 2001;25(4):287–297. doi: 10.1016/s0895-6111(00)00073-2. [DOI] [PubMed] [Google Scholar]
  • 10.D'Agostino E, Maes F, Vandermeulen D, Suetens P. A viscous fluid model for multimodal non-rigid image registration using mutual information. Medical Image Analysis. 2003;7(4):565–575. doi: 10.1016/s1361-8415(03)00039-2. [DOI] [PubMed] [Google Scholar]
  • 11.Sarvazyan A. Model-based imaging. Ultrasound in Medicine and Biology. 2006;32(11):1713–1720. doi: 10.1016/j.ultrasmedbio.2006.05.016. [DOI] [PubMed] [Google Scholar]
  • 12.Beyer T, Townsend DW, Brun T, et al. A combined PET/CT scanner for clinical oncology. Journal of Nuclear Medicine. 2000;41(8):1369–1379. [PubMed] [Google Scholar]
  • 13.Bar-Shalom R, Yefremov N, Guralnik L, et al. Clinical performance of PET/CT in evaluation of cancer: additional value for diagnostic imaging and patient management. Journal of Nuclear Medicine. 2003;44(8):1200–1209. [PubMed] [Google Scholar]
  • 14.Keidar Z, Haim N, Guralnik L, et al. PET/CT using 18F-FDG in suspected lung cancer recurrence: diagnostic value and impact on patient management. Journal of Nuclear Medicine. 2004;45(10):1640–1646. [PubMed] [Google Scholar]
  • 15.Bolan P, Nelson M, Garwood M. A novel tissue marker for multimodal breast imaging. In: Radiological Society of North America (RSNA) 91st Scientific Assembly and Annual Meeting; November-December, 2005; Chicago, Ill, USA. p. 624. Abstract LPH01-03. [Google Scholar]
  • 16.McDonald MA, Watkin KL. Small particulate gadolinium oxide and gadolinium oxide albumin microspheres as multimodal contrast and therapeutic agents. Investigative Radiology. 2003;38(6):305–310. [PubMed] [Google Scholar]

Articles from International Journal of Biomedical Imaging are provided here courtesy of Wiley

RESOURCES