Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2012 Jan 1.
Published in final edited form as: Med Image Comput Comput Assist Interv. 2011;14(Pt 3):537–545. doi: 10.1007/978-3-642-23626-6_66

Segmentation of Nerve Bundles and Ganglia in Spine MRI Using Particle Filters

Adrian Dalca 1, Giovanna Danagoulian 2, Ron Kikinis 2,3, Ehud Schmidt 2, Polina Golland 1
PMCID: PMC3232745  NIHMSID: NIHMS335110  PMID: 22003741

Abstract

Automatic segmentation of spinal nerve bundles that originate within the dural sac and exit the spinal canal is important for diagnosis and surgical planning. The variability in intensity, contrast, shape and direction of nerves seen in high resolution myelographic MR images makes segmentation a challenging task. In this paper, we present an automatic tracking method for nerve segmentation based on particle filters. We develop a novel approach to particle representation and dynamics, based on Bézier splines. Moreover, we introduce a robust image likelihood model that enables delineation of nerve bundles and ganglia from the surrounding anatomical structures. We demonstrate accurate and fast nerve tracking and compare it to expert manual segmentation.

Keywords: nerve bundles, tracking, segmentation, particle filter

1 Introduction

Mapping and localization of nerve pathways is essential for diagnosis of spinal pathologies, treatment planning, and image-guided interventions. Recent developments in high-resolution MRI have enabled visualization of the nerve bundles within the dura, as they pass through the foramen, and exit the vertebral canal [16]. The bundles exhibit good contrast with fluids and bone, but are often of similar intensity to that of marrow and muscle. Manual segmentation of nerves and ganglia is quite challenging and time-consuming. In this paper, we develop and demonstrate a method for automatic segmentation of these nerves and ganglia in high-resolution MRI that requires minimal input from an expert.

Nerve bundles and ganglia can be observed in high-resolution (0.3–0.6 mm voxels) MRI, as illustrated in Fig. 1. They start inside the spinal canal as dark grey bundles. The intensity contrast changes along the nerve; the neighboring tissues include cerebral spinal fluid, bone and other nerves. The bundles approximate cylinders, but change shape in the presence of a pathology such as disc herniation. As the bundles turn and exit through the foramen, they grow thicker, less regular and have lower contrast with their surroundings (e.g., fat, muscle or bone) as the nerve ganglia form. Automated nerve segmentation promises to significantly improve image-based diagnosis and therapy by providing fast tracing of the nerve bundles. In fact, the amount of time and effort currently required for manual tracing of the nerves precludes the practical construction of nerve maps, which could benefit surgery and minimally invasive interventions by reducing procedure duration and complications and improving outcomes of treatment of several degenerative conditions and spinal trauma.

Fig. 1.

Fig. 1

Three slices from an example herniated disk MRI. All arrows point to the same nerve bundle. Blue arrows show examples of poor contrast between the nerve and surrounding tissue; orange arrows indicate the thickening of the nerve into a ganglion.

Prior work in segmentation of tubular structures, such as blood vessels, is clearly relevant to this task. Region-growing approaches, such as classical region-growing [5], competitive region-growing [20] and wave propagation [6], have been used successfully for vessel segmentation. Unfortunately, these methods suffer from leakage, where segmentation “leaks” into nearby structures, in areas with lack of contrast [11]. Active contours that evolve an initial boundary to segment the tubular targets offer a model-based approach [13,14]. Variational and level-set formulations have been successfully used for vascular segmentation [7,13]. However, these methods need good initializations and suffer from many local minima [11]. Moreover, false positive rate (or severe leakage) is certain to limit the usefulness of such methods in our application.

An alternative approach is to first extract the centerline, and to fill out the segmentation as a subsequent step. The target is modeled as a tubular structure – most often via circular cross-sections of inscribed cylinders or spheres – with a centerline in 3D [1,9]. In practice, these methods require a fair amount of user interaction to often re-seed tubes or branches [11]. Correction and re-centering during centerline propagation are affected substantially by neighboring tissues of similar intensities. Some methods require two end-points and employ variants of minimal path extraction [4,10], which often suffer from shortcut paths [12]. The high degree of required user input and the high false-positive rate in low contrast structures make these approaches inappropriate for our specific task. A recent study has demonstrated the feasability of using DTI and fiber tracking of lumbar nerves [2] to estimate differences of diffusion parameters between healthy and herniated discs. Our method can be readily extended to include diffusion information by incorporating directional information in the likelihood function.

In this paper, we present a tracking approach based on particle filtering, also known as sequential Monte-Carlo tracking. Tracking has also been demonstrated previously for segmentation of tubular structures [8,11,15]. Most vessel tracking methods model the state as a cross-sectional ellipse [3,8] or as a cylindroid [19]. In tracking nerve bundles, the regions of low contrast require the state to capture substantially longer segments of the track than what is represented by a cross-section. In addition, nerves tend to change direction, often sharply, which necessitates a use of more complex descriptors than cylinders. Enabling multiple hypotheses, flexible dynamics and diverse likelihood models, particle filtering is an ideal approach for our task.

To address the challenges of nerve tracking, we define a rich particle representation that captures the geometric behaviour of the nerve bundles. We use a Bézier spline [18] centerline with a quadratic radius function to characterize a nerve bundle. We devise a dynamics model for particle updates that enforces continuity and smoothness. Furthermore, we define an image likelihood model that compares gradient fields and intensities of predicted patches with image observations to evaluate the posterior distribution of the particles’ importance. Once tracking is completed, we remove spurious segmentations by measuring the quality of the entire tract. We demonstrate successful segmentations of nerves and evaluate them relative to expert manual segmentations. To the best of our knowledge, this is the first automatic segmentation of nerve bundles and ganglia.

2 Methods

Particle Filters

We start by providing a brief review of particle filters [17]. We let ht be the particle, or state, representation at step t of the tracking algorithm, and assume the states respect a first order Markov chain, i.e.,

p(ht|h1:t1)=p(ht|ht1), (1)

where h1:t−1 denotes the state history for step t. We let zt be the image-based observation at step t, and further assume that given the state, the observations at different time points are independent:

p(z1:t|h1:t)=p(zt|ht)·p(z1:t1|h1:t1). (2)

A step of the tracking algorithm estimates the posterior distribution p(ht|z1:t), represented non-parametrically via a set of K weigthed samples {ht(k),wt(k)}k=1K. It can be readily shown that

p(ht|z1:t)p(zt|ht)·p(ht|z1:t1), (3)

i.e., the particle distribution depends on a likelihood function p(zt|ht) and a prior term p(ht|z1:t−1) [17].

A particle filter maintains the posterior distribution (3) by generating a set of samples {ht(k),wt(k)}k=1K at step t from the set {ht1(k),wt1(k)}k=1K generated at step t−1. Specifically, a sample 〈ht−1, wt−1〉 is drawn from the set {ht1(k),wt1(k)} according to the weights {wt1(k)}, and is propagated to become ht(k),wt(k). The state vector ht(k) is sampled from p(ht|ht−1), and its weight wt(k) is computed by rescaling wt−1 with likelihood p(zt|ht(k)). The weights are normalized at each step to sum to 1. It can be shown that the resulting sample set {ht(k),wt(k)}k=1K is an accurate representation of the state distribution p(ht|z1:t).

In the remainder of this section, we define our particle model ht for the nerve bundle, our dynamics model p(ht|ht−1), and our likelihood measure p(zt|ht). Together, these elements fully define the tracking algorithm.

Particle Representation for Nerve Tracks

We model each particle as a tubular structure around a centerline curve in 3D. We design the centerline as a Bézier curve and form the tubular structure by introducing a radius function, as illustrated in Fig. 2. A nth degree Bézier curve [18] is defined by n + 1 control points. The first and last control points define the endpoints of the curve. The interior control points can be thought of as “pulling” the curve towards them. We choose to work with cubic curves, i.e.,

c(τ)=(1τ)3p0+3(1τ)2τp1+3(1τ)τ2p2+τ3p3, (4)

where τ ∈ [0, 1] is the parameterization variable.

Fig. 2.

Fig. 2

Nerve segment (particle) is defined as a Bézier curve centerline with four control points and a radius function r(·)

We allow the radius function r(·) to vary quadratically along the segment, and also define it via a Bézier curve:

r(τ)=(1τ)2r0+2(1τ)τr1+τ2r2, (5)

for some control points r0, r1, and r2. In addition, we maintain the mean image intensity μ inside the segment. The state vector

h=(p0,p1,p2,p3,r0,r1,r2,μ) (6)

fully describes the corresponding segment. This construction can handle tubular structures with variable directionality, thickness and contrast, such as nerve bundles and ganglia.

Dynamics model

We now describe the construction of the state vector ht from the state vector ht−1 generated in a previous step of the algorithm. This step corresponds to sampling the probability p(ht|ht−1).

We set the first centerline control point of ht to the last control point of ht−1: p0,t = p3,t−1, which ensures continuity of the track. We place p1,t along the line (p2,t−1p3,t−1). This maintains smoothness during the transition from the previous to the current particle, since for Bézier curves, the tangent of a curve at an endpoint p0 is along the vector (p0, p1), and similarly the tangent at point p3 is along the vector (p2, p3). The distance ℓ between p0,t and p1,t is drawn uniformly from [0, L] where L is a parameter of the algorithm. Formally,

p1,t=p0,t+n^,

where is the unit vector in the direction of (p2,t−1, p3,t−1).

We draw the direction of (p1,t, p2,t) from a von Mises-Fisher distribution on the unit sphere, centered on the direction of the initial tangent (p0,t, p1,t) with concentration 1/σα2 (we call this new direction 01 + Δn̂12). We then sample the distance ℓ of p2,t from p1,t uniformly from [0, L]. Formally,

p2,t=p1,t+2(n^01+Δn^12).

Using the same procedure we generate p3,t based on p2,t and vector (p1,t, p2,t).

We set r0,t = r2,t−1 to maintain continuity of the radius function. We sample a distance d ∈ (0, 1), and we set r1,t to the y-coordinate of a control point which is d away from r0,t along the line (r1,t−1, r2,t−1). We choose r2,t from a Gaussian distribution with mean r1,t and variance σr2. The intensity parameter μt is propagated via a Gaussian distribution with variance σμ2.

This construction depends on four parameters: L controls the length of the particle, σα2 determines the variation in the particle curvature, σr2 describes the range of the radius, and σμ2 captures the intensity variation.

Likelihood Measure

Now we focus on the likelihood p(zt|ht). The contrast between the nerve bundle and surrounding tissue may change along the track, rendering ribbon measures [8,15] inappropriate. However, it still creates image gradients normal to the centerline. Therefore, to measure alignment of an observed image patch I with a hypothesis ht, we simulate an image patch with a white nerve segment described by the particle ht on a black background. We compare the directions of its gradients gh with those of the observed patch gI. We avoid using the gradient magnitude, since false hypotheses with partial but very strong contrasts are abundant. We express the distance d2 between the normalized particle gradient ĝh and the normalized observed gradient ĝI via their cross product:

d2(ht,I)=1|V(ht)|υV(ht)(ĝυh×ĝυI)2=1|V(ht)|υV(ht)sin2(ĝυh,ĝυI), (7)

where V (ht) is the set of voxels in the simulated patch that belong to the predicted nerve segment and υ is an image voxel.

To capture relatively constant nerve intensity, we include a term that measures the distance between the mean intensities in the observation and the particle prediction:

dμ2(ht,I)=[μt1|V(ht)|υV(ht)Iυ]2. (8)

We form the likelihood model by combining equations (7) and (8):

p(zt|ht)=1Zexp{(d2+λdμ2)}, (9)

where λ trades off between the two measures and Z is the partition function. In practice, Z does not need to be explicitly computed as the weights (likelihoods) of all samples are normalized at the end of each iteration.

Partial volume effects play a significant role in this computation. Most nerve bundle voxels also contain volume from surrounding anatomy. Modeling large segments of the nerve tracts, as opposed to cross-sections, improves the robustness of the method by increasing the number of voxels that contribute to the distance computations in (7) and (8).

Implementation Details

We initialize each nerve bundle with two nearby clicks that specify p2,0 and p3,0 for a single particle of weight w = 1 at time t = 0. We set parameters as follows: length L = 5, curvature σα = 0.4, radius σr = 1, intensity σμ = 2. The curvature variation only needs to be increased if sharp transitions are expected. In our experience, the length, radius and intensity parameters rarely need to be varied for similar contrast and resolution MR images. We also consider the intensity distance equally important to the gradient field, setting the tradeoff parameter λ in the likelihood model to 1.

We run the particle filter until all bundles reach the end of the volume. In each iteration, we sample 5, 000 particles and keep the ten top-weighed particles to form the sample set {ht(k),wt(k)}k=110. To identify the most appropriate of the surviving tracts, we simulate each tract V (h1:t) in the volume, and compute the likelihood (9) for the whole tract. We retain the top three tracts. Note that due to the multi-hypothesis nature of particle filters, branching nerves are naturally handled. Typical runtime ranges from 10 to 30 CPU-minutes per nerve.

3 Results

We demonstrate our method on MRI scans of the spine in ten nerve bundles from five subjects (3D Wide-band Steady State Free Precession, in-plane resolution of 0.44–0.6mm, slice thickness of 1.2–1.8mm, TR=6.4–6.9ms, TE=2.1–2.4ms, Θ=25, ±32 KHz bandwidth, FOV=14 cm) [16]. These include four nerves in two pathologies where the nerves have been displaced by disc herniations. Fig. 3 illustrates an example automatic segmentation. We obtain both expert and automatic segmentations of nerve bundles and ganglia that were deemed traceable, and evaluate tracing accuracy for all bundles. Fig. 3 shows cumulative distributions of the distances between segmentations in terms of centerlines and surfaces.

Fig. 3.

Fig. 3

Left: Example segmentation results – the rightmost nerve shows results without post-processing pruning, while the left segmentation was processed after completion of tracking. as described at the end of Section 2. Right: Cumulative distribution functions of distances (in voxels) between the automatically extracted and manual segmentations: centerline distances on top and surfaces on the bottom. Blue plots indicate differences from algorithm to expert segmentation voxels, red plots correspond to expert-to-algorithm distances. Error bars indicate standard deviations. Dotted vertical lines indicate mean (lower) and 90th percentiles distances (higher).

The mean distance between automatically extracted centerlines and their manual counterparts is within 1 voxel (0.2 ± 0.1 and 1.0 ± 0.3 for automatic-to-manual and manual-to-automatic, respectively); 90% of automatically extracted centerlines are within 0.9 ± 0.3 voxels of the expert centerline, and 90% of expert centerlines are within 2.2 ± 0.5 voxels of the algorithm centerline. Visually, we find very good centerline alignment (≤ 1 voxel) inside the vertebral canal. The greater disagreement is present in the ganglia, where the algorithm tends to under-segment and may be off-center, thereby shifting the centerline by a couple of voxels.

We find that since the edges of nerve bundles and ganglia are subject to the partial volume effects and are often near other anatomical structures, the algorithm slightly over-estimates the extent of the nerves in some regions of the image. As mentioned above, inside the thick ganglia the algorithm under-segments due to the ganglia’s more irregular shape. The mean distance from the automatically extracted surface to the expert surface is 1.1 ± 0.4 voxels and the 90th percentile is at 2.3 ± 0.6 voxels. Visual inspection reveals that the expert segmentation can be irregular and include small deformations or protrusions, especially in pathologies. Since the algorithm attempts to maintain the estimation within the ganglia, the correct outer surface voxels in areas of small irregularities will be more distant from the algorithm prediction. This occurs in cases where the nerve bundle is thicker, generally leading up to and including the ganglia, which can reach 15 voxels in diameter. This results in a mean distance between surfaces of 2.6 ± 0.8 voxels, with the 90th percentile within 5.9 ± 1.9 voxels. We therefore conclude that the proposed segmentation may slightly over-segment (usually by no more than two voxels) in thin areas and under-segment in thick areas, but will give a very good estimation of the nerve core and location.

We also evaluated the algorithm on the nerves following the ganglia, where they split up into several thinner peripheral nerves. Here, the algorithm often loses some nerves due to loss of contrast and the small radii of the nerves. When the algorithm continues to track, we observe a fully estimated path (the segmentation follows the nerve), but with over-segmentation as the filter is driven by stronger edges from the neighboring anatomical structures.

4 Conclusion

We demonstrate tracking of nerve bundles in high-resolution spine MRI. The tracking method is based on particle filtering and requires minimal input from the user. We model nerve segments via Bézier curves and describe a dynamics model for propagating the segments. A new distance measure that utilizes gradient fields and nerve intensities is used to score nerve segments and whole bundles. We demonstrate the method’s capacity to handle nerves and ganglia in presence of both high and low contrast. Precisely estimating edges from the current segmentation and segmentation of much thinner peripheral nerves of lower contrast remain challenging problems for future work.

Acknowledgements

This work was supported in part by NAMIC (NIH NIBIB NAMIC U54-EB005149), and the NSF CAREER grant 0642971.

References

  • 1.Aylward SR, Bullitt E. Initialization, noise, singularities, and scale in height ridge traversal for tubular object centerline extraction. IEEE Trans. Med. Imag. 2002;21(2):61–75. doi: 10.1109/42.993126. [DOI] [PubMed] [Google Scholar]
  • 2.Balbi V, Budzik JF, Duhamel A, Bera-Louville A, Le Thuc V, Cotten A. Tractography of lumbar nerve roots: initial results. Eur. Radiol. 2010;21:1153–1159. doi: 10.1007/s00330-010-2049-3. [DOI] [PubMed] [Google Scholar]
  • 3.Behrens T, Rohr K, Stiehl HS. Segmentation of tubular structures in 3d images using a combination of the hough transform and a kalman filter. In: Radig B, Florczyk S, editors. DAGM 2001. LNCS. vol. 2191. Heidelberg: Springer; 2001. pp. 406–413. [Google Scholar]
  • 4.Benmansour F, Cohen LD. A new interactive method for coronary arteries segmentation based on tubular anisotropy. ISBI 2009. 2009:41–44. [Google Scholar]
  • 5.Boskamp T, Rinck D, Link F, Kummerlen B, Stamm G, Mildenberger P. New Vessel Analysis Tool for Morphometric Quantification and Visualization of Vessels in CT and MR Imaging Data Sets. Radiographics. 2004;24(1):287–297. doi: 10.1148/rg.241035073. [DOI] [PubMed] [Google Scholar]
  • 6.Bruijns J. Fully-automatic branch labelling of voxel vessel structures. Vision Modeling and Vis. 2001. 2001:341–350. [Google Scholar]
  • 7.Delingette H, Montagnat J. Shape and topology constraints on parametric active contours. Computer Vision and Image Und. 2000;83:140–171. [Google Scholar]
  • 8.Florin C, Paragios N, Williams J. Particle filters, a quasi-monte carlo solution for segmentation of coronaries. In: Duncan JS, Gerig G, editors. MICCAI 2005. LNCS. vol. 3749. Heidelberg: Springer; 2005. pp. 246–253. [DOI] [PubMed] [Google Scholar]
  • 9.Fridman Y, Pizer SM, Aylward S, Bullitt E. Segmenting 3d branching tubular structures using cores. In: Ellis RE, Peters TM, editors. MICCAI 2003. LNCS. vol. 2879. Heidelberg: Springer; 2003. pp. 570–577. [Google Scholar]
  • 10.Gulsun M, Tek H. Robust vessel tree modeling. In: Metaxas D, Axel L, Fichtinger G, Székely G, editors. MICCAI 2008, Part I. LNCS. vol. 5241. Heidelberg: Springer; 2008. pp. 602–611. [DOI] [PubMed] [Google Scholar]
  • 11.Lesagea D, Angelini ED, Bloch I, Funka-Leaa G. A review of 3D vessel lumen segmentation techniques: Models, features and extraction schemes. Med. Image Anal. 2009;13(6):819–845. doi: 10.1016/j.media.2009.07.011. [DOI] [PubMed] [Google Scholar]
  • 12.Li H, Yezzi A. Vessels as 4-d curves: Global minimal 4-d paths to extract 3-d tubular surfaces and centerlines. IEEE Trans. Med. Imag. 2007;26(9):1213–1223. doi: 10.1109/tmi.2007.903696. [DOI] [PubMed] [Google Scholar]
  • 13.Lorigo LM, Faugeras OD, Grimson EL, Keriven R, Kikinis R, Nabavi A, Westin C-F. Curves: Curve evolution for vessel segmentation. Med. Image Anal. 2001;5(3):195–206. doi: 10.1016/s1361-8415(01)00040-8. [DOI] [PubMed] [Google Scholar]
  • 14.Mille J, Boné R, Cohen LD. Region-based 2d deformable generalized cylinder for narrow structures segmentation. In: Forsyth D, Torr P, Zisserman A, editors. ECCV 2008, Part II. LNCS. vol. 5303. Heidelberg: Springer; 2008. pp. 392–404. [Google Scholar]
  • 15.Schaap M, Manniesing R, Smal I, van Walsum T, van der Lugt A, Niessen W. Bayesian tracking of tubular structures and its application to carotid arteries in CTA. In: Ayache N, Ourselin S, Maeder A, editors. MICCAI 2007, Part II. LNCS. vol. 4792. Heidelberg: Springer; 2007. pp. 562–570. [DOI] [PubMed] [Google Scholar]
  • 16.Schmidt EJ, Shankaranarayanan A, Jaume S, Danagoulian G, Mukundan SJ, Nayak KS. Wide-band steady state free precession with small diffusion gradients for spine imaging: Application to superior nerve visualization. 18th ISMRM. 2010:448. [Google Scholar]
  • 17.Gordon NJ, Salmond DJ, Smith AFM. Novel approach to nonlinear / non-Gaussian Bayesian state estimation. IEE Proc-F. 1993;140(2):107–113. [Google Scholar]
  • 18.Bartels RH, Beatty JC, Barsky BA. Bézier Curves (Ch. 10): An Introduction to Splines for Use in Computer Graphics and Geometric Modelling. SF: Morgan Kauf; 1998. pp. 211–245. [Google Scholar]
  • 19.Tyrrell J, di Tomaso E, Fuja D, Tong R, Kozak K, Jain R, Roysam B. Robust 3-d modeling of vasculature imagery using superellipsoids. IEEE Trans. Med. Imag. 2007;26(2):223–237. doi: 10.1109/TMI.2006.889722. [DOI] [PubMed] [Google Scholar]
  • 20.Yi J, Ra JB. A locally adaptive region growing algorithm for vascular segmentation. Int. J. Imag. Syst. Tech. 2003;13(4):208–214. [Google Scholar]

RESOURCES