Abstract
Purpose
To evaluate the intra- and interobserver reproducibility of peripapillary retinal nerve fiber layer (RNFL) thickness measurements before and after pupil dilation using spectral-domain optical coherence tomography (SD-OCT).
Methods
In this observational case series, 44 eyes of 44 healthy subjects were scanned by two trained operators on the same day, using Cirrus SD-OCT (Carl Zeiss Meditec, Dublin, CA, USA). Three scans were obtained before and after pupil dilation by each operator. Mean ± standard deviation (SD) and coefficient of variation (CV) were used for description of results and variation of measurements respectively. Intraclass correlation coefficients (ICC) and Bland-Altman plots were used to evaluate validation and limits of agreement.
Results
Overall, 23 female and 21 male subjects with mean age of 36.9±8.8 (range, 20 to 50) years were enrolled. Mean RNFL thickness before pupil dilation was 92.6±7.2 (CV, 7.8%) and 92.4±6.8 (CV, 7.4%) µm by operator one and two, respectively. After pupil dilation, mean RNFL thickness was 92.7±7.9 (CV, 8.5%) and 92.0±7.5 (CV=8.2%) µm by observer one and two, respectively. ICCs ranged from 0.900 to 0.996. Mean absolute error of the two operators was less than 4.1µm. There were no significant differences in quadrant thicknesses before and after dilation. Interestingly, mean signal strength was not significantly affected by pupil dilation.
Conclusion
In normal subjects with clear media, peripapillary RNFL thickness measurements using Cirrus SD-OCT have high inter- and intraobserver reproducibility before and after pupil dilation. Pupil dilation may not be necessary in all subjects to obtain reproducible RNFL thickness measurements.
Keywords: Optical Coherence Tomography, Pupil Dilation, Retinal Nerve Fiber Layer, Reproducibility
INTRODUCTION
Optic nerve diseases, including glaucomatous optic neuropathy and neurological causes, need an objective, quantitative and sensitive method to assess retinal nerve fiber layer (RNFL) thickness both for early diagnosis and monitoring disease progression. The importance of RNFL thickness measurements for early glaucoma diagnosis cannot be overstated; theoretically RNFL thinning may be the earliest detectable structural change.
RNFL loss has been shown to precede functional loss in glaucoma by as much as five years.1 RNFL thickness maps can potentially be used for a thorough evaluation of the RNFL in longitudinal monitoring of optic nerve disease; this issue is of extreme importance in the clinical management of a life-long disease such as glaucoma.2-9 RNFL thickness measurement may also play a role in early detection of retinal toxicity of certain systemic medications.10
Optical coherence tomography (OCT), introduced in the mid-90s, is a valuable imaging technique for evaluation of the macula, optic nerve and RNFL. The latest commercially available generation of OCT devices, i.e. spectral-domain OCT (SD-OCT), is currently in clinical use.11 Carl Zeiss Meditec, Dublin, CA, USA introduced an SD-OCT system, Cirrus, that offers faster scanning and better axial resolution than its time-domain OCT (TD-OCT) predecessor, Stratus.12
Repeatability and reproducibility of RNFL thickness measurements using TD- and SD-OCTs have been previously demonstrated.13-15 Some studies have indicated that TD-OCT requires pupil dilation for acquisition of more reproducible RNFL thickness measurements.16-17 In practice, RNFL analyses by TD-OCT are usually performed after dilating the pupil. According to the Cirrus SD-OCT manufacturer, images can be obtained with the device without pupil dilation, but there are few independent studies in the literature investigating the effects of pupil dilation on measurements obtained with Cirrus.18-19
METHODS
This prospective cross-sectional study was performed on 44 healthy volunteers who accompanied patients at the ophthalmology clinics at Amiralmomenin Hospital, Rasht, Iran. Detailed consent forms were filled for each subject and the protocol was approved by the Ethics Committee of Guilan University of Medical Sciences.
Each subject underwent a complete ophthalmic examination including medical, ocular and family history; best corrected visual acuity (BCVA), slit lamp biomicroscopy, intraocular pressure (IOP) measurement using Goldmann applanation tonometry (Model AT 900, Haag-Streit, Bern, Switzerland) and dilated fundus examination.
Exclusion criteria were a history of ocular trauma or intraocular surgery, family history of glaucoma, contraindications to pupil dilation, history of intolerance to mydriatics, use of photosensitizing agents during the past two weeks, BCVA<20/20, presence of significant refractive errors (>6 diopters of spherical equivalent refraction or >3 diopters of astigmatism), IOP > 21 mmHg, any media opacification or abnormal slit lamp findings, occludable angle on gonioscopy, any vitreoretinal disorders, and abnormal optic disc appearance.
Before pupil dilation, two experienced operators measured peripapillary RNFL thickness of a randomly selected eye of each subject with Cirrus SD-OCT (software version 4.0, Model 400, Carl Zeiss Meditec, Inc. Dublin, CA, USA), respectively. The optic disc cube 200×200 was the scan acquisition protocol used for measuring peripapillary RNFL thickness and the procedure has previously been described by others.20 In this protocol a 3.4 mm diameter circular scan centered on the optic disc is obtained. Cirrus SD-OCT presents RNFL thickness on two circular charts, one with 12 equal sectors each representing one clock hour and the other with four equal 90-degree sectors, each representing one quadrant. The chart displays RNFL thickness in micrometers (µm) and average RNFL thickness is also displayed.
In order to evaluate reproducibility of the measurements, both operators performed the scan three times consecutively for each subject within a ten minute interval between operators. The procedure was performed in random order to prevent any possible effect from fatigue. On the same day, pupillary dilation was achieved using two drops of 1% tropicamide instilled during a 5-minute interval. Half an hour following pupil dilation the same procedure was carried out in all subjects. Images with artifacts, missing parts, seemingly distorted anatomy or signal strength <7 were excluded and/or retaken.
Statistical Analysis
Data was analysed using SPSS software (Version 16.0, SPSS Inc., Chicago, IL, USA). Mean ± standard deviation (SD) and coefficient of variation (CV) were used for description of results and variations of measurements respectively. Intraclass correlation coefficient (ICC) and Bland-Altman plots were used to evaluate validation and limits of agreement (LOA) between RNFL thickness measurements.
RESULTS
A total of 44 eyes of 44 volunteers including 23 female and 21 male subjects with mean age of 36.9±8.8 (range, 20 to 50) years were enrolled in the study.
Table 1 shows mean total and quadrantic RNFL thickness values obtained by each operator before and after pupil dilation, respectively. Mean difference ± SD and mean absolute error (MAE) between the two operators were 0.12±5.29 (95%CI, 0.20-0.44) µm and 3.89±3.58 (95% CI, 3.68-4.11) µm, respectively. There was a significant interobserver agreement (ICC=0.991, 95%CI, 0.990-0.992). Mean signal strength was not affected by pupil dilation (Table 2).
Table 1.
Mean values of three RNFL thickness measurements before and after pupil dilation*
Mean thickness ± SD (CV) | Mean thickness ± SD (CV) | |||
---|---|---|---|---|
Before pupil dilation (µm) | Before pupil dilation (µm) | |||
Operator 1 | Operator 2 | Operator 1 | Operator 2 | |
Average | 92.6±7.2 | 92.7±7.9 | 92.4±6.8 | 92.0±7.5 |
(7.8%) | (8.5%) | (7.4%) | (8.2%) | |
Temporal quadrant | 64.1±6.2 | 63.9±6.2 | 63.6±6.1 | 63.6±6.2 |
(9.7%) | (9.8%) | (9.6%) | (9.8%) | |
Superior quadrant | 115.6±9.2 | 116.2±9.5 | 114.9±9.5 | 114.8±9.3 |
(8.0%) | (8.2%) | (8.3%) | (8.1%) | |
Nasal quadrant | 69.3±6.8 | 69.9±6.7 | 69.5±6.5 | 69.4±6.7 |
(9.75%) | (9.5%) | (9.4%) | (9.7%) | |
Inferior quadrant | 121.4±10.8 | 120.9±10.7 | 121.4±11.0 | 120.1±11.1 |
(8.9%) | (8.8%) | (9.1%) | (9.2%) |
RNFL; retinal nerve fiber layer; SD, standard deviation; CV, coefficient of variation
None of the comparisons were statistically significant
Table 2.
Mean signal strengths (SS) obtained by the operators (before and after pupil dilation)*
Operator | Mean SS±SD | Mean SS±SD |
---|---|---|
(before pupil dilation) | (after pupil dilation) | |
1 | 0.91±0.08 | 0.92±0.09 |
2 | 0.90±0.10 | 0.90±0.09 |
None of the differences were statistically significant
According to Bland-Altman analysis, the 95% LOA for overall RNFL thickness measurements between the two operators was -9.56 to 9.80 μm with a bias of 0.12±5.29 μm. Figure 1 demonstrates Bland-Altman plots for interobserver agreement for RNFL thickness measurements in individual quadrants. The 95%LOA was -11.19 to 10.68 μm in the superior quadrant, -7.91 to 8.08 μm in the temporal quadrant, -9.28 to 8.77 μm in the inferior quadrant, and -9.85 to 11.66 μm in the nasal quadrant. The Bland-Altman plot for overall RNFL thickness measurements before and after pupil dilation showed 95%LOA ranging from -9.28 to 10.15 μm with a bias of 0.52±5.50 μm.
Figure 1.
Bland-Altman plots of quadrantic retinal nerve fiber layer (RNFL) thickness values by two operators: (A) superior, (B) temporal, (C) inferior, and (D) nasal quadrants.
Figure 2 shows Bland-Altman plots for average retinal thickness agreement in each quadrant, before and after pupil dilation. The 95%LOA was -9.66 to 11.80 μm in the superior quadrant, -8.11 to 8.94 μm in the temporal quadrant, -9.45 to 10.25 μm in the inferior quadrant, and -9.22 to 9.63 μm in the nasal quadrant.
Figure 2.
Bland-Altman plots of quadrantic retinal nerve fiber layer (RNFL) thickness values before and after pupil dilation: (A) superior, (B) temporal, (C) inferior, and (D) nasal quadrants.
DISCUSSION
In the current study we observed good intra- and interobserver reproducibility for peripapillary RNFL thickness measurements in each quadrant using Cirrus SD-OCT which is in agreement with other reports.14,20,21 In the current study, the highest reproducible quadrant was found to be the temporal one, although the differences were not statistically significant.
Good reproducibility is most likely due to the fact that Cirrus SD-OCT does not require manual scan centration on the optic disc as long as the peripapillary region is included in the optic disc cube. The scan registration process performed by the Cirrus algorithm is fully automated, reducing the likelihood of operator error. Conversely, TD-OCT requires the operator to choose the location of the circle, and previous studies have already shown that this procedure may affect the reproducibility of RNFL thickness measurements.20
OCT is typically performed following pupil dilation, since an image acquired through a narrow pupil may be truncated on the ends, or signal may be weak, leading to poor image quality. Hee et al stated that optical alignment is sensitive to pupil diameter and that there is reduction in the field of view.16 Smith et al demonstrated that reproducibility of RNFL measurements was not satisfactory in 23.7% of undilated eyes.17 However, other studies demonstrated that pupil dilation does not affect RNFL thickness measurements.22,23 All of the above-mentioned studies have been performed using TD-OCTs. There are few studies performed with SD-OCT. In a study in healthy subjects, Savini et al showed that pupil dilation did not affect RNFL thickness measurements obtained by Cirrus SD-OCT.18 In another study using Cirrus-SD-OCT, Massa et al revealed that RNFL measurements in healthy individuals and glaucoma patients were not influenced by pupil size.19 These two studies did not address interobserver reproducibility.
Our study showed that pupil dilation had no significant influence on peripapillary RNFL thickness measurements obtained by Cirrus SD-OCT. In comparison to the above mentioned reports, we studied both intra- and interobserver reproducibility and observed significant reproducibility with Cirrus OCT for RNFL measurements. Mean values and signal strength did not change before and after dilation.
Our study is limited by the use of healthy volunteers rather than glaucoma patients. The other drawback is the age of our subjects (ranging from 20 to 50 years) with a relatively larger pupil size, a condition which may not be present in older persons or glaucoma patients.22,23 Finally, it is not clear whether in the presence of media opacity the same results will be reproduced. Therefore, our results may not be generalizable to older subjects, especially those with glaucoma or cataract.
In summary, our study showed that in healthy subjects with clear media, peripapillary RNFL thickness measurements using Cirrus-SD-OCT have high inter- and intraobserver reproducibility before and after pupil dilation. Therefore, pupil dilation may not be necessary in all subjects to obtain reproducible RNFL thickness measurements.
Acknowledgments
This study was financially supported by a research grant from the Vice Chancellor for Research, Guilan University of Medical Sciences. The authors would also like to thank Ms Maryam Khoshbakht for kind writing assistance.
Footnotes
Conflicts of Interest
None.
REFERENCES
- 1.Sommer A, Katz J, Quigley HA, Miller NR, Robin AL, Richter RC, et al. Clinically detectable nerve fiber atrophy precedes the onset of glaucomatous field loss. Arch Ophthalmol. 1991;109:77–83. doi: 10.1001/archopht.1991.01080010079037. [DOI] [PubMed] [Google Scholar]
- 2.Schuman JS, Hee MR, Arya AV, Pedut-Kloizman T, Puliafito CA, Fujimoto JG, et al. Optical coherence tomography: a new tool for glaucoma diagnosis. Curr Opin Ophthalmol. 1995;6:89–95. doi: 10.1097/00055735-199504000-00014. [DOI] [PubMed] [Google Scholar]
- 3.Lee EJ, Kim TW, Park KH, Seong M, Kim H, Kim DM. Ability of Stratus OCT to detect progressive retinal nerve fiber layer atrophy in glaucoma. Invest Ophthalmol Vis Sci. 2009;50:662–668. doi: 10.1167/iovs.08-1682. [DOI] [PubMed] [Google Scholar]
- 4.Leung CK, Cheung CY, Weinreb RN, Qiu K, Liu S, Li H, et al. Evaluation of retinal nerve fiber layer progression in glaucoma: a study on optical coherence tomography guided progression analysis. Invest Ophthalmol Vis Sci. 2010;51:217–222. doi: 10.1167/iovs.09-3468. [DOI] [PubMed] [Google Scholar]
- 5.Savini G, Carbonelli M, Barboni P. Spectral-domain optical coherence tomography for the diagnosis and follow-up of glaucoma. Curr Opin Ophthalmol. 2011;22:115–123. doi: 10.1097/ICU.0b013e3283437222. [DOI] [PubMed] [Google Scholar]
- 6.Inzelberg R, Ramirez JA, Nisipeanu P, Ophir A. Retinal nerve fiber layer thinning in Parkinson disease. Vision Res. 2004;44:2793–2797. doi: 10.1016/j.visres.2004.06.009. [DOI] [PubMed] [Google Scholar]
- 7.Pueyo V, Ara JR, Almarcegui C, Martin J, Güerri N, García E, et al. Sub-clinical atrophy of the retinal nerve fiber layer in multiple sclerosis. Acta Ophthalmol. 2010;88:748–752. doi: 10.1111/j.1755-3768.2009.01527.x. [DOI] [PubMed] [Google Scholar]
- 8.Petzold A, de Boer JF, Schippling S, Vermersch P, Kardon R, Green A, et al. Optical coherence tomography in multiple sclerosis: a systematic review and meta-analysis. Lancet Neurol. 2010;9:921–932. doi: 10.1016/S1474-4422(10)70168-X. [DOI] [PubMed] [Google Scholar]
- 9.Moura FC, Monterio ML. Evaluation of retinal nerve fiber layer thickness measurements using optical coherence tomography in patients with tobacco-alcohol-induced toxic optic neuropathy. Indian J Ophthalmol. 2010;58:143–146. doi: 10.4103/0301-4738.60087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Lawthom C, Smith PE, Wild JM. Nasal retinal nerve fiber layer attenuation: a biomarker for vigabatrin toxicity. Ophthalmology. 2009;116:565–571. doi: 10.1016/j.ophtha.2008.09.047. [DOI] [PubMed] [Google Scholar]
- 11.Choma M, Sarunic M, Yang C, Izatt J. Sensitivity advantage of swept source and Fourier domain optical coherence tomography. Opt Express. 2003;11:2183–2189. doi: 10.1364/oe.11.002183. [DOI] [PubMed] [Google Scholar]
- 12.Cirrus HD-OCT. Details Define your Decisions. Dublin, CA: Carl Zeiss Meditec; CIR. 1595 DS-Nr. 0-1487-872. [Google Scholar]
- 13.Budenz DL, Fredette MJ, Feuer WJ, Anderson DR. Reproducibility of peripapillary retinal nerve fiber thickness measurements with Stratus OCT in glaucomatous eyes. Ophthalmology. 2008;115:661–666. doi: 10.1016/j.ophtha.2007.05.035. [DOI] [PubMed] [Google Scholar]
- 14.Carpineto P, Nubile M, Agnifili L, Toto L, Aharrh-Gnama A, Mastropasqua R, et al. Reproducibility and repeatability of Cirrus HD-OCT peripapillary retinal nerve fibre layer thickness measurements in young normal subjects. Ophthalmologica. 2012;227:139–145. doi: 10.1159/000334967. [DOI] [PubMed] [Google Scholar]
- 15.Jeoung JW, Park KH. Comparison of Cirrus OCT and Stratus OCT on the ability to detect localized retinal nerve fiber layer defects in preperimetric glaucoma. Invest Ophthalmol Vis Sci. 2010;51:938–945. doi: 10.1167/iovs.08-3335. [DOI] [PubMed] [Google Scholar]
- 16.Hee MR, Izatt JA, Swanson EA, Huang D, Schuman JS, Lin CP, et al. Optical coherence tomography of human retina. Arch Ophthalmol. 1995;113:325–332. doi: 10.1001/archopht.1995.01100030081025. [DOI] [PubMed] [Google Scholar]
- 17.Smith M, Frost A, Graham CM, Shaw S. Effect of pupillary dilatation on glaucoma assessments using optical coherence tomography. Br J Ophthalmol. 2007;91:1686–1690. doi: 10.1136/bjo.2006.113134. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Savini G, Carbonelli M, Parisi V, Barboni P. Effect of pupil dilation on retinal nerve fiber layer thickness measurements and their repeatability with Cirrus HD-OCT. Eye (Lond) 2010;24:1503–1508. doi: 10.1038/eye.2010.66. [DOI] [PubMed] [Google Scholar]
- 19.Massa GC, Vidotti VG, Cremasco F, Lupinacci AP, Costa VP. Influence of pupil dilation on retinal nerve fibre layer measurements with spectral domain OCT. Eye (Lond) 2010;24:1498–1502. doi: 10.1038/eye.2010.72. [DOI] [PubMed] [Google Scholar]
- 20.Knight OJ, Chang RT, Feuer WJ, Budenz DL. Comparison of retinal nerve fiber layer measurements using time domain and spectral domain optical coherent tomography. Ophthalmology. 2009;116:1271–1277. doi: 10.1016/j.ophtha.2008.12.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Garcia-Martin E, Pinilla I, Idoipe M, Fuertes I, Pueyo V. Intra and interoperator reproducibility of retinal nerve fiber and macular thickness measurements using Cirrus Fourier-domain OCT. Acta Ophthalmol. 2011;89:e23–29. doi: 10.1111/j.1755-3768.2010.02045.x. [DOI] [PubMed] [Google Scholar]
- 22.Zafar S, Gurses-Ozden R, Vessani R, Makornwattana M, Liebmann JM, Tello C, et al. Effect of pupillary dilation on retinal nerve fiber layer thickness measurements using optical coherence tomography. J Glaucoma. 2004;13:34–37. doi: 10.1097/00061198-200402000-00007. [DOI] [PubMed] [Google Scholar]
- 23.Savini G, Zanini M, Barboni P. Influence of pupilsize and cataract on retinal nerve fiber layerthickness measurements by Stratus OCT. J Glaucoma. 2006;15:336. doi: 10.1097/01.ijg.0000212244.64584.c2. [DOI] [PubMed] [Google Scholar]