Abstract
Objective
The aim of this study was to present a method of classifying the maturational level of the zygomaticomaxillary sutures (ZMSs).
Methods
Cone-beam CT (CBCT) images from 74 subjects (5.6–58.4 years) were examined to define the radiographic stages of ZMS maturation. Five stages of maturation of the ZMS were identified and defined: Stage A—uniform high-density sutural line, with no or little interdigitation; Stage B—scalloped appearance of the high-density sutural line; Stage C—two parallel, scalloped, high-density lines, separated in some areas by small low-density spaces; Stage D—fusion in the inferior portion of the suture; and Stage E—complete fusion. Intra- and inter-examiner agreements were evaluated by weighted kappa tests.
Results
The intra- and inter-examiners reproducibility values demonstrated substantial to almost perfect agreement. No fusion of ZMSs was observed in patients up to 10 years of age. From 10 to 15 years, all maturational stages were identified. After 15 years of age, the majority of patients showed fusion of ZMSs.
Conclusions
The classification of ZMS maturation using CBCT is a reliable method that allows the assessment of the morphology of the ZMSs in the individual patient.
Keywords: cone-beam computed tomography, cranial sutures, growth and development
1 | INTRODUCTION
Growth modification of the maxilla depends on the level of maturation of the circummaxillary sutures.1–5 The maxilla articulates with other facial bones by way of the transverse palatine suture, frontomaxillary sutures and ZMSs (Figure 1). In the posterior region, the palatine bone interposes between the maxilla (transverse palatine suture) and the pterygoid process of sphenoid bone (pterygopalatine suture).1 Interestingly, histological examination of human autopsy material demonstrated similar maturational stages of the transverse palatine and pterygopalatine sutures during the infantile, juvenile and adolescent growth stages.1 These sutures show an increasing interdigitation and complexity from the infantile through the adolescent stages, with complete fusion of the sutures in the adult. Clinically, the complexity of the interdigitations of the circummaxillary sutures or even their fusion can hamper desired orthopedic changes, such as those produced by maxillary protraction in patients with Class III malocclusion.6–11
The clinical parameter for the best timing for maxillary protraction using the face mask protocol is chronological age. However, different chronological ages have been proposed, with some authors recommending treatment up to 8,12 9,13 and 106,14 years of age or before puberty.7 On the other hand, other studies did not identify any differences in response according to chronological age.2,15,16
Animal studies2,3,5 have demonstrated that the complexity of interdigitations is greater in the zygomaticomaxillary sutures than in other circummaxillary sutures. Kambara17 observed that the ZMSs presented similar histological findings, or even greater complexity of interdigitations, compared to other circummaxillary sutures in young (mixed dentition phase) and older (permanent dentition phase) monkeys. Studies that used finite-element analysis reported that the ZMSs showed a major resistance to orthopedic forces generated by rapid maxillary expansion (RME) and maxillary protraction.18,19 Furthermore, the ZMSs are the longest and thickest of these sutures, and they are oriented in the same direction as the force systems applied for maxillary protraction.4,5
One method of analysis of these sutures is by radiographic interpretation of cone-beam computed tomography (CBCT), a technique that provides 3D images of the oral and maxillofacial structures with relatively low cost, no image overlap, ease of accessibility and low radiation compared to multislice CT.20 Recently, Angelieri et al.21 described a method of classification of the midpalatal suture maturation on CBCT images that can be useful mainly for late adolescent and young adult patients in whom the efficacy of RME is unpredictable. This individual assessment of the maturation level of the circummaxillary sutures has the potential to provide a means of assessing the potential midfacial sutural response to maxillary protraction forces in Class III patients.
The aim of this study was to present a novel classification method for individual assessment of zygomaticomaxillary suture maturation as observed on CBCT images and to test the reliability of this new classification method.
2 | SUBJECTS AND METHODS
Baseline diagnostic CBCT images acquired for clinical purposes from 74 subjects (50 females and 24 males; Table 1), with ages ranging from 5.6 to 58.4 years and with no history of previous orthodontic treatment, systemic diseases or syndromes, were examined to determine the radiographic stages of ZMS. This study was approved by the Institutional Review Board from the University of Michigan.
TABLE 1.
Gender | 5−<10y | 10−<15y | >15 y | Total |
---|---|---|---|---|
Female | 17 | 15 | 18 | 50 |
Male | 03 | 14 | 07 | 24 |
Total | 20 | 29 | 25 | 74 |
CBCT scan images were obtained using an iCAT™ Cone Beam 3-D Imaging System (Imaging Science International, Hatfield, PA, USA). Each subject was seated in an upright position with the Frankfort plane parallel to the floor during the scanning process. For all scans, the field of view (FOV) used was 16×22-cm, and the scan time ranged from 20 to 40 seconds, with spatial resolution ranging from 0.25 to 0.30 mm.
2.1 | Image analysis procedures
The image analysis was performed using Invivo5™ software (Anatomage, San Jose, CA, USA). The tortuousness of the ZMS22 requires the definition of a careful protocol to interpret cross-sectional images through the long axis of the suture. The following procedures were required to determine the maturational stages of the ZMS:
-
1
Head orientation: Using the reorientation module, head position was reoriented to correct for roll, pitch and/or yaw during image acquisition (Figure 2).
-
2
In sagittal view, the horizontal cursor (orange line) was placed at the tip of the nose parallel to the palatal plane (Figure 3). In this inferior-superior cross section determined sagittally, the axial view then displayed a portion of the oblique ZMSs bilaterally. The anteroposterior cursor (purple line) then was positioned transversely through the ZMSs bilaterally. These procedures allowed visualization of the ZMSs also in the coronal view (Figure 4).
For analysis of the tortuous path of the ZMSs, in the coronal view, the vertical cursor (green line) first was positioned along the ZMS on the left side (Figure 5C). These orientation steps allowed visualization of the suture in all views (sagittal, axial and coronal; Figure 5A–C). In the sagittal views, the inferior portion of the ZMS was more lateral and often overlapped the view of the cortical bone (Figure 6). For this reason, interpretation of the maturational stage of the inferior portion of the left ZMS required rotating the patient’s head in a counterclockwise direction in the coronal view until the inferior portion of the ZMS was visualized appropriately in the sagittal view (Figure 7).
Radiographic interpretation required scrolling the sagittal cross sections to evaluate the medial and lateral path of the infraorbital portion of the ZMS. The same procedures were repeated for assessment of the ZMS on the right side and in the coronal view, so the patient’s head was rotated in a clockwise direction (Figure 8).
-
3
Radiographic interpretation was performed in the cross-sectional slice that best allowed visualization of the long axis of the ZMS in each side (right and left, Figures 4–8). The maturation stage of each ZMS was determined in the sagittal view at the infraorbital (superior) and infrazygomatic (inferior) portions of the suture.
-
4Definition of the maturational stages of the ZMS. The stage of fusion of the ZMS was defined, using the standardized CBCT cross-sectional images described above by the principal investigator, in a similar staging as the maturation of the midpalatal suture.21 The definition of each CBCT radiographic appearance of the sutural maturation stage followed the findings of previous histological2,4 and micro-CT studies23,24 on the morphological maturation of the ZMS. The following descriptive stages of ZMS maturation are proposed:
- Stage A
-
Stage BZMS can be seen as a thicker scalloped high-density line with some interdigitation. In a later phase, stage B also can be seen as a thicker scalloped high-density line in some areas, and in other areas as two thin, parallel, scalloped, high-density lines close to each other and separated by small low-density spaces (Figure 10).25,26 The parasutural bone density still is decreased.
- Stage C
-
Stage DFusion has occurred in a portion of the ZMS, usually in most inferior part of the suture, where the ZMS line cannot be visualized and the parasutural bone density is increased (high-density bone; Figure 12).
- Stage E
For patients who present wide maxillary sinus, the ZMSs can be located on the lateral walls of the maxillary sinus. in this case, although the ZMSs could appear fused, they are visible inferiorly and/or superiorly and laterally of the maxillary sinus (Figure 14). The ZMSs were analysed on right and left sides, and the more matured stage was considered.
All sagittal cross-sectional slices used for the assessment of the zygomaticomaxillary suture were selected and classified by the principal investigator (F.A.). These slices were arranged in a presentation (Microsoft Office PowerPoint 2007, Microsoft Corporation) with black background and codes that were displayed sequentially on a high-definition computer monitor. Each image was classified blindly by the principal investigator in a darkened room. No change in contrast or brightness of these images was undertaken. This evaluation was considered the ground truth.
2.2 | Reproducibility of the method
To test the reproducibility of the method, a second examiner (C.T.H.) was instructed by the principal observer on the procedure for the obtainment of the ZMS images and on the interpretation of the maturational stages of ZMSs. The second examiner evaluated 30 cases chosen randomly, in which the images were manipulated, the cross sections were selected and the ZMSs were classified, using the same software and classification. After a brief calibration (five cases), this second examiner analysed these cases by herself.
For the definition of the ZMS stages and their identification, three experienced orthodontists (L.F., L.H.S.C., T.N.) who had over 1 year of experience in interpreting CBCT scans for diagnostic purposes in specific research applications were involved in the assessment of the inter- and intra-observer reproducibility of the identification of the maturational stages of the ZMSs. The definition and figures (Figures 9–13) of the maturational stages of the ZMS were shown on a PowerPoint presentation with a black background. Examiner calibration was performed using six images, in which all orthodontists openly classified the maturation of ZMSs, and any questions regarding the different maturational stages were discussed.
To test the intra- and inter-examiner reproducibility of the identification of the maturational stages of ZMSs, 20 images were selected randomly to represent all the maturational stages of the ZMS. The three orthodontists classified all images blindly in the same room under dimmed light conditions, using the same high-definition monitor. A second viewing session for the reclassification of the maturation of the ZMS by the same three orthodontists was performed 15 days later in the same way after random rearrangement of the same images.
2.3 | Statistical analysis
A weighted kappa coefficient was calculated to evaluate intra-examiner and inter-examiner agreement, as well as the agreement between the examiners and the ground truth. The statistical software used was MedCalc (version 12.3.0; MedCalc Software, Mariakerke, Belgium). The agreement was defined according to the scale of Landis and Koch.27
3 | RESULTS
The method showed a very high inter-examiner reproducibility (weighted kappa coefficient 0.93 with a 95% confidence interval [CI] 0.83–1.00).
The weighted kappa values for both intra- and inter-examiner reproducibility of the identification of the maturational stages of ZMSs demonstrated substantial to almost perfect agreement with weighted kappa coefficients ranging from 0.774 (95% CI, 0.560–0.988) to 0.953 (95% CI, 0.864–1.00]) (Table 2). The reproducibility of the examiners with the ground truth showed almost perfect agreement with weighted kappa coefficients, ranging from 0.855 (95% CI, 0.697–1.000) to 0.903 (95% CI, 0.765–1.00) (Table 2).
TABLE 2.
Weighted kappa | 95% confidence interval | |
---|---|---|
Inter rater agreement | ||
OBS1 vs OBS2 | 0.825 | 0.626–1.000 |
OBS1 vs OBS3 | 0.864 | 0.716–1.000 |
OBS1 vs OBS4 | 0.774 | 0.560–0.988 |
OBS2 vs OBS3 | 0.953 | 0.864–1.000 |
OBS2 vs OBS4 | 0.953 | 0.864–1.000 |
OBS3 vs OBS4 | 0.903 | 0.775–1.000 |
Intra-rater agreement | ||
OBS1 | 0.742 | 0.589–0.896 |
OBS2 | 0.821 | 0.663–0.979 |
OBS3 | 0.903 | 0.765–1.000 |
OBS4 | 0.758 | 0.565–0.952 |
Observers (OBS) vs ground truth (GT) | ||
OBS1 vs GT | 0.774 | 0.630–0.918 |
OBS2 vs GT | 0.860 | 0.715–1.000 |
OBS3 vs GT | 0.903 | 0.765–1.000 |
OBS4 vs GT | 0.855 | 0.697–1.000 |
The distribution of the maturational stages of ZMS is shown in Table 3. Large variability in the distribution of the maturational stages of ZMS was noted mainly up to 15 years. Stages A, B and C were verified up to 15 years of age, except for one 15.9-year female. Great variability was verified in subjects from 10 to 15 years. No fusion of the ZMS was noted in subjects younger than 10 years old. On the other hand, fusion of ZMS (Stage E) was assessed mainly in subjects older than 15 years.
TABLE 3.
Stages | 5–<10y | 10–<15y | >15 y | Total | |||
---|---|---|---|---|---|---|---|
Female | Male | Female | Male | Female | Male | ||
A | 6 | 1 | 1 | 2 | 0 | 0 | 10 |
B | 7 | 0 | 7 | 5 | 0 | 0 | 19 |
C | 4 | 2 | 4 | 4 | 1 | 0 | 15 |
D | 0 | 0 | 2 | 2 | 4 | 0 | 8 |
E | 0 | 0 | 1 | 1 | 13 | 7 | 22 |
Total | 17 | 3 | 15 | 14 | 18 | 7 | 74 |
4 | DISCUSSION
This study described a new classification for the maturation of the ZMSs. Recently, Angelieri et al.21 described a classification of the midpalatal suture maturation on CBCT images. This assessment can be useful mainly for late adolescent and young adult patients to avoid the side effects of RME failure or unnecessary surgically assisted RME. Similarly, the classification for the ZMS maturation could be useful to predict individual responsiveness to maxillary protraction in Class III patients.
The results of the present study showed that the new classification for ZMS maturation is a reproducible method, as both inter- and intra-examiner values demonstrated substantial to almost perfect agreement. However, due to the oblique nature of the ZMSs, the image interpretation protocol used in this study describes the careful standardization of the multiplanar cross-sectional views along the ZMSs. Positioning and visualization of these cross sections may require training and calibration of examiners to avoid errors and inconsistency in choice of anatomic sections to be visualized.
CBCT images analysed in the current investigation were obtained retrospectively, with the spatial resolution ranging from 0.25 to 0.30 mm. According to Waltrick et al.,28 this variation does not compromise the quality of the images or validity of this study, as voxel sizes of 0.2, 0.3 mm or 0.4 mm did not influence significant statistically the error of the measurements.
Experimental studies2–5 on maxillary protraction have reported that maxillary protraction produced effects on many facial sutures, with sutural response mainly in the transverse palatine suture, zygomaticotemporal sutures and zygomaticomaxillary sutures. The sutural separation was more variable in the ZMSs that showed a greater sutural surface and more complex interdigitation with respect to the other facial sutures. While the transverse palatine suture also may be a possible area of resistance for maxillary protraction, the suture in that area is very thin and does not allow staging of maturation in the current resolution of CBCT radiographic assessments. Furthermore, Kambara17 demonstrated that the ZMSs presented similar histological findings (regarding the maturation), or even greater complexity of interdigitations, compared to other circummaxillary sutures in young (mixed dentition phase) and older (permanent dentition phase) monkeys. Thus, we assume that the other circummaxillary sutures probably will present the same or less matured maturational stages compared to the ZMSs.
Interestingly, the ZMS is well visualized on CBCT images due to its robust thickness, in contrast to the zygomaticotemporal and transverse palatine sutures. Its complexity of shape and tortuousness22 requires that two slices should be evaluated at the infraorbital (superior) and infrazygomatic (inferior) portions of the suture.
The radiographic examination of the ZMS revealed similar maturational stages compared to the maturation of the midpalatal suture.21 Despite the tortuous shape of the ZMS, low density of parasutural bone at less mature stages and the increase in interdigitation of suture as maturation progresses also were noted. The presence of the two lines as two thin, parallel, scalloped, high-density lines close to each other and separated by small low-density spaces (stage C) also preceded the fusion of the ZMS. These findings corroborate those of Cohen24 who demonstrated that facial sutures have similar maturation processes. Obviously, both ZMSs should be examined, because for some patients, two different stages were identified bilaterally. For those patients, the ZMS staging was considered as the more matured side.
As for the distribution of the developmental stages of the ZMS (Table 3), no fusion of ZMS was observed in subjects younger than 10 years, while fusion of ZMS (stages D and E) was assessed mainly in subjects older than 15 years. It is interesting to note that between 10 and 15 years, there is great variability of ZMS maturational stages in that all stages can be found during this age interval.
The individual assessment of the circummaxillary suture maturation may provide a means of assessing the midfacial sutural response to applied orthopedic forces in Class III patients. On the basis of the present results, we can speculate that at stages A and B, a conventional treatment approach for Class III malocclusion, like the RME and facial mask protocol, would encounter less resistant forces to maxillary protraction. At stages A and B, presumably, greater skeletal effects associated with maxillary protraction can be expected than at stage C, when there are initial ossification areas along the ZMSs.
In the presence of stages D and E that show partial or complete fusion, dentoalveolar effects have to be expected as the primary result of maxillary protraction. If maxillary advancement is required at these more mature stages, a surgical approach should be considered. Due to the great variability in ZMS maturational stages between 10 and 15 years, the evaluation ZMS maturational stages appears to be indicated mainly in juvenile and early adolescent Class III patients. However, future studies with the larger sample are indicated for the clinical meaning of the different ZMS stages before the clinical applications of this classification method.
5 | CONCLUSIONS
The classification of ZMS maturation using CBCT appears to be a reliable method that allows the assessment of the morphology of the ZMSs in the individual patient. This method could be useful to predict individual patient responsiveness to rapid maxillary expansion and maxillary protraction. Nevertheless, future studies are recommended evaluating the clinical meaning of the different ZMSs stages before the clinical application of this method.
References
- 1.Melsen B, Melsen F. The postnatal development of the palatomaxillary region studied on human autopsy material. Am J Orthod. 1982;82:329–342. doi: 10.1016/0002-9416(82)90467-5. [DOI] [PubMed] [Google Scholar]
- 2.Kambara T. Dentofacial changes produced by extraoral forward force in the Macaca irus. Am J Orthod. 1977;71:249–277. doi: 10.1016/0002-9416(77)90187-7. [DOI] [PubMed] [Google Scholar]
- 3.Jackson G, Kokich V, Shapiro P. Experimental and post-experimental response to anteriorly directed extraoral force in young Macaca nemestrina. Am J Orthod. 1979;75:318–333. doi: 10.1016/0002-9416(79)90278-1. [DOI] [PubMed] [Google Scholar]
- 4.Nanda R, Hickory W. Zygomaticomaxillary suture adaptations incident to anteriorly-directed forces in rhesus monkeys. Angle Orthod. 1984;54:199–210. doi: 10.1043/0003-3219(1984)054<0199:ZSAITA>2.0.CO;2. [DOI] [PubMed] [Google Scholar]
- 5.Zhao N, Xu Y, Chen Y, Xu Y, Han X, Wang L. Effects of class III magnetic orthopedic forces on the craniofacial sutures of rhesus monkeys. Am J Orthod Dentofacial Orthop. 2008;133:401–409. doi: 10.1016/j.ajodo.2006.04.035. [DOI] [PubMed] [Google Scholar]
- 6.Kapust AJ, Sinclair PM, Turley PK. Cephalometric effects of facemask/expansion therapy in class III children: a comparison of three age groups. Am J Orthod Dentofacial Orthop. 1998;113:204–212. doi: 10.1016/s0889-5406(98)70141-6. [DOI] [PubMed] [Google Scholar]
- 7.Franchi L, Baccetti T, McNamara JA., Jr Postpubertal assessment of treatment timing for maxillary expansion and protraction therapy followed by fixed appliances. Am J Orthod Dentofacial Orthop. 2004;126:555–568. doi: 10.1016/j.ajodo.2003.10.036. [DOI] [PubMed] [Google Scholar]
- 8.Baccetti T, Franchi L, McNamara JA., Jr Treatment and posttreatment craniofacial changes after rapid maxillary expansion and facemask therapy. Am J Orthod Dentofacial Orthop. 2000;118:404–413. doi: 10.1067/mod.2000.109840. [DOI] [PubMed] [Google Scholar]
- 9.Cordasco G, Matarese G, Rustico L, et al. Efficacy of orthopedic treatment with protraction facemask on skeletal class III malocclusion: a systematic review and meta-analysis. Orthod Craniofac Res. 2014;17:133–143. doi: 10.1111/ocr.12040. [DOI] [PubMed] [Google Scholar]
- 10.Macdonald KE, Kapust AJ, Turley PK. Cephalometric changes after the correction of class III malocclusion with maxillary expansion/facemask therapy. Am J Orthod Dentofacial Orthop. 1999;116:13–24. doi: 10.1016/S0889-5406(99)70298-2. [DOI] [PubMed] [Google Scholar]
- 11.Ngan P, Yiu C, Hu A, Hägg U, Wei SH, Gunel E. Cephalometric and occlusal changes following maxillary expansion and protraction. Eur J Orthod. 1998;20:237–254. doi: 10.1093/ejo/20.3.237. [DOI] [PubMed] [Google Scholar]
- 12.Hickham JH. Maxillary protraction therapy: diagnosis and treatment. J Clin Orthod. 1991;25:102–113. [PubMed] [Google Scholar]
- 13.Proffit WR, editor. Contemporary Orthodontics. St Louis: CV Mosby; 1992. [Google Scholar]
- 14.Wells AP, Sarver DM, Proffit WR. Long-term efficacy of reverse pull headgear therapy. Angle Orthod. 2006;76:915–922. doi: 10.2319/091605-328. [DOI] [PubMed] [Google Scholar]
- 15.Yüksel S, Uçem TT, Keykubat A. Early and late facemask therapy. Eur J Orthod. 2001;23:559–568. doi: 10.1093/ejo/23.5.559. [DOI] [PubMed] [Google Scholar]
- 16.Yavuz I, Halicioğlu K, Ceylan I. Face mask therapy effects in two skeletal maturation groups of female subjects with skeletal class III malocclusions. Angle Orthod. 2009;79:842–848. doi: 10.2319/090308-462.1. [DOI] [PubMed] [Google Scholar]
- 17.Kambara T. Dentofacial changes produced by extraoral forward force in the Macaca irus. Am J Orthod. 1977;71:249–277. doi: 10.1016/0002-9416(77)90187-7. [DOI] [PubMed] [Google Scholar]
- 18.Yu HS, Baik HS, Sung SJ, Kim KD, Cho YS. Three-dimensional finite-element analysis of maxillary protraction with and without rapid palatal expansion. Eur J Orthod. 2007;29:118–125. doi: 10.1093/ejo/cjl057. [DOI] [PubMed] [Google Scholar]
- 19.Tanne K, Sakuda M. Biomechanical and clinical changes of the craniofacial complex from orthopedic maxillary protraction. Angle Orthod. 1991;61:145–152. doi: 10.1043/0003-3219(1991)061<0145:BACCOT>2.0.CO;2. [DOI] [PubMed] [Google Scholar]
- 20.De Vos W, Casselman J, Swennen GR. Cone-beam computerized tomography (CBCT) imaging of the oral and maxillofacial region: a systematic review of the literature. Int J Oral Maxillofac Surg. 2009;38:609–625. doi: 10.1016/j.ijom.2009.02.028. [DOI] [PubMed] [Google Scholar]
- 21.Angelieri F, Cevidanes LHS, Franchi L, Gonçalves JR, Benavides E, McNamara JA., Jr Midpalatal suture maturation: classification method for individual assessment prior to rapid maxillary expansion. Am J Orthod Dentofacial Orthop. 2013;144:759–769. doi: 10.1016/j.ajodo.2013.04.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Sholts SB, Wärmländer SKTS. Zygomaticomaxillary suture shape analyzed with digital morphometrics: reassessing patterns of variation in American Indian and European populations. Forensic Sci Int. 2012;217:234e.1–234e.6. doi: 10.1016/j.forsciint.2011.11.016. [DOI] [PubMed] [Google Scholar]
- 23.Sun Z, Lee E, Herring SW. Cranial sutures and bones: growth and fusion in relation to masticatory strain. Anat Rec A Discov Mol Cell Evol Biol. 2004;276:1–22. doi: 10.1002/ar.a.20002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Cohen MM., Jr Sutural biology and the correlates of craniosynostosis. Am J Med Gen. 1993;47:581–616. doi: 10.1002/ajmg.1320470507. [DOI] [PubMed] [Google Scholar]
- 25.Hahn W, Fricke-Zech S, Fialka-Fricke J, et al. Imaging of the midpalatal suture in a porcine model: flat-panel volume computed tomography compared with multislice computed tomography. Oral Surg Oral Med Oral Pathol Oral Radiol Endod. 2009;108:443–449. doi: 10.1016/j.tripleo.2009.02.034. [DOI] [PubMed] [Google Scholar]
- 26.Korbmacher H, Schilling A, Püschel K, Amling M, Kahl-Nieke B. Age-dependent three-dimensional micro-computed tomography analysis of the human midpalatal suture. J Orofacial Orthop. 2007;68:364–376. doi: 10.1007/s00056-007-0729-7. [DOI] [PubMed] [Google Scholar]
- 27.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. [PubMed] [Google Scholar]
- 28.Waltrick KB, Nunes de Abreu Junior MJ, Corrêa M, Zastrow MD, Dutra VD. Accuracy of linear measurements and visibility of the mandibular canal of cone-beam computed tomography images with different voxel sizes: an in vitro study. J Periodontol. 2013;84:68–77. doi: 10.1902/jop.2012.110524. [DOI] [PubMed] [Google Scholar]