Table 9. Reliability of methods for 3D imaging in cleft lip and palate patients in studies with good methodological quality.
| first author | Year | Topic | raters | subjects/objects included in error analysis | duplicate measurements | reliability corr coeff | systematic error determined | Randomerror | weighted kappa |
| CT | |||||||||
| Ras | 1997 | maxilla, position(mm) | 2 | 17 | 2 | y | |||
| van der Meij | 2001 | bone graft quantity, surface (mm2) | 1 | 1 | 10 | 1.95%* | |||
| Kawakami | 2003 | bone graft density (grading scale) | 1 | 19 | 2 | 0.99 | y | ||
| van der Meij | 2003 | bone graft, surface (mm2) | – | – | – | ||||
| Kita | 2004 | bone graft, need (grading scale) | 2 | 24 | 0 | ||||
| Schliephake | 2006 | maxillary arch width (mm) | – | – | – | ||||
| Kim | 2008 | bone graft, volume(mm3) | 1 | 15 | 2 | y | |||
| 2 | 15 | 2 | y | ||||||
| Suri | 2008 | midface (mm) | 1 | 3 | 3 | y | |||
| Alonso | 2010 | bone graft, bone fill (%) | 1 | 16 | 2 | y | |||
| Saijo | 2010 | pal suture, ossification (mm) | – | – | – | ||||
| Lee | 2011 | pterygomaxillary region (mm) | – | 10 | 2 | y | 0.4 | ||
| Li | 2011 | maxilla (mm) | 1 | – | 2 | y | |||
| Tulunoglu | 2011 | cephalometry 3D (mm, degrees) | 1 | 15 | 2 | 0.88–0.99 | |||
| Choi | 2012 | pal suture, ossification (mm) | – | – | – | ||||
| Seike | 2012 | bone graft, size (mm), bone graft, density (mg Calcium) | – | – | – | ||||
| Ye | 2012 | maxillary arch width (mm) | 1 | 30 | 3 | 0.84 | |||
| CBCT | |||||||||
| Dickinson | 2008 | bone graft (grading system) | 3 | – | - | 1.9%* | |||
| Nagasao | 2008 | nasal septum (mm) | – | – | – | ||||
| Oberoi | 2009 | bone graft, bone fill (%) | 1 | 5 | 2 | >0.9 | |||
| 2 | 5 | 2 | >0.9 | ||||||
| Oberoi | 2010 | Canine, eruption (mm) | 2 | 10 | 2 | 0.3–1.03 | |||
| Shirota | 2010 | bone graft, volume(cm3) | 1 | 13 | 3 | ||||
| Li, F | 2011 | Maxilla, position (mm) | 1 | 20 | 2 | 0.98 | |||
| Veli | 2011 | Mandible (mm, mm3) | – | 15 | 2 | y | |||
| Leenarts | 2012 | dental arch relationship (1–5 Goslon grading scale) | 4 | 26 | 2 | 0.83–0.97 | y | 0.18–0.45 | 0.72–0.93 |
| Li | 2012 | Nose, angles (degrees) | 2 | 16 | 2 | 0.98–0.99 | |||
| 1 | 16 | 2 | 0.94–0.99 | ||||||
| Trindade–Suedam | 2012 | bone graft, presence of bone (grading scale) | 3 | –– | 2 | y | |||
| Zhou | 2013 | Teeth movement (mm) | 1 | 20 | 2 | 2%* | |||
| MRI | |||||||||
| Tian | 2010 | velopharyngeal space(mm) | 1 | 2 | 2 | 0.92–0.99 | |||
| 2 | 2 | 2 | 0.89–0.98 | ||||||
| Tian | 2010 | velopharyngeal motion (mm, ratios) | 1 | 6 | 2 | 0.92–0.99 | |||
| 2 | 6 | 2 | 0.89–0.98 | ||||||
| Stereophotogrammetry | |||||||||
| Ras | 1994 | face, asymmetry (mm) | 1 | 10 | 4 | y | |||
| Al–Omari | 2003 | face, deformity scoring (rating scale) | 10 | 31 | 2 | 0.42–0.72 | |||
| Devlin | 2007 | nose, symmetry (mm) | 1 | 1 | 10 | 0.46 | |||
| Bugaighis | 2010 | face, shape (mm) | – | – | – | 0.5 | |||
| Hoefert | 2010 | face, controls (mm) | 1 | 7 | 10 | ||||
| CLP (mm) | 1 | 22 | 10 | ||||||
| Hoefert | 2010 | face (mm) | 1 | 29 | 10 | 0.31–0.55 | |||
| Tanikawa | 2010 | lips (mm) | 1 | 10 | 2 | ||||
| van Loon | 2010 | Nose, volume (mm3) | 1 | 12 | 2 | 0.97–1.00 | y | 55.68–129.86 | |
| 2 | 12 | 2 | 0.96–1.00 | y | 56.32–147.40 | ||||
| Clark | 2011 | lips (mm) | – | – | – | ||||
| Kau | 2011 | maxilla/lip (mm) | – | – | – | ||||
| Sander | 2011 | Nose (mm) | 1 | 9 | 3 | 0.99 | |||
| Zreaqat | 2012 | face (mm) | 1 | 20 | 2 | 0.97–0.98 | |||
| Millar | 2013 | facial asymmetry, scars (algorithm score, ratios, scale) | – | – | – | ||||
| Laser surface scanning | |||||||||
| Bennun | 1999 | Nose (mm) | – | – | – | ||||
| Duffy | 2000 | chin, nose, lips (mm) | 2 | 16 | 2 | 0.47–5.4%* | |||
| Honda | 2002 | Maxillary dental arch (mm, mm2, degrees) | – | – | – | ||||
| Mori | 2005 | nose, lips (mm, degrees) | – | – | – | ||||
| Meyer–Marcotty | 2009 | Face, asymmetry (mm) | – | – | 2 | <0.006 | |||
| Smahel | 2009 | palate (mm) | – | – | – | >0.98 | 0.03–2.45 | ||
| Meyer–Marcotty | 2010 | Face (mm) | – | – | 2 | <0.006 | |||
| Chawla | 2012 | dental arches (1–5grading scale of 5-yr-olds' index) | 7 | 45 | 2 | 0.67–0.88 | |||
| Asquith | 2012 | dental arches (1–5 grading scale of 5-yr-olds' index) | 3 | 30 | 2 | 062–0.83 | |||
| Dogan | 2012 | dental arches (1–5 Goslon grading scale) | 2 | 70 | 3 | 0.82–0.96 | |||
| Chawla | 2013 | dental arches (1–5grading scale of 5-yr-olds' index) | 3 | 45 | 2 | 0.74–0.83 | |||
| Other | |||||||||
| Kilpelainen | 1996 | palate (mm, degrees) | – | – | – | ||||
| Russell | 2001 | Nose (degrees, VAS scale) | 6 | 28 | 1 | 0.74 | |||
| Smahel | 2003 | Palate (mm, mm2) | 1 | – | 2 | >0.95 | 0.03 | ||
| Smahel | 2004 | Palate (mm, mm2) | 1 | – | 2 | >0.95 | 0.03 | ||
| Bilwatsch | 2006 | nose (mm, degrees) | – | 22 | 2 | y | <1mm, <1.50 | ||
| Stauber | 2008 | nose (mm, degrees) | – | 40 | 2 | y | <1mm, <1.50 | ||
| Krey | 2009 | dental arches (mm) | – | – | – | ||||
| Trotman | 2010 | Lips, distances and movements (mm) | – | – | – | ||||
| Russell | 2011 | Nose (VAS), | 6 | 48 | 1 | 0.74 | |||
* = maximum of variable of landmark/distance reproducibility.