Table 3.
The frequency distribution of the reliability values according to the groups
| Reliability questions | Researcher | Score | Orthodontist | Orthodontics | Orthodontic treatment |
|---|---|---|---|---|---|
| Are the aims clear and achieved? | GS | 0 | 9 (29) | 3 (7.1) | 4 (11.4) |
| 1 | 22 (71) | 39 (92.9) | 31 (88.6) | ||
| DDK | 0 | 10 (32.3) | 6 (14.3) | 8 (22.9) | |
| 1 | 21 (67.7) | 36 (85.7) | 27 (77.1) | ||
| K value | 0.773* | 0.632* | 0.607* | ||
| Reliable sources info? | GS | 0 | 10 (32.3) | 15 (35.7) | 15 (42.9) |
| 1 | 21 (67.7) | 27 (64.3) | 20 (57.1) | ||
| DDK | 0 | 20 (64.5) | 20 (47.6) | 24 (68.6) | |
| 1 | 11 (35.5) | 22 (52.4) | 11 (31.4) | ||
| K value | 0.415** | 0.566** | 0.512** | ||
| Balanced and unbiased? | GS | 0 | 11 (35.5) | 23 (54.8) | 24 (68.6) |
| 1 | 20 (64.5) | 19 (45.2) | 11 (31.4) | ||
| DDK | 0 | 20 (64.5) | 27 (64.3) | 26 (74.3) | |
| 1 | 11 (35.5) | 15 (35.7) | 9 (25.7) | ||
| K value | 0.464** | 0.510** | 0.721* | ||
| Additional sources info? | GS | 0 | 19 (61.3) | 28 (66.7) | 28 (80) |
| 1 | 12 (38.7) | 14 (33.3) | 7 (20) | ||
| DDK | 0 | 22 (73.3) | 28 (66.7) | 29 (82.9) | |
| 1 | 8 (26.7) | 14 (33.3) | 6 (17.1) | ||
| K value | 0.619* | 0.571** | 0.717* | ||
| Are areas of uncertainty mentioned? | GS | 0 | 22 (71) | 30 (71.4) | 29 (82.9) |
| 1 | 9 (29) | 12 (28.6) | 6 (17.1) | ||
| DDK | 0 | 24 (77.4) | 33 (78.6) | 32 (91.4) | |
| 1 | 7 (22.6) | 9 (21.4) | 3 (8.6) | ||
| K value | 0.665* | 0.559** | 0.624* |
K: kappa coefficent
*
There is good concordance between the researchers.
**
There is moderate concordance between the researchers.