Table 2. Inter-rater reliability expert analysis.
| No. | Components | Evaluators | AB | AC | BC | Level of agreement | No. of agreement | ||
|---|---|---|---|---|---|---|---|---|---|
| A | B | C | |||||||
| 1 | Goal identification | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 2 | Game structure | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 3 | Game mechanics | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 4 | Game player | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 5 | Game control | 1 | 0 | 1 | 0 | 1 | 0 | 1/3 | 1 |
| 6 | Game presentation | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 7 | User journey | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 8 | Reward system | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 9 | Feedback mechanism | 1 | 1 | 0 | 1 | 0 | 0 | 1/3 | 1 |
| 10 | Quest and challenges | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 11 | Game elements | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 12 | Experience design | 0 | 1 | 1 | 0 | 0 | 1 | 1/3 | 2 |
| 13 | Outcomes | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 14 | Usability principles | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 15 | Collaboration tools | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| 16 | Usability testing | 1 | 1 | 1 | 1 | 1 | 1 | 3/3 | 3 |
| Total | 42/48 | ||||||||
| Percentage | 0.875 | ||||||||
| Inter-rater reliability mean: | 87.50% | ||||||||