Table 5.
Inter-rater reliability for nominal and ordinal items of Wetland Wanderer Tool (WWT), based on observations at 21 wetlands in Tasmania, Australia
| Domain | # items | Weighted/Unweighted (W/UW) | Percentage agreement (%) | Cohen’s kappa (k) | Range (k) | Level of agreement |
|---|---|---|---|---|---|---|
| Online Presence | 0 of 7 | NA | NA | NA | NA | NA |
| Education and Outreach | 10 | UW | 98 | 0.96 | 0.64–1.0 | Near Perfect |
| Signage | 12 | UW | 89 | 0.77 | 0.60–1 | Substantial |
| Use of Site | 5 | W, UW | 70 | 0.40 | 0.13–0.75 | Fair |
| Access | 12 | W, UW | 91 | 0.78 | 0.61–1 | Substantial |
| Accessibility | 8 | W, UW | 92 | 0.84 | 0.40–1 | Near perfect |
| Safety and Security | 7 of 9 | W, UW | 92 | 0.82 | 0.61–1 | Near perfect |
| Incivilities | 5 of 6 | W, UW | 80 | 0.51 | 0.005–1 | Moderate |
| Aesthetics | 16 | UW | 83 | 0.66 | 0.15–1 | Substantial |
| Paths and Trails | 9 of 10 | UW | 80 | 0.61 | 0.16–1 | Substantial |
| Facilities and Amenities | 16 | UW | 93 | 0.86 | 0.60–0.86 | Near perfect |
| Maintenance and Management | 1 | UW | 100 | 1 | 1 | Perfect |
| First Nations Values | 0 of 4 | N/A | N/A | N/A | N/A | N/A |
| Natural Values | 8 | UW | 84 | 0.62 | 0.23–0.90 | Substantial |