Table 6.
Content validity of the dimension “Cognition status”
| Relevance of the questions | Clarity of the questions | Meaningfulness of the answers | Completeness of the answers | ||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| No | Content of the item | Number of experts | Number of ratings of 3 or 4 | I-CVIa | pc b | k* c | Evaluationd | Number of experts | Number of ratings of 3 or 4 | I-CVIa | pc b | k* c | Evaluationd | Number of experts | Number of ratings of 3 or 4 | I-CVIa | pc b | k* c | Evaluationad | Number of experts | Number of ratings of 3 or 4 | I-CVIa | pc b | k* c | Evaluationd |
| 1 | Diagnosis of dementia | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 9 | 7 | 0.78 | 0.070 | 0.76 | **** |
| 2 | Type of dementia | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 10 | 1.00 | 0.001 | 1.00 | *** | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 10 | 7 | 0.70 | 0.117 | 0.66 | *** |
| 3 | Dementia stage | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 10 | 6 | 0.60 | 0.205 | 0.50 | ** | 8 | 6 | 0.75 | 0.109 | 0.72 | *** |
| 4 | Memory functions | 8 | 6 | 0.75 | 0.109 | 0.72 | *** | 8 | 7 | 0.88 | 0.031 | 0.87 | **** | 9 | 9 | 1.00 | 0.002 | 1.00 | **** | 9 | 6 | 0.67 | 0.164 | 0.60 | *** |
| 5 | Long-term memory | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 10 | 7 | 0.70 | 0.117 | 0.66 | *** | 9 | 9 | 1 00 | 0.002 | 1.00 | **** | 7 | 6 | 0.86 | 0.055 | 0.85 | **** |
| 6 | Short-time memory | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 9 | 6 | 0.67 | 0.164 | 0.60 | *** |
| 7 | Orientation | 9 | 9 | 1.00 | 0.002 | 1.00 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 9 | 6 | 0.67 | 0.164 | 0.60 | *** |
| S-CVI/AVE 0.95 | S-CVI/AVE 0.85 | S-CVI/AVE 0.83 | S-CVI/AVE 0.74 | ||||||||||||||||||||||
| S-CVI/UA 0.71 | S-CVI/UA 0.14 | S-CVI/UA 0.33 | S-CVI/UA 0.00 | ||||||||||||||||||||||
a I-CVI (content validity index) = number of experts providing a rating of 3 or 4/number of experts
b pc (probability of chance occurrence) = [N!/A!(N-A)!] × 0.5N, N = number of experts; A = number of experts agreeing on a rating of 3 or 4
c k* (modified kappa) = (I-CVI-pc)(1-pc)
d Evaluation criteria for level of content validity: relationship between I-CVI and k*; excellent validity = I-CVI ≥ 0.78 and k* >0.74 (****); good validity I-CVI < 0.78 and ≥ 0.60 andk* ≤0.74 (***); fair validity I-CVI < 0.6 and ≥ 0.40 and k* ≤0.59 (**); poor validity I-CVI < 0.4 and k* <0.40 (*)