Table 5.
Relevance of the questions | Clarity of the questions | Meaningfulness of the answers | Completeness of the answers | ||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
No | Content of the items | Number of experts | Number of ratings of 3 or 4 | I-CVIa | pc b | k* c | Evaluationd | Number of experts | Number of ratings of 3 or 4 | I-CVIa | pc b | k* c | Evaluationd | Number of experts | Number of ratings of 3 or 4 | I-CVIa | pc b | k* c | Evaluationd | Number of experts | Number of ratings of 3 or 4 | I-CVIa | pc b | k* c | Evaluationc |
1 | Type of behaviour | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 9 | 8 | 0.89 | 0.018 | 0.89 | **** | 9 | 7 | 0.78 | 0.070 | 0.76 | **** |
2 | Description of behaviour | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 9 | 8 | 0.89 | 0.018 | 0.89 | **** | 8 | 6 | 0.75 | 0.109 | 0.72 | *** |
3 | First occurrence of behaviour | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 9 | 9 | 1.00 | 0.002 | 1.00 | **** | 8 | 8 | 1.00 | 0.004 | 1.00 | **** |
4 | Event before the occurrence of the behaviour | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 9 | 8 | 0.89 | 0.018 | 0.89 | **** | 8 | 7 | 0.88 | 0.031 | 0.87 | **** |
5 | Time at which the behaviour occurs | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 9 | 9 | 1.00 | 0.002 | 1.00 | **** | 9 | 6 | 0.67 | 0.164 | 0.60 | *** |
6 | Duration of the behaviour | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 9 | 7 | 0.78 | 0.070 | 0.76 | **** | 9 | 7 | 0.78 | 0.070 | 0.76 | **** |
7 | Frequency of the behaviour | 10 | 10 | 1.00 | 0.001 | 1...00 | **** | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 8 | 7 | 0.88 | 0.031 | 0.87 | **** | 9 | 9 | 1.00 | 0.002 | 1.00 | **** |
8 | Area in which the behaviour occurs | 9 | 8 | 0.89 | 0.018 | 0.89 | **** | 9 | 9 | 1.00 | 0.002 | 1.00 | **** | 9 | 8 | 0.89 | 0.018 | 0.89 | **** | 9 | 7 | 0.78 | 0.070 | 0.76 | **** |
9 | Person present when the behaviour occurs | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 9 | 7 | 0.78 | 0.070 | 0.76 | **** | 9 | 7 | 0.78 | 0.070 | 0.76 | **** |
10 | Events directly before the behaviour | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 9 | 8 | 0.89 | 0.018 | 0.89 | **** | 8 | 6 | 0.75 | 0.109 | 0.72 | *** |
11 | Events directly after the behaviour | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 9 | 9 | 1.00 | 0.002 | 1.00 | **** | 8 | 8 | 1.00 | 0.004 | 1.00 | **** |
12 | Helpful interventions | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 10 | 5 | 0.50 | 0.246 | 0.34 | * | 9 | 7 | 0.78 | 0.070 | 0.76 | **** | 8 | 7 | 0.88 | 0.031 | 0.87 | **** |
13 | Behaviour unpleasant for the resident | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 9 | 8 | 0.89 | 0.018 | 0.89 | **** | 9 | 6 | 0.67 | 0.164 | 0.60 | *** |
14 | Danger for the person with dementia | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 9 | 9 | 1.00 | 0.002 | 1.00 | **** | 9 | 7 | 0.78 | 0.070 | 0.76 | **** |
15 | Behaviour unpleasant for the resident or for other residents | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** | 8 | 6 | 0.75 | 0.109 | 0.72 | *** | 9 | 9 | 1.00 | 0.002 | 1.00 | **** |
16 | Danger for other residents | 10 | 10 | 1.00 | 0.001 | 1.00 | **** | 11 | 9 | 0.82 | 0.027 | 0.81 | **** | 9 | 8 | 0.89 | 0.018 | 0.89 | **** | 9 | 7 | 0.78 | 0.070 | 0.76 | **** |
17 | Impact on carers | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 10 | 6 | 0.60 | 0.205 | 0.50 | ** | 9 | 8 | 0.89 | 0.018 | 0.89 | **** | 9 | 7 | 0.78 | 0.070 | 0.76 | **** |
18 | Danger for carers | 10 | 8 | 0.80 | 0.044 | 0.79 | **** | 8 | 7 | 0.88 | 0.031 | 0.87 | **** | 9 | 9 | 1.00 | 0.002 | 1.00 | **** | 10 | 9 | 0.90 | 0.010 | 0.90 | **** |
S-CVI/AVE 0.92 | S-CVI/AVE 0.87 | **** | S-CVI/AVE 0.87 | S-CVI/AVE 0.83 | |||||||||||||||||||||
S-CVI/UA 0.56 | S-CVI/UA 0.22 | S-CVI/UA 0.28 | S-CVI/UA 0.17 |
a I-CVI (content validity index) = number of experts providing a rating of 3 or 4/number of experts
b pc (probability of chance occurrence) = [N!/A!(N-A)!] × 0.5N, N = number of experts; A = number of experts agreeing on a rating of 3 or 4
c k* (modified kappa) = (I-CVI-pc)(1-pc)
d Evaluation criteria for the level of content validity: relationship between I-CVI and k*; excellent validity = I-CVI ≥ 0.78 and k* >0.74 (****); good validity I-CVI < 0.78 and ≥ 0.60 and k* ≤ 0.74 (***); fair validity I-CVI < 0.6 and ≥ 0.40 and k* ≤ 0.59 (**); and poor validity I-CVI < 0.4 and k* <0.40 (*)