Table 3. Inter-coder and test-retest reliability for section 5 of INCRESE v2.
Round 1 | Round 2 2 weeks later |
TRR by coder | TRR controlling for coder | TRR not controlling for coder | ||||
---|---|---|---|---|---|---|---|---|
Coder 1 | Coder 2 | Coder 3 | Coder 4 | |||||
kappa | kappa | ICC | ICC | ICC | ICC | ICC | ICC (95% CI) | |
38. Abuse or sexual violation | 0.75 | 0.78 | 0.69 | 0.59 | 0.84 | 0.30 | 0.72 | 0.75 (0.69-0.79) |
39. Death or threatened death | 0.77 | 0.79 | 0.42 | 0.59 | 0.69 | 0.73 | 0.60 | 0.77 (0.72-0.81) |
40. Self-inflicted injury | 0.83 | 0.83 | 0.55 | 0.86 | 0.83 | 0.67 | 0.72 | 0.83 (0.79-0.86) |
41. Injury or threatened injury | 0.66 | 0.68 | 0.39 | 0.65 | 0.80 | 0.36 | 0.48 | 0.66 (0.58-0.72) |
42. Injustice, prejudice, discrimination | 0.85 | 0.89 | 0.83 | 0.81 | 1.00 | 0.42 | 0.73 | 0.85 (0.81-0.87) |
43. Taking charge | 0.62 | 0.72 | 0.30 | 0.50 | 0.57 | 0.27 | 0.41 | 0.62 (0.54-0.69) |
44. Interventions/support from others | 0.70 | 0.70 | 0.25 | 0.65 | 0.55 | 0.50 | 0.52 | 0.69 (0.62-0.74) |
45. Self-acceptance | 0.68 | 0.74 | 0.10 | 0.71 | 0.24 | 0.57 | 0.52 | 0.68 (0.61-0.74) |
46. Spiritual | 0.81 | 0.81 | 0.65 | 0.85 | 0.58 | 0.60 | 0.69 | 0.81 (0.76-0.84) |
47. Rude awakening | 0.97 | 0.94 | 1.00 | 1.00 | 0.74 | 1.00 | 0.95 | 0.97 (0.91-0.97) |
48. Deciding to live | 0.93 | 0.90 | 0.25 | 0.66 | 0.14 | 0.14 | 0.86 | 0.93 (0.91-0.93) |
49. Shift in identify | 0.63 | 0.76 | 0.29 | 0.88 | 0.20 | 0.54 | 0.47 | 0.63 (0.55-0.69) |
50. Pregnancy/birth | 0.99 | 1.00 | 0.77 | 0.77 | 0.66 | 0.66 | 0.98 | 0.98 (0.95-1.00) |
51. Family | 0.81 | 0.85 | 0.57 | 0.77 | 0.75 | 0.57 | 0.69 | 0.81 (0.77-0.84) |
52. Care System | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.99 | 1.00 (0.99-1.00) |
53. Education | 0.87 | 0.97 | 0.73 | 0.85 | 0.78 | 0.52 | 0.77 | 0.87 (0.84-0.89) |
54. Friendships | 0.79 | 0.84 | 0.53 | 0.78 | 0.74 | 0.49 | 0.64 | 0.78 (0.73-0.82) |
55. Relationships | 0.77 | 0.73 | 0.52 | 0.75 | 0.81 | 0.33 | 0.63 | 0.77 (0.72-0.81) |
56. Housing | 0.83 | 0.89 | 0.59 | 0.69 | 0.63 | 0.42 | 0.71 | 0.83 (0.79-0.86) |
57. Income | 0.84 | 0.85 | 0.47 | 0.92 | 0.79 | 0.49 | 0.72 | 0.84 (0.80-0.86) |
58. Work | 0.78 | 0.78 | 0.67 | 0.71 | 0.67 | 0.21 | 0.65 | 0.78 (0.73-0.82) |
59. Criminal justice system | 0.70 | 0.77 | 0.77 | 0.65 | 0.50 | 1.00 | 0.56 | 0.70 (0.65-0.76) |
60. Diagnosis | 0.80 | 0.86 | 0.60 | 0.71 | 0.57 | 0.51 | 0.66 | 0.80 (0.75-0.83) |
61. Medication | 0.86 | 0.85 | 0.80 | 0.82 | 0.70 | 0.60 | 0.75 | 0.86 (0.82-0.88) |
62. Relationship with MH professional | 0.83 | 0.83 | 0.63 | 0.88 | 0.69 | 0.59 | 0.71 | 0.83 (0.79-0.86) |
63. Formal peer support | 0.73 | 0.75 | 0.39 | 0.64 | 0.63 | 0.33 | 0.57 | 0.73 (0.67-0.74) |
64. Informal peer support | 0.78 | 0.82 | 0.44 | 0.62 | 0.69 | 0.61 | 0.65 | 0.78 (0.73-0.82) |
65. Involuntary use of MH services | 0.84 | 0.84 | 0.71 | 0.79 | 0.85 | 0.36 | 0.73 | 0.84 (0.81-0.87) |
66. Hospitalization | 0.78 | 0.73 | 0.78 | 0.83 | 0.67 | 0.38 | 0.65 | 0.78 (0.73-0.82) |
67. Psychological services | 0.78 | 0.75 | 0.63 | 0.78 | 0.53 | 0.43 | 0.63 | 0.78 (0.73-0.81) |
68. Alternative therapies | 0.82 | 0.84 | 0.61 | 0.73 | 0.84 | 0.65 | 0.70 | 0.82 (0.78-0.85) |
69. Being in natural environments | 0.71 | 0.78 | 0.50 | 0.72 | 0.50 | 0.48 | 0.56 | 0.71 (0.65-0.76) |
70. Animals/pets | 0.77 | 0.76 | 0.38 | 0.68 | 0.87 | 0.00 | 0.67 | 0.77 (0.71-0.81) |
71. Community activities | 0.63 | 0.63 | 0.39 | 0.56 | 0.56 | 0.48 | 0.46 | 0.63 (0.55-0.70) |
72. Hobbies/interests | 0.74 | 0.73 | 0.31 | 0.69 | 0.47 | 0.68 | 0.59 | 0.74 (0.68-0.78) |
73. Physical activities | 0.71 | 0.78 | 0.44 | 0.91 | 0.48 | 0.38 | 0.55 | 0.71 (0.65-0.76) |
74. Political activities | 0.61 | 0.72 | 0.43 | 0.43 | 0.66 | 0.41 | 0.44 | 0.61 (0.53-0.68) |
75. Previous life circumstances | 0.26 | 0.31 | 0.09 | 0.68 | 0.23 | 0.18 | 0.14 | 0.26 (0.10-0.39) |
76. Spiritual/religious activities | 0.89 | 0.94 | 0.81 | 0.73 | 0.70 | 0.62 | 0.80 | 0.89 (0.86-0.91) |
77. Stigma | 0.79 | 0.84 | 0.74 | 0.79 | 0.60 | 0.35 | 0.66 | 0.79 (0.75-0.83) |
78. Creative activities | 0.82 | 0.82 | 0.64 | 0.80 | 0.63 | 0.69 | 0.70 | 0.82 (0.79-0.85) |
79. Caring responsibilities | 0.58 | 0.71 | 0.38 | 0.65 | 0.39 | 0.35 | 0.41 | 0.58 (0.49-0.66) |
80. Family experiences of MH issues | 0.87 | 0.88 | 0.65 | 0.65 | 0.42 | 0.49 | 0.77 | 0.87 (0.84-0.89) |
81. Diet/Nutrition | 0.81 | 0.88 | 0.59 | 0.62 | 0.56 | 0.00 | 0.68 | 0.81 (0.77-0.84) |
82. Volunteering | 0.89 | 0.94 | 0.74 | 0.91 | 0.85 | 0.68 | 0.82 | 0.89 (0.87-0.91) |
Bold = below predefined item-level threshold