Skip to main content
. Author manuscript; available in PMC: 2022 Jan 4.
Published in final edited form as: J Recovery Ment Health. 2020 Summer;3(2):25–44.

Table 3. Inter-coder and test-retest reliability for section 5 of INCRESE v2.

Item Inter-coder reliability Test-retest reliability (TRR)
Round 1 Round 2
2 weeks later
TRR by coder TRR controlling for coder TRR not controlling for coder
Coder 1 Coder 2 Coder 3 Coder 4
kappa kappa ICC ICC ICC ICC ICC ICC (95% CI)
38. Abuse or sexual violation 0.75 0.78 0.69 0.59 0.84 0.30 0.72 0.75 (0.69-0.79)
39. Death or threatened death 0.77 0.79 0.42 0.59 0.69 0.73 0.60 0.77 (0.72-0.81)
40. Self-inflicted injury 0.83 0.83 0.55 0.86 0.83 0.67 0.72 0.83 (0.79-0.86)
41. Injury or threatened injury 0.66 0.68 0.39 0.65 0.80 0.36 0.48 0.66 (0.58-0.72)
42. Injustice, prejudice, discrimination 0.85 0.89 0.83 0.81 1.00 0.42 0.73 0.85 (0.81-0.87)
43. Taking charge 0.62 0.72 0.30 0.50 0.57 0.27 0.41 0.62 (0.54-0.69)
44. Interventions/support from others 0.70 0.70 0.25 0.65 0.55 0.50 0.52 0.69 (0.62-0.74)
45. Self-acceptance 0.68 0.74 0.10 0.71 0.24 0.57 0.52 0.68 (0.61-0.74)
46. Spiritual 0.81 0.81 0.65 0.85 0.58 0.60 0.69 0.81 (0.76-0.84)
47. Rude awakening 0.97 0.94 1.00 1.00 0.74 1.00 0.95 0.97 (0.91-0.97)
48. Deciding to live 0.93 0.90 0.25 0.66 0.14 0.14 0.86 0.93 (0.91-0.93)
49. Shift in identify 0.63 0.76 0.29 0.88 0.20 0.54 0.47 0.63 (0.55-0.69)
50. Pregnancy/birth 0.99 1.00 0.77 0.77 0.66 0.66 0.98 0.98 (0.95-1.00)
51. Family 0.81 0.85 0.57 0.77 0.75 0.57 0.69 0.81 (0.77-0.84)
52. Care System 1.00 1.00 1.00 1.00 1.00 1.00 0.99 1.00 (0.99-1.00)
53. Education 0.87 0.97 0.73 0.85 0.78 0.52 0.77 0.87 (0.84-0.89)
54. Friendships 0.79 0.84 0.53 0.78 0.74 0.49 0.64 0.78 (0.73-0.82)
55. Relationships 0.77 0.73 0.52 0.75 0.81 0.33 0.63 0.77 (0.72-0.81)
56. Housing 0.83 0.89 0.59 0.69 0.63 0.42 0.71 0.83 (0.79-0.86)
57. Income 0.84 0.85 0.47 0.92 0.79 0.49 0.72 0.84 (0.80-0.86)
58. Work 0.78 0.78 0.67 0.71 0.67 0.21 0.65 0.78 (0.73-0.82)
59. Criminal justice system 0.70 0.77 0.77 0.65 0.50 1.00 0.56 0.70 (0.65-0.76)
60. Diagnosis 0.80 0.86 0.60 0.71 0.57 0.51 0.66 0.80 (0.75-0.83)
61. Medication 0.86 0.85 0.80 0.82 0.70 0.60 0.75 0.86 (0.82-0.88)
62. Relationship with MH professional 0.83 0.83 0.63 0.88 0.69 0.59 0.71 0.83 (0.79-0.86)
63. Formal peer support 0.73 0.75 0.39 0.64 0.63 0.33 0.57 0.73 (0.67-0.74)
64. Informal peer support 0.78 0.82 0.44 0.62 0.69 0.61 0.65 0.78 (0.73-0.82)
65. Involuntary use of MH services 0.84 0.84 0.71 0.79 0.85 0.36 0.73 0.84 (0.81-0.87)
66. Hospitalization 0.78 0.73 0.78 0.83 0.67 0.38 0.65 0.78 (0.73-0.82)
67. Psychological services 0.78 0.75 0.63 0.78 0.53 0.43 0.63 0.78 (0.73-0.81)
68. Alternative therapies 0.82 0.84 0.61 0.73 0.84 0.65 0.70 0.82 (0.78-0.85)
69. Being in natural environments 0.71 0.78 0.50 0.72 0.50 0.48 0.56 0.71 (0.65-0.76)
70. Animals/pets 0.77 0.76 0.38 0.68 0.87 0.00 0.67 0.77 (0.71-0.81)
71. Community activities 0.63 0.63 0.39 0.56 0.56 0.48 0.46 0.63 (0.55-0.70)
72. Hobbies/interests 0.74 0.73 0.31 0.69 0.47 0.68 0.59 0.74 (0.68-0.78)
73. Physical activities 0.71 0.78 0.44 0.91 0.48 0.38 0.55 0.71 (0.65-0.76)
74. Political activities 0.61 0.72 0.43 0.43 0.66 0.41 0.44 0.61 (0.53-0.68)
75. Previous life circumstances 0.26 0.31 0.09 0.68 0.23 0.18 0.14 0.26 (0.10-0.39)
76. Spiritual/religious activities 0.89 0.94 0.81 0.73 0.70 0.62 0.80 0.89 (0.86-0.91)
77. Stigma 0.79 0.84 0.74 0.79 0.60 0.35 0.66 0.79 (0.75-0.83)
78. Creative activities 0.82 0.82 0.64 0.80 0.63 0.69 0.70 0.82 (0.79-0.85)
79. Caring responsibilities 0.58 0.71 0.38 0.65 0.39 0.35 0.41 0.58 (0.49-0.66)
80. Family experiences of MH issues 0.87 0.88 0.65 0.65 0.42 0.49 0.77 0.87 (0.84-0.89)
81. Diet/Nutrition 0.81 0.88 0.59 0.62 0.56 0.00 0.68 0.81 (0.77-0.84)
82. Volunteering 0.89 0.94 0.74 0.91 0.85 0.68 0.82 0.89 (0.87-0.91)

Bold = below predefined item-level threshold