Table 3.
Concordance, sensitivity, specificity, and Cohen’s kappa for each complaint (app-based vs in-person).
| Complaint | Concordancea | Sensitivity (n/N) | Specificity (n/N) | Cohen’s kappaa |
|---|---|---|---|---|
| Head | 0.92 (0.89-0.94) | — | — | — |
| Eye problems | 0.99 (0.97-0.99) | 0.83 (5/6) | 0.99 (388/393) | 0.62 (0.34-0.90) |
| Headache | 0.95 (0.92-0.97) | 0.90 (38/42) | 0.95 (340/357) | 0.75 (0.65-0.85) |
| Ear problems | 0.98 (0.96-0.99) | 0.70 (7/10) | 0.98 (383/389) | 0.60 (0.36-0.84) |
| Dizziness | 0.97 (0.94-0.98) | 0.92 (12/13) | 0.97 (374/386) | 0.63 (0.45-0.82) |
| Throat, breathing and common cold | 0.91 (0.88-0.94) | — | — | — |
| Shortness of breath | 0.98 (0.96-0.99) | 0.89 (8/9) | 0.98 (384/390) | 0.69 (0.47-0.91) |
| Cold or flu | 0.98 (0.96-0.99) | 0.88 (29/33) | 0.99 (363/366) | 0.88 (0.80-0.97) |
| Sore throat | 0.98 (0.96-0.99) | 1.00 (29/29) | 0.98 (361/370) | 0.85 (0.76-0.95) |
| Cough | 0.97 (0.95-0.99) | 0.91 (21/23) | 0.98 (368/376) | 0.79 (0.67-0.92) |
| Difficulty swallowing | 0.96 (0.94-0.98) | 0.86 (12/14) | 0.97 (372/385) | 0.60 (0.41-0.78) |
| Heart, chest and back | 0.93 (0.91: 0.96) | — | — | — |
| Chest and heart problems | 0.98 (0.96-0.99) | 0.87 (26/30) | 0.99 (364/369) | 0.84 (0.74-0.94) |
| Palpitations | 0.99 (0.97-0.99) | 0.88 (7/8) | 0.99 (386/391) | 0.69 (0.46-0.93) |
| Back pain | 0.96 (0.94-0.98) | 0.92 (54/59) | 0.97 (330/340) | 0.86 (0.78-0.93) |
| Abdomen, digestion and urination | 0.92 (0.89-0.94) | — | — | — |
| Abdominal discomfort | 0.96 (0.94-0.98) | 0.89 (50/56) | 0.97 (334/343) | 0.85 (0.77-0.92) |
| Urinary discomfort | 0.998 (0.99-1.00) | 1.00 (22/22) | 0.997 (376/377) | 0.98 (0.93-1.00) |
| Diarrhea | 0.98 (0.96-0.99) | 0.67 (6/9) | 0.99 (385/390) | 0.72 (0.33-0.85) |
| Vomiting/nausea | 0.97 (0.95-0.99) | 0.67 (8/12) | 0.98 (381/387) | 0.75 (0.38-0.83) |
| Changes in bowel movements/constipation | 0.99 (0.97-0.995) | 1.00 (5/5) | 0.99 (389/394) | 0.66 (0.38-0.94) |
| Lower body and groin | 0.96 (0.94-0.98) | — | — | — |
| Anus problems | 1.00 (0.99-1.00) | 1.00 (1/1) | 1.00 (398/398) | 1.00 (1.00-1.00) |
| Unusual vaginal discharge | 0.997 (0.99-1.00) | − (0) | 0.997 (398/399) | — |
| Unusual vaginal bleeding | 0.99 | − (0) | 0.992 (396/399) | — |
| Groin problems | 0.998 (0.99-1) | 0.83 (5/6) | 1.00 (393/393) | 0.91 (0.73-1.00) |
| Leg pain/leg swelling | 0.97 (0.95-0.99) | 0.60 (3/5) | 0.98 (386/394) | 0.36 (0.06-0.67) |
| General condition and psyche | 0.90 (0.87-0.93) | — | — | — |
| Anxiety | 0.97 (0.94-0.98) | 0.78 (7/9) | 0.97 (379/390) | 0.50 (0.27-0.74) |
| Depression | 0.99 (0.98-1) | 0.95 (20/21) | 0.99 (376/378) | 0.93 (0.84-1.00) |
| Fever | 1.00 (0.99-1) | 1.00 (2/2) | 1.00 (397/397) | 1.00 (1.00-1.00) |
| Weight changes | 0.99 (0.98-1) | 1.00 (1/1) | 0.99 (394/398) | 0.33 (-0.15-0.82) |
| Sleep disturbances or fatigue | 0.95 (0.92-0.97) | 0.71 (15/21) | 0.96 (364/378) | 0.57 (0.41-0.74) |
| Weaknesses | 0.96 (0.93-0.98) | 0.71 (5/7) | 0.96 (377/392) | 0.35 (0.12-0.59) |
| Sweating | 0.985 (0.97-0.99) | 0.00 (0/1) | 0.99 (393/398) | −0.00 (-0.01-0.00) |
| Forgetfulness | 0.99 (0.97-1.00) | − (0/0) | 0.99 (395/399) | — |
| Other problems | 0.92 (0.89-0.94) | |||
| Bleeding | 0.99 (0.98-1.00) | − (0/0) | 0.99 (397/399) | — |
| Joint and muscle problems | 0.95 (0.92-0.97) | 0.71 (40/56) | 0.99 (339/343) | 0.77 (0.68-0.87) |
| Insect bites or string | 1.00 (0.99-1) | 1.00 (1/1) | 1.00 (398/398) | 1.00 (1.00-1.00) |
| Paralysis/sensory problems | 0.99 (0.98-1.00) | 1.00 (2/2) | 0.99 (394/397) | 0.57 (0.13-1.00) |
| Fainting or blacking out | 0.9975 (0.99-1) | − (0/0) | 0.998 (398/399) | — |
| Swelling | 0.98 (0.96-0.99) | 0.79 (11/14) | 0.99 (381/385) | 0.75 (0.57-0.93) |
| Changes in skin, hair, or nails | 0.99 (0.97-0.995) | 0.88 (21/24) | 0.99 (373/375) | 0.89 (0.79-0.98) |
| Injury | 0.99 (0.98-0.998) | 1.00 (8/8) | 0.99 (388/391) | 0.84 (0.66-1.00) |
| Mental complaints | 0.93 (0.89-0.95) | — | — | — |
| Somatic complaints | 0.67 (0.62-0.72) | — | — | — |
| All complaints | 0.64 (0.59-0.69) | — | — | — |
| All complaints including overreportingb | 0.83 (0.79-0.87) | — | — | — |
a
With the corresponding 95% CI.
b
Concordance including patients with exact matches and overreport in the app-based interview.