Table 2.
Impact of interactive training, by message. N = 712, Qualtrics-based test and training
| Message | % correct: control | % correct: interactive training | Difference (percentage points) | % change | Significance |
|---|---|---|---|---|---|
| Your Urgent Support Is Needed | 42% | 63% | 21% | 50.0% | p: 0.000; *** |
| Need a replacement Social Security Card? | 64% | 85% | 21% | 32.8% | p: 0.000; *** |
| Important Information About Your Online Account | 79% | 91% | 12% | 15.2% | p: 0.003; ** |
| The Social Security Administration is contacting a few people | 47% | 59% | 12% | 25.5% | p: 0.028; * |
| Payment declined: Update your information so we can ship your order | 61% | 70% | 9% | 14.8% | p: 0.058 |
| Opt Out of Receiving Mailed Notices | 43% | 49% | 6% | 14.0% | p: 0.307 |
| Annual Reminder to Review Your Social Security Statement | 68% | 74% | 6% | 8.8% | p: 0.192 |
| Disability Alert | 94% | 97% | 3% | 3.2% | p: 0.235 |
| Delivery Update | 93% | 94% | 1% | 1.1% | p: 0.678 |
| Notice of Intent to Levy Social Security Benefits | 82% | 81% | − 1% | − 1.2% | p: 0.741 |
| The Application Process Is Open For Disability Benefits | 86% | 85% | − 1% | − 1.2% | p: 0.884 |
| Convalescent Plasma is needed | 52% | 46% | − 6% | − 11.5% | p: 0.292 |
| Average | 68% | 75% | 7% | 10.2% |
***p < 0.001; **p < 0.01; *p < 0.05. Two-sided test of proportions (z test) on the number of communications correctly identified, relative to the control condition.