Table 3.
Comparison of Idiographic Model Performance for Negative Affect, Sadness, Anger, and Nervousness Using LIWC+VADER, LDA, and GPT
LIWC+VADER | LDA | GPT | ||||||||
---|---|---|---|---|---|---|---|---|---|---|
R2 | R2 range | RMSE | R2 | R2 range | RMSE | R2 | R2 range | RMSE | ||
Negative Aflect | Random Forest | .05 (.08) | .00; .42 Sig.n=31/97 |
0.49 (0.21) | .07 (.09) | .00; .48 Sig.n=36/97 |
0.49 (0.21) | .10 (.08) | .00; .34 Sig.n=55/97 |
0.85 (.20) |
Elastic net | .07 (.10) | .00; .55 Sig.n=36/97 |
0.49 (0.22) | .06 (.07) | .00; .44 Sig.n=35/97 |
0.50 (0.22) | ||||
Sad | Random Forest | .05 (.08) | .00; .38 Sig.n=24/95 |
0.70 (0.25) | .05 (.08) | .00; .46 Sig.n=25/95 |
0.71 (0.26) | .10 (.10) | .00; .54 Sig.n=55/96 |
1.11 (0.26) |
Elastic net | .07 (.08) | .00; .44 Sig.n=42/95 |
0.70 (0.26) | .07 (.07) | .00; .29 Sig.n=45/95 |
0.71 (0.27) | ||||
Angry | Random Forest | .04 (.06) | .00; .28 Sig.n=15/70 |
0.72 (0.29) | .03 (.05) | .00; .58 Sig.n=12/85 |
0.68 (0.32) | .09 (.10) | .00; .44 Sig.n=45/90 |
0.93 (0.34) |
Elastic net | .05 (.07) | .00; .27 Sig.n=26/70 |
0.73 (0.31) | .07 (.07) | .00; .28 Sig.n=43/84 |
0.67 (0.32) | ||||
Nervous | Random Forest | .04 (0.06) | .00; .29 Sig.n=19/86 |
0.80 (0.26) | .05 (.08) | .00; .53 Sig.n=29/94 |
0.77 (0.28) | .06 (.06) | 1.36 (0.22) | |