Table 5.
Balanced Accuracy Performance Change using Enhancement Strategies.
Dataset | Dreaddit | DepSeverity | SDCNL | CSSRS-Suicide | |||
---|---|---|---|---|---|---|---|
Model | Task #1 | Task #2 | Task #3 | Task #4 | Task #5 | Task #6 | –All Six Tasks |
↑ +0.019 | ↑ +0.045 | ↑ +0.023 | ↑ +0.004 | ↑ +0.014 | ↑ +0.018 | ↑ +0.021 | |
↑ +0.000 | ↑ +0.055 | ↑ +0.013 | ↓ −0.011 | ↑ +0.006 | ↑ +0.004 | ↑ +0.011 | |
↓ −0.053 | ↑ +0.037 | ↓ −0.010 | ↑ +0.039 | ↓ −0.007 | ↓ −0.010 | ↓ −0.001 | |
↓ −0.035 | ↓ −0.047 | ↓ −0.094 | ↓ −0.030 | ↑ +0.027 | ↑ +0.027 | ↓ −0.025 | |
↓ −0.071 | ↓ −0.047 | ↓ −0.105 | ↓ −0.005 | ↑ +0.017 | ↑ +0.029 | ↓ −0.031 | |
↓ −0.071 | ↓ −0.048 | ↓ −0.051 | ↓ −0.003 | ↓ −0.023 | ↑ +0.037 | ↓ −0.027 | |
↑ +0.004 | ↑ +0.011 | ↓ −0.018 | ↑ +0.010 | ↓ −0.018 | ↓ −0.040 | ↓ −0.009 | |
↓ −0.043 | ↑ +0.003 | ↓ −0.030 | ↑ +0.005 | ↓ −0.013 | ↓ −0.046 | ↓ −0.021 | |
↓ −0.055 | ↓ −0.003 | ↓ −0.007 | ↑ +0.002 | ↓ −0.010 | ↓ −0.036 | ↓ −0.018 | |
↓ −0.062 | ↑ +0.014 | ↓ −0.019 | ↑ +0.000 | ↑ +0.031 | ↑ +0.106 | ↑ +0.012 | |
↓ −0.102 | ↑ +0.018 | ↓ −0.033 | ↑ +0.053 | ↑ +0.004 | ↑ +0.031 | ↓ −0.005 | |
↓ −0.136 | ↑ +0.011 | ↑ +0.016 | ↑ +0.054 | ↓ −0.002 | ↑ +0.067 | ↑ +0.002 | |
↑ +0.003 | ↑ +0.011 | ↓ −0.060 | ↑ +0.157 | ↑ +0.007 | ↑ +0.031 | ↑ +0.025 | |
↓ −0.006 | ↓ −0.006 | ↑ +0.039 | ↑ +0.116 | ↓ −0.093 | ↑ +0.077 | ↑ +0.021 | |
↓ −0.005 | ↓ −0.015 | ↑ +0.014 | ↑ +0.172 | ↑ +0.047 | ↑ +0.020 | ↑ +0.039 | |
↑ +0.006 | ↑ +0.000 | ↑ +0.001 | ↑ +0.000 | ↓ −0.007 | ↑ +0.023 | ↑ +0.004 | |
↑ +0.025 | ↓ −0.035 | ↑ +0.067 | ↑ +0.002 | ↓ −0.023 | ↓ −0.022 | ↑ +0.002 | |
↑ +0.018 | ↓ −0.031 | ↑ +0.061 | ↑ +0.003 | ↓ −0.063 | ↓ −0.006 | ↓ −0.003 | |
–All Six Models | ↓ −0.031 | ↑ +0.000 | ↓ −0.011 | ↑ +0.032 | ↓ −0.006 | ↑ +0.017 | ↑ +0.000 |
–Alpaca, GPT-3.5, GPT-4 | ↑ +0.001 | ↑ +0.007 | ↑ +0.017 | ↑ +0.053 | ↓ −0.013 | ↑ +0.015 | ↑ +0.013 |
The green/red color indicates increased/decreased accuracy. This table zooms in on the zero-shot section of Table 4. ↑/↓ marks the ones with better/worse performance in comparison.