Table 4.
Performance of methods on intrinsic evaluation from 4 mental health professionals gathered after counting the number of good questions with clear context, good questions with unclear context, and meaningful responses in 50 (2 methods) summaries generated.
| Domain Experts | MHPa 1 | MHP 2 | MHP 3 | MHP 4 | |||||||
| Methods | ASb | KiASc | AS | KiAS | AS | KiAS | AS | KiAS | |||
| GQCCd | 71 | 78 | 75 | 74 | 66 | 63 | 59 | 64 | |||
| GQUCe | 86 | 92 | 93 | 95 | 87 | 85 | 82 | 85 | |||
| Meaningful responses | 60 | 63 | 61 | 65 | 52 | 57 | 72 | 76 | |||
aMHP: mental health professional.
bAS: abstractive summarization.
cKiAS: knowledge-infused abstractive summarization.
dGQCC: good questions with clear context.
eGQUC: good questions with unclear context.