Table 5.
Interannotator agreement (Cohen κ) calculated over summaries evaluated by 4 mental health professionals.
| Method | Good questionsa, Cohen κ | Meaningful response, Cohen κ |
| Abstractive summarization | 0.63 | 0.43 |
| KiASb | 0.70 | 0.65 |
aGood questions include good questions with unclear context and good questions with clear context.
bKiAS: knowledge-infused abstractive summarization.