Table 7:
The impact of domain adaptation on metric correlation to human assessments when combining with an easy-to-compute extractiveness statistic (coverage).
| Domain Adaptation | Metric | Pearson Correlation |
|---|---|---|
| Coverage (Cov) | .457 | |
|
| ||
| Off The Shelf | BARTScore + Cov | .542 |
| CTC + Cov | .522 | |
| Entailment + Cov | .524 | |
| Average | .529 | |
|
| ||
| Tuned In-Domain | BARTScore + Cov | .547 |
| CTC + Cov | .523 | |
| Entailment + Cov | .535 | |
| Average | .535 | |
|
| ||
| Double In-Domain | BARTScore | .547 |
| CTC + Cov | .514 | |
| Entailment + Cov | .535 | |
| Average | .532 | |