Skip to main content
. Author manuscript; available in PMC: 2021 Jun 24.
Published in final edited form as: Proc Conf. 2021 Jun;2021:4125–4138.

Table 1:

Translational NLP checklist items for Disability Review case study, including notes on published results.

Information Need Overall goal: Improve disability benefits review process by highlighting relevant information
Formal representation: Spans of evidence, with attributes for activity type and level of limitation

Data Characteristics Medical records and administrative forms from USA, mostly English

Task Paradigms Information extraction (spans), information retrieval (documents), span classification (activity and limitations)

Available Resources Minimal knowledge sources for function and disability, no public corpora; US government computing systems; high throughput requirements (thousands of records/day)

NLP Technologies Low-latency, low-compute sequence models; rule-based systems

Evaluation Standard metrics (F-1, accuracy). Information retrieval metrics reported for use case prototypes.

Interpretation Interpretation needs primarily around human decision-making; NLP tools highlight and organize information in context. No ML interpretability reported in published results.

Application Engineering Open-source implementations using standardized frameworks for preprocessing. No data exchange reported.