Table 2. Overview of the models used in the study. The table presents each model’s size, type, pretraining data, and fine-tuning task.
| Model | Size | Type | Pretrained from | Pretraining | Fine-tuning |
|---|---|---|---|---|---|
| NorDeClin-BERT-base-NorICDab | Base | Domain-Specific Clinical BERT | NorBERT3-base | Subset of Norwegian clinical texts | Norwegian ICD-10 |
| SweDeClin-BERT-SweICD | Base | Domain-Specific Clinical BERT | KB-BERT | Swedish clinical texts | Swedish ICD-10 |
| SweDeClin-BERT-NorICD | Base | Domain-Specific Clinical BERT | KB-BERT | Swedish clinical texts | Norwegian ICD-10 |
| ScandiBERT-NorICD | Base | General-Domain BERT | —c | No | Norwegian ICD-10 |
| NorBERT3-base-NorICD | Base | General-Domain BERT | — | No | Norwegian ICD-10 |
| NorDeClin-BERT-large-NorICD | Large | Domain-Specific Clinical BERT | NorBERT3-large | Full Norwegian clinical corpus | Norwegian ICD-10 |
| NorBERT3-large-NorICD | Large | General-Domain BERT | — | No | Norwegian ICD-10 |
BERT: Bidirectional Encoder Representations from Transformers.
ICD-10: International Statistical Classification of Diseases, Tenth Revision.
Not applicable.