Skip to main content
. 2025 Aug 25;4:e66153. doi: 10.2196/66153

Table 2. Overview of the models used in the study. The table presents each model’s size, type, pretraining data, and fine-tuning task.

Model Size Type Pretrained from Pretraining Fine-tuning
NorDeClin-BERT-base-NorICDab Base Domain-Specific Clinical BERT NorBERT3-base Subset of Norwegian clinical texts Norwegian ICD-10
SweDeClin-BERT-SweICD Base Domain-Specific Clinical BERT KB-BERT Swedish clinical texts Swedish ICD-10
SweDeClin-BERT-NorICD Base Domain-Specific Clinical BERT KB-BERT Swedish clinical texts Norwegian ICD-10
ScandiBERT-NorICD Base General-Domain BERT c No Norwegian ICD-10
NorBERT3-base-NorICD Base General-Domain BERT No Norwegian ICD-10
NorDeClin-BERT-large-NorICD Large Domain-Specific Clinical BERT NorBERT3-large Full Norwegian clinical corpus Norwegian ICD-10
NorBERT3-large-NorICD Large General-Domain BERT No Norwegian ICD-10
a

BERT: Bidirectional Encoder Representations from Transformers.

b

ICD-10: International Statistical Classification of Diseases, Tenth Revision.

c

Not applicable.