Table 1.

Criteria for including/excluding articles

Aspect	Criteria
Domain	Articles must focus on the biomedical domain with applications pertaining to clinical or biomedical tasks.
Model architecture	Any model architecture is permissible, with the only condition that the parameter size must exceed 1B parameters.
Model training	Inclusion: models trained from scratch, continual pretraining, or fine-tuning utilizing biomedical data Exclusion: models relying solely on prompt engineering strategies including in-context learning
Modality	Single or multimodal models with text data as one modality