Table 3. Classification results for freezing Clinical BERT vs. fine-tuning Clinical BERT on the small TCMR sample.

Acc refers to accuracy. Log.Reg. refers to logistic regression. DNN stands for dense neural network.

Model	Overall Acc	Positive precision	Positive recall	Positive F1-score
Frozen clinical BERT+Log.Reg.	0.78	0.75	0.23	0.35
Frozen clinical BERT+DNN	0.88	0.77	0.77	0.77
Fine-tuned clinical BERT+DNN	0.92	0.87	0.83	0.85