Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Set Transformer can perform worse (underlined) with layer norm than with no normalization, particularly when inputs are real-valued. Results are test loss over three seeds (CE for Point Cloud, MSE for rest). Lower is better.
| No norm | Layer norm | |
|---|---|---|
| Hematocrit | 18.7436 ± 0.0148 | 19.0904 ± 0.1003 |
| Point Cloud | 0.9217 ± 0.0119 | 0.9219 ± 0.0052 |
| Normal Var | 0.0023 ± 0.0006 | 0.0801 ± 0.0076 |
