Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Combinations of L and H and the comparison performance of the proposed model with these combinations.
| Model | Number of layers (L) | Number of heads (H′) | AUC |
|---|---|---|---|
| L_2_H_8 | 2 | 8 | 0.907 |
| L_4_H_8 | 4 | 8 | 0.911 |
| L_8_H_8 | 8 | 8 | 0.923 |
| L_2_H_16 | 2 | 16 | 0.917 |
| L_4_H_16 | 4 | 16 | 0.931 |
| L_8_H_16 | 8 | 16 | 0.925 |
L, number of layers; H, number of heads.
