Table 6.
Comparison of GPT-1 and GraphGPT.
| GPT-1 | GraphGPT | |
|---|---|---|
| Decoder layer | 12 | 8 |
| Attention header | 12 | 8 |
| Dimensions of vocab | 768 | 256 |
| Sequence length | 512 | 100 |
| Parameter | 117 million | 7.07 million |
Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.