Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
The advantages and disadvantages of the various architectures.
| Distributed training architecture | Advantages | Disadvantages |
|---|---|---|
| Single-node multi-process (scale-up) | Simple, cheap | Slow |
| Multi-node single-process (scale-out) | Simple, medium speed | Expensive |
| Multi-node multi-process (both) | Fast | Expensive, complicated |
