Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Summary of investigated large language models.
| Model | Author | Release year | Size (# of parameters) | RLHF |
|---|---|---|---|---|
| Grover | Zellers et al.26 | 2019 | 1.5B | No |
| GPT-2 | OpenAI | 2019 | 774M | No |
| GPT-3-curie | OpenAI | 2020 | 13B | No |
| GPT-3-davinci | OpenAI | 2020 | 175B | No |
| ChatGPT | OpenAI | 2022 | 175B | Yes |
| Cohere | Cohere | 2022 | 52.4B | – |
| LLaMA-7B | Meta | 2023 | 7B | No |
Cohere does not disclose whether its LLM includes RLHF.
