| Expected value of action | 1V1 |
| Expected value of action | V2 |
| Chosen action | Ai (either A1 or A2) |
| Reward received | r |
| Prediction error (having chosen Ai) | δ= r—Vi |
| Learning rate | α |
| Updated expected values: | |
| Chosen action | AiVi → Vi + αδ |
| Unchosen action | AjVj → Vj |
Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.