Table 1.
Model components and their characteristics
| Component | 3- and 4-State* (Figs. 3-4) |
Visit-State (Fig. 7A) |
Hidden Markov (HMM; Fig. 7B) |
Partially Hidden Markov (PHMM; Fig. 9) |
Nonstationary PHMM (nPHMM) |
|---|---|---|---|---|---|
| States and Outputs | |||||
| D (disengagement)* | Observable State | Observable State | Hidden State | Hidden State | Hidden State |
| R (response) | Observable State | Observable State | Observable Output | Observable Output | Observable Output |
| V (visit) | --- | Observable State | Hidden State | Hidden State | Hidden State |
| C (consumption) | Observable State | Observable State | Hidden State | Hidden State | Hidden State |
| Transition and Output Probabilities | |||||
| b (D → R) | Fixed | --- | --- | --- | --- |
| b (D → V) | --- | Fixed | Fixed | Fixed | Dynamic |
| c (R → C) | Fixed | Fixed | --- | --- | --- |
| c (V → C) | --- | --- | Fixed | May depend on R | May depend on R |
| d (R → D) | Zero | --- | --- | --- | --- |
| d (V → O) | --- | Fixed | Fixed | Fixed | Dynamic |
| w (V → R) | --- | Fixed | Fixed | Fixed | Dynamic |
| q (D → R) | --- | --- | --- | Fixed | Dynamic |
*
In the 4-state model, D is split into two states, D1 and D2.