Skip to main content
. 2018 Aug 30;12:45. doi: 10.3389/fnbot.2018.00045
This article Friston et al. (2016b) Note
etE Actual environment states
e^tE^ stS Estimated/modeled environment states
stS ot ∈ Ω Actual/observed sensor or outcome values
s^tS^=S ot ∈ Ω Estimated/modeled (usually future) sensor or outcome values. Note that the index τ instead of t often indicates an estimated future sensor value in Friston et al. (2015).
atA utA Actions
a^tA^=A ut ∈ Υ Contemplated (usually future) actions
mtM Agent memory state
a^0:T^ π, action sequences
θ θ Generative model parameters
θ1 A Sensor dynamics param.
θ2 B Environment dynamics param.
θ3 D Initial environment state param.
ξ η Generative model hyperparam. or model parameter that subsumes all hyperparameters
ξ1 a sensor dynamics hyperparam.
ξ2 b Environment dynamics hyperparam.
ξ3 d Initial environment state hyperparam.
ξΓ β Precision hyperparam.
(ϕ, ϕΓ) η Variational param.
ϕE0:T^ s0:T Environment states variational param.
q(e^τ|a^t:T^,a0:t-1,ϕEτ) (sτπ)e^τ For each sequence of actions and for each timestep there is a parameter sτπ. Since a categorical distribution is used, the parameter is a vector of probabilities whose entry êτ is equal to the probability of êτ if we set E^={1,,|E^|}
ϕ1 a Sensor dynamics variational param.
ϕ2 b Environment dynamics variational param.
ϕ3 d Initial environment state variational param.
π π Future action sequence variational param.
ϕΓ β Precision variational param.
Q^(a^t:T^,ϕ) G(π) Variational action-value function. The dependence of G(π) on s0:Tπ is omitted
p(st, et, at) R(õ,s~,ã) Our physical environment corresponds to the generative process
q(s^t,e^0:T^,a^0:T^,γ,θ,ξ) P(õ,s~,π,γ,A,B,D|a,b,d,β) The generative model for active inference
r(e^0:T^,a^0:T^,γ,θ|π,ϕΓ,ϕ) Q(s~,π,A,B,D,γ|s0:T^π,π,a,b,d,β) Approximate complete posterior for active inference
pd(s^τ) P(oτ) = σ(Uτ) Prior over future outcomes.