Skip to main content
. 2023 Jul 19;23(14):6510. doi: 10.3390/s23146510
FaPTi Forecasted activity with probabilistic and reinforcement learning
FaTi Forecasted activity with reinforcement learning
IoT Internet of things
T Set of time before the forecasted activity start time
X Set of input. The possible response from the user
P Probability level of forecasted activity
S Set of all states
A Set of action possible in the state s
R Set of possible rewards
r Reward
δ The state-transition
π policy, decision-making rule
t time step
St State at t
At Action at t
Rt Reward at t
NF User needs to do the activity
FA User needs the notification
RN The number of activities which is response is now
RL The number of activities which is response is later
RD The number of activities which is response is to dismiss
NR      The number of user responses to the notification
TN Total number of notifications sent
RT The time when the user responds to a notification for each activity
NT The length of time for which the notification appears on the user’s smartphone screen for each activity