Algorithm 1 Overview of the Proposed Algorithm

Require: $T\leftarrow 0$, $\mathit{L}\leftarrow {\mathrm{zeros}}_{d,m}$, ${\mathit{G}}_x\leftarrow {\mathrm{zeros}}_{d_x,d}$, $\forall x\in \{1,2,3\}$

Require: ${\mathit{\alpha }}_y$, ${\mathit{s}}_y$ for all pieces of equipment

while $t\le T$ do

Randomly choose a piece of equipment

Identify the group of the chosen equipment as $x\in \{1,2,3\}$

Obtain interaction history and compute ${\mathbf{\Gamma }}_y$

Update $\mathit{L}$, ${\mathit{G}}_x$ using (12) and (13)

Update ${\mathit{s}}_y$ for device i using (14)

$t\leftarrow t+1$

end while