Skip to main content
. 2023 Feb 5;25(2):299. doi: 10.3390/e25020299
Algorithm 1 RCA neural networks based on the IrQL method with event triggering.
Set initial value:
1: Set initial values for ωr2i(0),ωa2i(0),ωc2i(0) between (0,1);
2: Set a low level of degree of precision for the calculation E.
3: Initialize the score of xi(0),x0(0) within (0,1)
The iterative process: Make kisequalto0. Error calculation at the localized level ei(k);
4: Keep on;
5: Based on actor NN, estimate u^i(k) by (37)
6: Update the reinforce NN;
7: Via the inputting [ei(k),ui(k),ui(k)] into the reinforce NN, and we can obtain the
estimated the function of IRR Ri(Zri(k)) via (27)
8: Obtain eri(k) by (28);
9: Renew the matrices ωr2i(k) by (31);
10: Renew the critic NN:
11: Via the inputting [R^i(Zri(k)),ei(k),ui(k),andui(k)] into critic NN,
and we can obtain its estimated Q-function via (32);
12: Obtain eci(k) by (33);
13: Renew the matrices ωc2i(k) by (36);
14: Renew the actor NN:
15: Input [ei(k)] to the actor NN, and we can obtain the estimated Q-function
u^i(k) via (37)
16: Calculation eai(k) via (38)
17: In the event that the triggering conditions are met, renew the matrices
ωa2i(k) of the actor NN using (41)
18: Otherwise, do not update the weight matrices ωa2i(k)
19: Until ωc2i(k+1)ωc2i(k)E; otherwise, set k=k+1, then go to
procedure (5)
20: Keep on ωr2i(k),ωc2i(k),ωa2i(k) as the optimal weights.