|
Algorithm 1 RCA neural networks based on the IrQL method with event triggering. |
| Set initial value: |
| 1: Set initial values for between ; |
| 2: Set a low level of degree of precision for the calculation . |
| 3: Initialize the score of within
|
| The iterative process: Make . Error calculation at the localized level ; |
| 4: Keep on; |
| 5: Based on actor NN, estimate by
|
| 6: Update the reinforce NN; |
| 7: Via the inputting into the reinforce NN, and we can obtain the |
| estimated the function of IRR via
|
| 8: Obtain by ; |
| 9: Renew the matrices by ; |
| 10: Renew the critic NN: |
| 11: Via the inputting into critic NN, |
| and we can obtain its estimated Q-function via ; |
| 12: Obtain by ; |
| 13: Renew the matrices by ; |
| 14: Renew the actor NN: |
| 15: Input to the actor NN, and we can obtain the estimated Q-function |
|
via
|
| 16: Calculation via
|
| 17: In the event that the triggering conditions are met, renew the matrices |
|
of the actor NN using
|
| 18: Otherwise, do not update the weight matrices
|
| 19: Until ; otherwise, set , then go to |
| procedure
|
| 20: Keep on as the optimal weights. |