| Algorithm 3: Computing the Reward |
| Create Supply Curve for from Historical Dataset //Create Supply Curve. = Linear Regression Model for Supply Curve //Construct Linear Regression model. //Predict the responses for different reward levels. = foreach //Construct the each reward’s queuing state variables. end foreach //Compute Lyapunov Optimization constant. //Map data utility weighting U to V foreach [ //Use Lyapunov Optimization to evaluate each reward. /Compute the budget used by this reward. if > then //Check that budget consumption does not exceed set maximum. break end if //Carry out the Lyapunov Optimization computation. = //Compute one-slot conditional Lyapunov drift. = + //Evaluate drift plus penalty expression. if then continue end if //Evaluate the current optimization computation. if then end if end foreach |