| Algorithm 3: LVW-MECO feature selection algorithm |
|
Input: Dataset D containing N classes; feature set F; base classifier (binary classifier) algorithm h in OVO; aggregation strategy s in OVO; stopping condition control parameter T in M-LVW algorithm; and number of binary classifiers to be optimized r Initialization: number of binary classifiers Step 1: Apply the M-LVW algorithm to the k binary classifiers in the OVO setting individually and set the evaluation criterion for the parameter feature subsets as the accuracy of the corresponding binary classifier. This process selects k different feature subsets for the k binary classifiers . Step 2: By applying the 10-fold cross-validation method, the F1 values corresponding to the k binary classifiers are calculated. All binary classifiers are then sorted in ascending order based on their F1 values. Step 3: For j = 1 to r /*Repeat the following Steps 4–5 sequentially for the r binary classifiers with lower F1 values.*/ Step 4: M-LVW algorithm is used for the binary classifier, and the evaluation criterion of its parameter feature subset is set as the F1 value of the binary classifier, and the feature subset is selected for the binary classifier, and is used as the feature set of the binary classifier e. Step 5: The k binary classifiers of are used to form a multi-classifier H with aggregation strategy s; and other binary classifiers , , and a multi-classifier is formed by aggregation strategy s; then, the accuracy of H and is obtained by using the 10-fold cross-verification method. If the accuracy of is greater than H, then , . Output: The subset of features corresponding to each binary classifier in OVO |