Table 3 Average performance metrics of the 3-repeated 5-fold cross-validation strategy for different classifiers (ACC, F1, REC, and PRE values are given as percentages (%) and the ET unit is s.)
Classifier | Train | Validation | |||||||
|---|---|---|---|---|---|---|---|---|---|
ACC | AUC | ACC | AUC | F1 | REC | PRE | ET | p-value | |
LR | 77.60 | 0.85 | 66.60 | 0.71 | 66.20 | 66.55 | 67.40 | 0.76 | .803 |
LDA | 80.25 | 0.88 | 68.25 | 0.73 | 68.00 | 68.25 | 69.20 | 1.56 | .544 |
GPC | 99.00 | 1.00 | 73.95 | 0.80 | 73.75 | 73.90 | 74.75 | 3.68 | \(<.005\) |
XGBC | 100.00 | 1.00 | 72.80 | 0.81 | 72.40 | 72.85 | 74.10 | 3.95 | .017 |
LGBMC | 99.75 | 1.00 | 75.75 | 0.82 | 75.30 | 75.65 | 77.40 | 1.68 | \(<.005\) |
KNN | 81.95 | 0.90 | 72.85 | 0.77 | 72.50 | 72.75 | 74.05 | 1.05 | .017 |
DTC | 100.00 | 1.00 | 70.45 | 0.70 | 70.25 | 70.45 | 70.95 | 0.69 | .237 |
ETC | 100.00 | 1.00 | 63.80 | 0.64 | 63.40 | 63.80 | 64.55 | 0.66 | .972 |
GNB | 70.20 | 0.81 | 61.80 | 0.71 | 60.75 | 61.85 | 62.75 | 0.69 | \(>.999\) |
BNB | 71.45 | 0.77 | 65.90 | 0.70 | 65.15 | 65.80 | 66.35 | 0.70 | .868 |
SVM | 74.65 | 0.81 | 68.85 | 0.72 | 67.95 | 68.75 | 70.35 | 1.73 | .447 |
BC | 97.90 | 1.00 | 74.15 | 0.80 | 73.80 | 74.30 | 75.25 | 1.42 | \(<.005\) |
ABC | 85.65 | 0.94 | 70.15 | 0.78 | 69.15 | 70.20 | 72.10 | 3.63 | .252 |
HGBC | 99.80 | 1.00 | 74.70 | 0.82 | 74.30 | 74.70 | 76.20 | 13.49 | \(<.005\) |
RFC | 100.00 | 1.00 | 75.00 | 0.82 | 74.65 | 74.95 | 75.95 | 5.77 | \(<.005\) |
GBC | 96.95 | 0.99 | 69.55 | 0.81 | 68.90 | 69.60 | 70.75 | 3.39 | .333 |
MLPC | 97.25 | 1.00 | 75.25 | 0.77 | 75.00 | 75.30 | 76.70 | 28.44 | \(<.005\) |