Multilabel Classification Using Low-Rank Decomposition

Table 3

Performance of each multilabel algorithm (mean ± std. deviation) on the large-scale datasets.

Comparing algorithms	Slashdot	rcv1subset1	rcv1subset2	rcv1subset3	rcv1subset4	rcv1subset5
One-error ↓
LLRD	0.363 ± 0.026	0.414 ± 0.013	0.411 ± 0.017	0.416 ± 0.029	0.317 ± 0.015	0.401 ± 0.018
MLFE	0.374 ± 0.027	0.406 ± 0.018	0.399 ± 0.013	0.402 ± 0.025	0.328 ± 0.013	0.392 ± 0.008
LIFT	0.393 ± 0.033	0.427 ± 0.011	0.434 ± 0.017	0.441 ± 0.020	0.363 ± 0.019	0.430 ± 0.019
RELIAB	0.508 ± 0.022	0.449 ± 0.015	0.458 ± 0.028	0.454 ± 0.012	0.433 ± 0.024	0.423 ± 0.009
ML^2	0.370 ± 0.025	0.404 ± 0.017	0.395 ± 0.018	0.398 ± 0.021	0.323 ± 0.021	0.388 ± 0.010
CLR	0.965 ± 0.013	0.513 ± 0.022	0.515 ± 0.009	0.518 ± 0.028	0.472 ± 0.031	0.521 ± 0.021
RAKEL	0.602 ± 0.009	0.605 ± 0.013	0.574 ± 0.012	0.585 ± 0.022	0.561 ± 0.022	0.614 ± 0.009
Coverage ↓
LLRD	0.107 ± 0.010	0.125 ± 0.008	0.121 ± 0.009	0.123 ± 0.006	0.092 ± 0.004	0.116 ± 0.009
MLFE	0.126 ± 0.013	0.136 ± 0.005	0.130 ± 0.010	0.129 ± 0.007	0.094 ± 0.007	0.124 ± 0.007
LIFT	0.112 ± 0.008	0.144 ± 0.020	0.135 ± 0.008	0.156 ± 0.008	0.113 ± 0.012	0.148 ± 0.013
RELIAB	0.131 ± 0.007	0.152 ± 0.012	0.128 ± 0.014	0.144 ± 0.011	0.105 ± 0.020	0.131 ± 0.014
ML^2	0.103 ± 0.011	0.138 ± 0.008	0.132 ± 0.010	0.126 ± 0.006	0.078 ± 0.006	0.129 ± 0.009
CLR	0.254 ± 0.003	0.146 ± 0.018	0.141 ± 0.007	0.137 ± 0.010	0.109 ± 0.018	0.136 ± 0.011
RAKEL	0.226 ± 0.020	0.426 ± 0.023	0.372 ± 0.016	0.381 ± 0.014	0.365 ± 0.009	0.388 ± 0.020
Ranking loss ↓
LLRD	0.090 ± 0.010	0.049 ± 0.004	0.050 ± 0.004	0.052 ± 0.002	0.038 ± 0.002	0.047 ± 0.003
MLFE	0.107 ± 0.013	0.052 ± 0.002	0.055 ± 0.007	0.055 ± 0.002	0.040 ± 0.004	0.050 ± 0.003
LIFT	0.098 ± 0.016	0.058 ± 0.007	0.057 ± 0.009	0.068 ± 0.004	0.059 ± 0.010	0.055 ± 0.007
RELIAB	0.124 ± 0.003	0.066 ± 0.010	0.063 ± 0.008	0.062 ± 0.004	0.052 ± 0.006	0.063 ± 0.005
ML^2	0.103 ± 0.012	0.056 ± 0.004	0.057 ± 0.004	0.056 ± 0.003	0.031 ± 0.003	0.050 ± 0.004
CLR	0.237 ± 0.008	0.062 ± 0.011	0.066 ± 0.008	0.065 ± 0.012	0.047 ± 0.006	0.071 ± 0.005
RAKEL	0.211 ± 0.019	0.226 ± 0.019	0.215 ± 0.017	0.230 ± 0.015	0.235 ± 0.014	0.214 ± 0.016
Average precision ↑
LLRD	0.725 ± 0.019	0.611 ± 0.010	0.638 ± 0.011	0.634 ± 0.017	0.717 ± 0.008	0.643 ± 0.011
MLFE	0.712 ± 0.021	0.618 ± 0.016	0.645 ± 0.009	0.639 ± 0.014	0.708 ± 0.012	0.647 ± 0.012
LIFT	0.703 ± 0.010	0.586 ± 0.009	0.598 ± 0.012	0.595 ± 0.011	0.674 ± 0.013	0.598 ± 0.011
RELIAB	0.624 ± 0.014	0.578 ± 0.021	0.611 ± 0.011	0.614 ± 0.018	0.655 ± 0.018	0.604 ± 0.009
ML^2	0.715 ± 0.022	0.621 ± 0.012	0.647 ± 0.013	0.643 ± 0.016	0.717 ± 0.013	0.650 ± 0.010
CLR	0.269 ± 0.002	0.575 ± 0.013	0.584 ± 0.021	0.571 ± 0.032	0.614 ± 0.020	0.588 ± 0.013
RAKEL	0.522 ± 0.020	0.395 ± 0.012	0.445 ± 0.018	0.431 ± 0.014	0.450 ± 0.012	0.437 ± 0.016
Macroaveraging F1 ↑
LLRD	0.427 ± 0.035	0.235 ± 0.020	0.259 ± 0.019	0.213 ± 0.031	0.300 ± 0.019	0.211 ± 0.020
MLFE	0.466 ± 0.035	0.198 ± 0.017	0.195 ± 0.056	0.202 ± 0.030	0.249 ± 0.021	0.204 ± 0.021
LIFT	0.429 ± 0.037	0.223 ± 0.025	0.186 ± 0.024	0.200 ± 0.031	0.238 ± 0.013	0.196 ± 0.031
RELIAB	0.425 ± 0.029	0.342 ± 0.022	0.338 ± 0.016	0.348 ± 0.014	0.342 ± 0.028	0.352 ± 0.014
ML^2	0.472 ± 0.029	0.216 ± 0.020	0.206 ± 0.024	0.195 ± 0.030	0.244 ± 0.023	0.208 ± 0.011
CLR	0.174 ± 0.032	0.285 ± 0.032	0.264 ± 0.021	0.272 ± 0.022	0.311 ± 0.031	0.305 ± 0.017
RAKEL	0.354 ± 0.037	0.269 ± 0.030	0.251 ± 0.014	0.255 ± 0.014	0.263 ± 0.014	0.274 ± 0.018
Microaveraging F1 ↑
LLRD	0.496 ± 0.021	0.393 ± 0.013	0.381 ± 0.017	0.406 ± 0.027	0.470 ± 0.013	0.402 ± 0.018
MLFE	0.545 ± 0.019	0.373 ± 0.014	0.375 ± 0.031	0.392 ± 0.024	0.403 ± 0.020	0.381 ± 0.017
LIFT	0.510 ± 0.030	0.320 ± 0.017	0.353 ± 0.014	0.347 ± 0.018	0.342 ± 0.024	0.363 ± 0.008
RELIAB	0.453 ± 0.011	0.408 ± 0.010	0.449 ± 0.008	0.451 ± 0.021	0.478 ± 0.016	0.454 ± 0.012
ML^2	0.556 ± 0.022	0.371 ± 0.014	0.391 ± 0.010	0.383 ± 0.026	0.393 ± 0.022	0.410 ± 0.015
CLR	0.104 ± 0.005	0.367 ± 0.011	0.368 ± 0.024	0.320 ± 0.024	0.381 ± 0.015	0.372 ± 0.008
RAKEL	0.365 ± 0.020	0.359 ± 0.023	0.348 ± 0.016	0.341 ± 0.016	0.371 ± 0.015	0.342 ± 0.006