Multilabel Classification Using Low-Rank Decomposition

Table 2

Performance of each multilabel algorithm (mean ± std. deviation) on the regular-scale datasets.

Comparing algorithms	cal500	Emotions	Medical	Llog	Image	Scene	Yeast
One-error ↓
LLRD	0.136 ± 0.041	0.248 ± 0.048	0.125 ± 0.031	0.657 ± 0.038	0.244 ± 0.018	0.116 ± 0.019	0.217 ± 0.013
MLFE	0.168 ± 0.049	0.259 ± 0.050	0.131 ± 0.030	0.672 ± 0.041	0.257 ± 0.031	0.127 ± 0.022	0.233 ± 0.026
LIFT	0.125 ± 0.049	0.251 ± 0.027	0.156 ± 0.041	0.664 ± 0.034	0.276 ± 0.026	0.132 ± 0.012	0.226 ± 0.021
RELIAB	0.116 ± 0.030	0.255 ± 0.041	0.163 ± 0.028	0.754 ± 0.035	0.342 ± 0.032	0.258 ± 0.011	0.255 ± 0.016
ML^2	0.201 ± 0.090	0.261 ± 0.045	0.135 ± 0.032	0.674 ± 0.051	0.260 ± 0.027	0.144 ± 0.019	0.246 ± 0.034
CLR	0.243 ± 0.058	0.310 ± 0.019	0.362 ± 0.009	0.841 ± 0.036	0.449 ± 0.013	0.331 ± 0.031	0.234 ± 0.022
RAKEL	0.622 ± 0.065	0.289 ± 0.032	0.237 ± 0.032	0.871 ± 0.028	0.397 ± 0.019	0.314 ± 0.030	0.291 ± 0.031
Coverage ↓
LLRD	0.774 ± 0.021	0.282 ± 0.034	0.029 ± 0.009	0.194 ± 0.025	0.157 ± 0.010	0.008 ± 0.009	0.447 ± 0.010
MLFE	0.769 ± 0.024	0.283 ± 0.030	0.033 ± 0.010	0.200 ± 0.027	0.162 ± 0.018	0.012 ± 0.008	0.449 ± 0.011
LIFT	0.753 ± 0.015	0.271 ± 0.023	0.040 ± 0.014	0.164 ± 0.007	0.172 ± 0.013	0.026 ± 0.007	0.454 ± 0.017
RELIAB	0.746 ± 0.019	0.306 ± 0.020	0.044 ± 0.013	0.155 ± 0.013	0.185 ± 0.007	0.114 ± 0.004	0.457 ± 0.015
ML^2	0.814 ± 0.033	0.292 ± 0.044	0.035 ± 0.013	0.201 ± 0.026	0.164 ± 0.009	0.010 ± 0.007	0.461 ± 0.016
CLR	0.789 ± 0.010	0.330 ± 0.011	0.073 ± 0.041	0.182 ± 0.050	0.233 ± 0.017	0.122 ± 0.011	0.484 ± 0.020
RAKEL	0.958 ± 0.011	0.335 ± 0.031	0.077 ± 0.014	0.332 ± 0.021	0.249 ± 0.006	0.161 ± 0.007	0.553 ± 0.016
Ranking loss ↓
LLRD	0.185 ± 0.011	0.144 ± 0.028	0.018 ± 0.007	0.185 ± 0.022	0.129 ± 0.010	0.042 ± 0.008	0.163 ± 0.008
MLFE	0.188 ± 0.010	0.146 ± 0.030	0.014 ± 0.007	0.191 ± 0.025	0.134 ± 0.017	0.046 ± 0.010	0.167 ± 0.011
LIFT	0.178 ± 0.008	0.144 ± 0.026	0.029 ± 0.009	0.148 ± 0.014	0.148 ± 0.012	0.054 ± 0.015	0.164 ± 0.013
RELIAB	0.182 ± 0.007	0.165 ± 0.021	0.026 ± 0.008	0.134 ± 0.011	0.176 ± 0.008	0.076 ± 0.007	0.185 ± 0.021
ML^2	0.205 ± 0.021	0.153 ± 0.033	0.011 ± 0.009	0.194 ± 0.027	0.136 ± 0.012	0.050 ± 0.007	0.175 ± 0.015
CLR	0.231 ± 0.020	0.181 ± 0.020	0.072 ± 0.051	0.137 ± 0.028	0.241 ± 0.015	0.098 ± 0.021	0.196 ± 0.009
RAKEL	0.359 ± 0.012	0.213 ± 0.019	0.066 ± 0.019	0.281 ± 0.034	0.244 ± 0.016	0.155 ± 0.023	0.243 ± 0.010
Average precision ↑
LLRD	0.506 ± 0.018	0.819 ± 0.031	0.905 ± 0.020	0.421 ± 0.033	0.841 ± 0.009	0.934 ± 0.010	0.775 ± 0.008
MLFE	0.490 ± 0.017	0.812 ± 0.032	0.901 ± 0.021	0.410 ± 0.029	0.835 ± 0.019	0.928 ± 0.013	0.766 ± 0.016
LIFT	0.502 ± 0.021	0.824 ± 0.024	0.880 ± 0.030	0.416 ± 0.031	0.820 ± 0.018	0.922 ± 0.008	0.768 ± 0.018
RELIAB	0.497 ± 0.016	0.801 ± 0.021	0.869 ± 0.020	0.405 ± 0.041	0.781 ± 0.009	0.851 ± 0.008	0.751 ± 0.010
ML^2	0.481 ± 0.030	0.816 ± 0.031	0.898 ± 0.022	0.404 ± 0.031	0.832 ± 0.014	0.930 ± 0.009	0.759 ± 0.020
CLR	0.425 ± 0.034	0.770 ± 0.019	0.695 ± 0.032	0.312 ± 0.059	0.722 ± 0.015	0.801 ± 0.012	0.755 ± 0.006
RAKEL	0.343 ± 0.009	0.772 ± 0.037	0.798 ± 0.018	0.228 ± 0.020	0.731 ± 0.017	0.777 ± 0.023	0.717 ± 0.007
Macroaveraging F1 ↑
LLRD	0.231 ± 0.026	0.676 ± 0.051	0.736 ± 0.050	0.408 ± 0.028	0.666 ± 0.024	0.800 ± 0.016	0.420 ± 0.030
MLFE	0.239 ± 0.025	0.668 ± 0.050	0.702 ± 0.056	0.415 ± 0.041	0.655 ± 0.021	0.787 ± 0.015	0.430 ± 0.024
LIFT	0.179 ± 0.014	0.651 ± 0.035	0.694 ± 0.052	0.392 ± 0.045	0.624 ± 0.033	0.788 ± 0.018	0.377 ± 0.019
RELIAB	0.288 ± 0.015	0.639 ± 0.038	0.686 ± 0.058	0.394 ± 0.031	0.568 ± 0.030	0.671 ± 0.021	0.409 ± 0.023
ML^2	0.226 ± 0.024	0.656 ± 0.045	0.686 ± 0.058	0.382 ± 0.035	0.652 ± 0.018	0.783 ± 0.015	0.438 ± 0.017
CLR	0.220 ± 0.017	0.604 ± 0.032	0.616 ± 0.118	0.402 ± 0.056	0.523 ± 0.027	0.635 ± 0.013	0.386 ± 0.016
RAKEL	0.195 ± 0.010	0.615 ± 0.030	0.679 ± 0.037	0.377 ± 0.054	0.545 ± 0.018	0.654 ± 0.012	0.441 ± 0.011
Microaveraging F1 ↑
LLRD	0.325 ± 0.011	0.692 ± 0.048	0.814 ± 0.030	0.126 ± 0.027	0.665 ± 0.024	0.792 ± 0.017	0.656 ± 0.011
MLFE	0.384 ± 0.017	0.683 ± 0.047	0.785 ± 0.031	0.137 ± 0.032	0.653 ± 0.024	0.781 ± 0.015	0.643 ± 0.013
LIFT	0.313 ± 0.013	0.664 ± 0.015	0.763 ± 0.031	0.168 ± 0.034	0.625 ± 0.031	0.779 ± 0.022	0.650 ± 0.016
RELIAB	0.454 ± 0.011	0.647 ± 0.038	0.748 ± 0.024	0.188 ± 0.028	0.562 ± 0.021	0.639 ± 0.013	0.631 ± 0.015
ML^2	0.366 ± 0.013	0.674 ± 0.042	0.780 ± 0.021	0.074 ± 0.031	0.650 ± 0.019	0.776 ± 0.018	0.635 ± 0.018
CLR	0.330 ± 0.012	0.626 ± 0.029	0.606 ± 0.143	0.165 ± 0.050	0.531 ± 0.008	0.634 ± 0.017	0.623 ± 0.010
RAKEL	0.356 ± 0.025	0.648 ± 0.024	0.669 ± 0.016	0.155 ± 0.019	0.533 ± 0.005	0.645 ± 0.009	0.637 ± 0.011