MOFSRank: A Multiobjective Evolutionary Algorithm for Feature Selection in Learning to Rank

Table 2

The Comparison Results between MOFSRank and Classical Ranking Algorithms on LETOR Data Sets, Averaged on Five Folds.

	N@1	N@2	N@3	N@4	N@5	N@6	N@7	N@8	N@9	N@10	MAP
NP2004
RankSVM-Primal	0.5600	0.7000	0.7236	0.7662	0.7719	0.7816	0.7864	0.7908	0.7950	0.7950	0.6755
RankSVM-Struct	0.5600	0.7000	0.7321	0.7746	0.7746	0.7843	0.7890	0.7935	0.7977	0.7977	0.6771
ListNet	0.5333	0.7267	0.7587	0.7879	0.7965	0.8037	0.8084	0.8128	0.8128	0.8128	0.6720
AdaRank-NDCG	0.5067	0.6133	0.6722	0.7122	0.7122	0.7225	0.7273	0.7384	0.7384	0.7384	0.6269
MOFSRank	0.5547	0.8000	0.8218	0.8411	0.8466	0.8505	0.8514	0.8518	0.8543	0.8543	0.7064
HP2004
RankSVM-Primal	0.5733	0.6867	0.7129	0.7413	0.7528	0.7683	0.7706	0.7706	0.7720	0.7720	0.6715
RankSVM-Struct	0.5867	0.6733	0.7248	0.7465	0.7523	0.7652	0.7652	0.7666	0.7666	0.7666	0.6784
ListNet	0.6000	0.6867	0.7213	0.7618	0.7694	0.7797	0.7845	0.7845	0.7845	0.7845	0.6899
AdaRank-NDCG	0.5867	0.7333	0.7512	0.7862	0.7920	0.7971	0.7971	0.8016	0.8037	0.8057	0.6914
MOFSRank	0.6720	0.8080	0.8343	0.8406	0.8477	0.8508	0.8541	0.8585	0.8594	0.8622	0.7614
TD2004
RankSVM-Primal	0.3067	0.3067	0.3131	0.3026	0.3062	0.3003	0.2951	0.2921	0.2942	0.2913	0.2061
RankSVM-Struct	0.3467	0.3467	0.3371	0.3287	0.3192	0.3129	0.3102	0.3146	0.3084	0.309	0.2196
ListNet	0.3600	0.3467	0.3573	0.3469	0.3325	0.327	0.3251	0.3206	0.3188	0.3175	0.2231
AdaRank-NDCG	0.4267	0.3800	0.3688	0.3524	0.3514	0.3376	0.3297	0.3284	0.3212	0.3163	0.1936
MOFSRank	0.4533	0.4467	0.4105	0.3901	0.3795	0.3711	0.3616	0.3579	0.3551	0.3560	0.2427
MQ2008
RankSVM-Primal	0.3725	0.4065	0.4333	0.4566	0.4765	0.4893	0.4940	0.4604	0.2263	0.2309	0.4744
RankSVM-Struct	0.3626	0.3984	0.4285	0.4508	0.4695	0.4851	0.4905	0.4564	0.2239	0.2279	0.4785
ListNet	0.3754	0.4112	0.4324	0.4568	0.4747	0.4894	0.4978	0.4630	0.2265	0.2303	0.4833
AdaRank-NDCG	0.3826	0.4211	0.4420	0.4653	0.4821	0.4948	0.4993	0.4636	0.2270	0.2307	0.4763
MOFSRank	0.3957	0.4300	0.4521	0.4718	0.4888	0.5021	0.5064	0.4700	0.2360	0.2406	0.4867
OHSUMED
RankSVM-Primal	0.5460	0.5010	0.4855	0.4766	0.4689	0.4552	0.4534	0.4500	0.4490	0.4504	0.4447
RankSVM-Struct	0.5515	0.5000	0.4850	0.4820	0.4729	0.4584	0.4570	0.4587	0.4568	0.4523	0.4478
ListNet	0.5326	0.4810	0.4732	0.4561	0.4432	0.4400	0.4409	0.4460	0.4459	0.4410	0.4457
AdaRank-NDCG	0.5330	0.4922	0.4790	0.4688	0.4673	0.4597	0.4596	0.4575	0.4541	0.4496	0.4498
MOFSRank	0.5707	0.5353	0.5144	0.4970	0.4872	0.4774	0.4719	0.4676	0.4646	0.4641	0.4489