ranxhub

A Multi-Domain Benchmark for Personalized Search Evaluation

You can find more information about this dataset here.

The search function inspect all the metadata, even those not displayed!

Computer Science - Test Set

Name RanxHub ID MAP@100 MRR@10 NDCG@10 Full-text
BM25 + Mean amdbfpse/cs/test/ikr3/bm25-mean 0.1636935998097666 0.5457174984302889 0.26693194077061083 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + QA amdbfpse/cs/test/ikr3/bm25-qa 0.17876602135476927 0.5720634187695909 0.2848662607381339 Fine-TunedRe-Ranking PersonalizationQuery-Aware PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc + QA amdbfpse/cs/test/ikr3/bm25-bienc-qa 0.2011139936470018 0.611702226424406 0.3114890530969009 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc + Mean amdbfpse/cs/test/ikr3/bm25-bienc-mean 0.19922398305702083 0.6064014893320726 0.30804085426805106 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc amdbfpse/cs/test/ikr3/bm25-bienc 0.18208265233091048 0.5801722284522038 0.2890459287641638 Fine-TunedRe-Ranking Neural NetworkDeep LearningTransformer
BM25 amdbfpse/cs/test/ikr3/bm25 0.12250016476373904 0.4892777741130827 0.2245485237683848 Fine-TunedRetrieval ClassicProbabilistic

Physics - Test Set

Name RanxHub ID MAP@100 MRR@10 NDCG@10 Full-text
BM25 + Mean amdbfpse/phy/test/ikr3/bm25-mean 0.16436778539149025 0.5905328531035411 0.3118272928976512 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + QA amdbfpse/phy/test/ikr3/bm25-qa 0.17465504229949197 0.61797576659735 0.32718243674300546 Fine-TunedRe-Ranking PersonalizationQuery-Aware PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc + QA amdbfpse/phy/test/ikr3/bm25-bienc-qa 0.18976694037573183 0.6477969520617965 0.34814058456884617 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc + Mean amdbfpse/phy/test/ikr3/bm25-bienc-mean 0.189065706936736 0.6387980042786828 0.3450915861077577 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc amdbfpse/phy/test/ikr3/bm25-bienc 0.16977473892792513 0.6098794314039366 0.3213257374925779 Fine-TunedRe-Ranking Neural NetworkDeep LearningTransformer
BM25 amdbfpse/phy/test/ikr3/bm25 0.1276927071918605 0.5368405567274559 0.26877746678031655 Fine-TunedRetrieval ClassicProbabilistic

Political Science - Test Set

Name RanxHub ID MAP@100 MRR@10 NDCG@10 Full-text
BM25 + Mean amdbfpse/ps/test/ikr3/bm25-mean 0.16606392263180822 0.5504912580371898 0.2757958500464659 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + QA amdbfpse/ps/test/ikr3/bm25-qa 0.17692692719179504 0.5758198975128109 0.28939069631406383 Fine-TunedRe-Ranking PersonalizationQuery-Aware PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc + QA amdbfpse/ps/test/ikr3/bm25-bienc-qa 0.19847290025838638 0.6119980141371217 0.3141345189563284 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc + Mean amdbfpse/ps/test/ikr3/bm25-bienc-mean 0.19260206390101886 0.5976369620464109 0.3062581536089432 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc amdbfpse/ps/test/ikr3/bm25-bienc 0.18149917241446284 0.5763522615228652 0.29246081287402176 Fine-TunedRe-Ranking Neural NetworkDeep LearningTransformer
BM25 amdbfpse/ps/test/ikr3/bm25 0.13270557820444512 0.5022926300879057 0.24073239996931844 Fine-TunedRetrieval ClassicProbabilistic

Psychology - Test Set

Name RanxHub ID MAP@100 MRR@10 NDCG@10 Full-text
BM25 + Mean amdbfpse/psy/test/ikr3/bm25-mean 0.16728786078852065 0.5704587144428728 0.2841569572561065 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + QA amdbfpse/psy/test/ikr3/bm25-qa 0.1889963155598133 0.609194970925664 0.31121984213828263 Fine-TunedRe-Ranking PersonalizationQuery-Aware PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc + QA amdbfpse/psy/test/ikr3/bm25-bienc-qa 0.21992412419980886 0.6561634449159203 0.34848047166109536 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc + Mean amdbfpse/psy/test/ikr3/bm25-bienc-mean 0.21974948121187401 0.6521017130284457 0.3470874949797735 Fine-TunedRe-Ranking PersonalizationLong-Term PersonalizationNeural NetworkDeep LearningTransformer
BM25 + BiEnc amdbfpse/psy/test/ikr3/bm25-bienc 0.20722043079600103 0.6341126512651265 0.3310706521762829 Fine-TunedRe-Ranking Neural NetworkDeep LearningTransformer
BM25 amdbfpse/psy/test/ikr3/bm25 0.1257721574187849 0.5118687097281156 0.23932599259309442 Fine-TunedRetrieval ClassicProbabilistic