MSMARCO Passage Ranking
You can find more information about this dataset here.
The search function inspect all the metadata, even those not displayed!
To reproduce TREC DL 2019 and TREC DL 2020 with ranx you must set the relevance level of binary metrics to 2, e.g., "map@1000-l2".
Dev Set
| Name | RanxHub ID | MRR@10 | MAP@1000 | Recall@1000 | Full-text |
|---|---|---|---|---|---|
| DistilSPLADE-max | msmarco-passage/dev/ranxhub/distilsplade-max |
0.36843214172010735 | 0.37456825687555095 | 0.9787249283667622 | Retrieval Sparse RepresentationKnowledge Distillation |
| DistilBERT KD | msmarco-passage/dev/ranxhub/distilbert-kd |
0.32500119388729704 | 0.33078731041995807 | 0.9552650429799427 | Retrieval Dense RetrievalKnowledge DistillationDistilBERT |
| DistilBERT KD TASB | msmarco-passage/dev/ranxhub/distilbert-kd-tasb |
0.34428110929185424 | 0.3513913575391264 | 0.977101241642789 | Retrieval Dense RetrievalKnowledge DistillationDistilBERT |
| TCT-ColBERT-V2-HN+ | msmarco-passage/dev/ranxhub/tct-colbert-v2-hn+ |
0.35842099877200156 | 0.3644447389275738 | 0.9694603629417384 | Retrieval Dense RetrievalKnowledge DistillationBERT |
| SLIM | msmarco-passage/dev/ranxhub/slim |
0.3581149656615273 | 0.3637336833516397 | 0.9620343839541547 | Retrieval Late InteractionsSparse RepresentationsBERT |
| SLIM++ | msmarco-passage/dev/ranxhub/slim++ |
0.4031593668986219 | 0.40819243767807084 | 0.9679918815663803 | Retrieval BERTKnowledge DistillationLate InteractionsSparse Representations |
| ANCE | msmarco-passage/dev/ranxhub/ance |
0.33014502888070213 | 0.33623895943583004 | 0.958655682903534 | Retrieval Single RepresentationDense RetrievalDot ProductBERT |
| UniCOIL | msmarco-passage/dev/ranxhub/unicoil |
0.351552224041479 | 0.3572757316324218 | 0.9581900668576887 | Retrieval Sparse RetrievalTerm Impacts LearningDocument ExpansionBERT |
| BM25 Pyserini | msmarco-passage/dev/ranxhub/bm25-pyserini |
0.18398616227770956 | 0.19255382968353726 | 0.8526146131805158 | Retrieval ClassicProbabilistic |
TREC DL 2019
| Name | RanxHub ID | NDCG@10 | MAP@1000 | Recall@1000 | Full-text |
|---|---|---|---|---|---|
| DistilSPLADE-max | msmarco-passage/trec-dl-2019/ranxhub/distilsplade-max |
0.7280431302103255 | 0.48480225516986203 | 0.8654281615352637 | Retrieval Sparse RepresentationKnowledge Distillation |
| DistilBERT KD | msmarco-passage/trec-dl-2019/ranxhub/distilbert-kd |
0.6994296896841119 | 0.4052535407823343 | 0.7652937677433573 | Retrieval Dense RetrievalKnowledge DistillationDistilBERT |
| DistilBERT KD TASB | msmarco-passage/trec-dl-2019/ranxhub/distilbert-kd-tasb |
0.7210329462852862 | 0.4589655995972589 | 0.8406351026610451 | Retrieval Dense RetrievalKnowledge DistillationDistilBERT |
| TCT-ColBERT-V2-HN+ | msmarco-passage/trec-dl-2019/ranxhub/tct-colbert-v2-hn+ |
0.7203592714500755 | 0.446870052693327 | 0.8260529421972208 | Retrieval Dense RetrievalKnowledge DistillationBERT |
| SLIM | msmarco-passage/trec-dl-2019/ranxhub/slim |
0.7009591167340055 | 0.45092329607459053 | 0.8240820187876271 | Retrieval Late InteractionsSparse RepresentationsBERT |
| SLIM++ | msmarco-passage/trec-dl-2019/ranxhub/slim++ |
0.714007207425965 | 0.46872873483541133 | 0.8415337525361667 | Retrieval BERTKnowledge DistillationLate InteractionsSparse Representations |
| ANCE | msmarco-passage/trec-dl-2019/ranxhub/ance |
0.6452034248972228 | 0.37101234992328763 | 0.7554035729754223 | Retrieval Single RepresentationDense RetrievalDot ProductBERT |
| UniCOIL | msmarco-passage/trec-dl-2019/ranxhub/unicoil |
0.7024015043239907 | 0.46124777344582546 | 0.8292154975382996 | Retrieval Sparse RetrievalTerm Impacts LearningDocument ExpansionBERT |
| BM25 Pyserini | msmarco-passage/dev/trec-dl-2019/bm25-pyserini |
0.5058310024399073 | 0.30128558071075273 | 0.7501450319499805 | Retrieval ClassicProbabilistic |
TREC DL 2020
| Name | RanxHub ID | NDCG@10 | MAP@1000 | Recall@1000 | Full-text |
|---|---|---|---|---|---|
| DistilSPLADE-max | msmarco-passage/trec-dl-2020/ranxhub/distilsplade-max |
0.7104728592149189 | 0.4896753769901523 | 0.8906994463915417 | Retrieval Sparse RepresentationKnowledge Distillation |
| DistilBERT KD | msmarco-passage/trec-dl-2020/ranxhub/distilbert-kd |
0.6446694985165204 | 0.41588803860428253 | 0.795297885501652 | Retrieval Dense RetrievalKnowledge DistillationDistilBERT |
| DistilBERT KD TASB | msmarco-passage/trec-dl-2020/ranxhub/distilbert-kd-tasb |
0.6853606924858654 | 0.46980015057307795 | 0.8726546234053667 | Retrieval Dense RetrievalKnowledge DistillationDistilBERT |
| TCT-ColBERT-V2-HN+ | msmarco-passage/trec-dl-2020/ranxhub/tct-colbert-v2-hn+ |
0.6882393744726825 | 0.4754120714070939 | 0.842946385272863 | Retrieval Dense RetrievalKnowledge DistillationBERT |
| SLIM | msmarco-passage/trec-dl-2020/ranxhub/slim |
0.6403123403278427 | 0.44188777168549054 | 0.8542621067515406 | Retrieval Late InteractionsSparse RepresentationsBERT |
| SLIM++ | msmarco-passage/trec-dl-2020/ranxhub/slim++ |
0.7021451024094133 | 0.49063745716330454 | 0.8550606933791138 | Retrieval BERTKnowledge DistillationLate InteractionsSparse Representations |
| ANCE | msmarco-passage/trec-dl-2020/ranxhub/ance |
0.6457601052924431 | 0.40766564067193684 | 0.7764298079709676 | Retrieval Single RepresentationDense RetrievalDot ProductBERT |
| UniCOIL | msmarco-passage/trec-dl-2020/ranxhub/unicoil |
0.6745099354378765 | 0.4429593433742214 | 0.8430300560787803 | Retrieval Sparse RetrievalTerm Impacts LearningDocument ExpansionBERT |
| BM25 Pyserini | msmarco-passage/trec-dl-2020/ranxhub/bm25-pyserini |
0.4796366724252675 | 0.28560193692877245 | 0.786322367361522 | Retrieval ClassicProbabilistic |