nDCG@10, dev queries | ar | bn | en | es | fa | fi | fr | hi | id | ja | ko | ru | sw | te | th | zh | avg | ||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
BM25 | 0.481 | 0.508 | 0.351 | 0.319 | 0.333 | 0.551 | 0.183 | 0.458 | 0.449 | 0.369 | 0.419 | 0.334 | 0.383 | 0.494 | 0.484 | 0.180 | 0.393 | ||
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
|
|||||||||||||||||||
mDPR (tied encoders), pre-FT w/ MS MARCO | 0.499 | 0.443 | 0.394 | 0.478 | 0.480 | 0.472 | 0.435 | 0.383 | 0.272 | 0.439 | 0.419 | 0.407 | 0.299 | 0.356 | 0.358 | 0.512 | 0.415 | ||
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
|
Recall@100, dev queries | ar | bn | en | es | fa | fi | fr | hi | id | ja | ko | ru | sw | te | th | zh | avg | ||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
BM25 | 0.889 | 0.909 | 0.819 | 0.702 | 0.731 | 0.891 | 0.653 | 0.868 | 0.904 | 0.805 | 0.783 | 0.661 | 0.701 | 0.831 | 0.887 | 0.560 | 0.787 | ||
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
|
|||||||||||||||||||
mDPR (tied encoders), pre-FT w/ MS MARCO | 0.841 | 0.819 | 0.768 | 0.864 | 0.898 | 0.788 | 0.915 | 0.776 | 0.573 | 0.825 | 0.737 | 0.797 | 0.616 | 0.762 | 0.678 | 0.944 | 0.788 | ||
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
Command to generate run:
Evaluation commands:
|