Statistical Tests

ranx provides two statistical tests that can be used when comparing different runs:

• Fisher's Randomization Test
• Two-sided Paired Student's t-Test

Please, refer to Smucker et al. for additional information on statistical tests for Information Retrieval.

To use the Fisher's Randomization Test, pass stat_test="fisher" to compare.

To use the Two-sided Paired Student's t-Test, pass stat_test="student" to compare.