P1-Retrieved Results Cache

[ronakice]

Provide important cached retrieve results as well as rerank results hosted elsewhere but documented here. I can perhaps do this sometime.

[sahel-sh]

@ronakice it seems like you are looking for volunteers for this one, I unassigned it so that people can pick

[ronakice]

Updating this with the following link: https://github.com/castorini/rank_llm_data

[ronakice]

Please interface with this!

[AndreSlavescu]

interested

[ronakice]

Something like:

If it exists and matches md5 use it, else get it from rank_llm_data if there, else run retrieve.

Eventually, the rerank_results can be added to rank_llm_data too for verification. But not priority for now. This will likely fall into place after we have a nice 2CR after #32 is mature

[ronakice]

This is super important so bumping to P1. More people want to repro the baselines before jumping into their own dataset and making them download SPLADE indexes every time is probably not optimal