Route Me If You Can: a benchmark for selecting rewritten queries
A post describes a benchmark designed to make comparisons of query-reformulation selectors reproducible by keeping the queries, rewrites and retrieval results fixed.
TLDR
A post shares Route Me If You Can, a benchmark for comparing systems that select query reformulations. It says the benchmark freezes queries, LLM reformulations, retrieval results and oracle labels for reproducible selector comparisons. The post links to an arXiv paper and the QueryRoute GitHub repository.
Combined views
1.4K
1 Source, first seen 16d ago