BM25 lost worst on the queries full of file paths. In 54% of them, the path is not in the answer
A CQADupStack benchmark reports dense retrieval beating BM25 by more on identifier-bearing queries than on the rest, because the identifier is often absent from the documents that answer them.
Reality
- Evidence62
- Adoption
- Insufficient
- Hype gap+12
- Incentives42
- Confidence54