build1 publisher
Normalizing text before the hash lookup finds several times more contaminated eval rows
Train/test contamination gets into a fine-tuning set through merges, augmentation and re-scrapes, and the first two checks for it are complete hash lookups with no threshold to tune. The approximation only enters at the near-duplicate stage.
Publishers:dev.to
Reality
- Evidence55
- Adoption
- Insufficient
- Hype gap+15
- Incentives65
- Confidence50