build1 distinct publisher
Splitting log templates from variables cut Uber's HDFS bill to $10K a year
Uber reported 169:1 on 200TB of Spark logs a day by separating static templates from variable fields before anything was written to HDFS. Whether that ratio transfers depends on how few call sites your lines come from.
Publishers:dev.to
Reality
- Evidence45
- Adoption32
- Hype gap+20
- Incentives
- Insufficient
- Confidence