build1 publisher
Twelve of 500 byte-identical temperature-0 requests came back different
Greedy sampling picks the top token every time, but the arithmetic that decides which token is on top depends on the shape of the batch you were pooled into, and you do not pick your batch.
Publishers:dev.to
Reality
- Evidence45
- Adoption
- Insufficient
- Hype gap+15
- Incentives25
- Confidence