Prompt and Payload Retention

Hundreds of 200 OKs a day hid an agent inventing tracking numbers for three weeks

The logs held request, model call, response and status code, which is exactly the field set that cannot show an empty retrieval chunk. A span carrying the payload and the model version can, at a cost in storage and in what you are then holding about customers.