Debugging distributed systems

Techniques for locating faults across network boundaries, such as varying one condition at a time, inspecting traffic on the wire, and building minimal reproductions that cannot contain the suspected bug.