Vision transformers

A 20x backbone-to-head learning rate gap only pays when the checkpoint solves a different task

A dev.to write-up gives DEIMv2's DINOv3 backbone 5e-6 and its decoder head 1e-4 while fine-tuning a face detector, then explains why a second detector from the same week kept one global learning rate.