Training-Free Inference-Time Methods

SciCon subtracts the text-only score at decode time to stop figure QA from guessing

A preprint argues multimodal models pick scientifically plausible answer text over figure evidence, and that discounting the text-only score during decoding improves accuracy without retraining.