Diffusion Model Inference

A 1.1-second fixed overhead pushes caption-driven TTS out of the conversational path

A dev.to writeup put caption-driven diffusion TTS against a Style-Bert-VITS2 baseline on the same GPU slice and found a fixed overhead that alone exceeds the baseline's entire generation time, so the model moved offline.