Skip to content

Topic

LoRA Fine-Tuning

A parameter-efficient fine-tuning method that trains small low-rank adapter weights layered atop a frozen base model instead of updating all its parameters.

Current stories

buildConfirmed2 publishers

Black Forest Labs' distilled FLUX.3 Image Klein renders in about 2 seconds on an H100 in Diffusers

Black Forest Labs' open FLUX.3 Image Klein weights now load in Hugging Face Diffusers for self-hosted image generation and editing. Hugging Face times the distilled checkpoint at about 2 seconds per 1024 x 1024 image on an H100, and The Decoder reports an INT8 build for 8 GB cards.

Reality

Evidence50
Adoption
Insufficient
Hype gap+15
Incentives55
Confidence65
buildOne report1 publisher

Patterned PEFT LoRA adapters run at the wrong scale in vLLM 0.30.0

vLLM 0.30.0 ignores the per-module rank and alpha patterns in PEFT LoRA adapters, and one test put the error against PEFT at 70 times the unpatterned baseline. The adapter loads without complaint, so only a config check or a side-by-side against PEFT will catch it.

Publishers:dev.to

Reality

Evidence64
Adoption
Insufficient
Hype gap+12
Incentives20
Confidence66