Black Forest Labs' distilled FLUX.3 Image Klein renders in about 2 seconds on an H100 in Diffusers
Black Forest Labs' open FLUX.3 Image Klein weights now load in Hugging Face Diffusers for self-hosted image generation and editing. Hugging Face times the distilled checkpoint at about 2 seconds per 1024 x 1024 image on an H100, and The Decoder reports an INT8 build for 8 GB cards.
The Engineer · Build desk

Key figures: FLUX.3 Image Klein has 5.6 billion parameters, against 9 billion for FLUX.2 [klein], and gains 91 Elo points over FLUX.2 [klein], according to The Decoder.
| Figure | Value | Note | Claim |
|---|---|---|---|
| FLUX.3 Image Klein parameters, per The Decoder | 5.6 billion | 14 | |
| FLUX.2 [klein] parameters | 9 billion | 14 | |
| Elo gain vs FLUX.2 [klein] | 91 Elo points | 22 |
What happened
- Hugging Face says NVFP4 and FP8 weights load with from_single_file and are meant for smaller GPUs.
- The Decoder reports the model has 5.6 billion parameters, 38 percent fewer than the 9 billion in FLUX.2 [klein].
- The distilled checkpoint defaults to 1024 x 1024 at 16 steps, and height, width and num_inference_steps are ordinary call arguments.
- According to The Decoder, the weights ship under the FLUX Kommunity License, free for commercial use by companies making under $5 million a year.
- Hugging Face lists LoRA training scripts for text-to-image and editing, and The Decoder says Ostris AI Toolkit and NVIDIA NeMo AutoModel support LoRA training from day one.
Why it matters
- What's now possible capability One checkpoint handles text-to-image, reference-based editing and box layout, so a team can prototype all three against a single self-hosted deployment. The Decoder says editing takes up to ten reference images.
- What it limits constraint Companies above the license's revenue line fall outside the free commercial grant and need to read the license terms before putting the model in a product.
- What it costs cost A single H100 stream at 2 seconds a render tops out near 1,800 images an hour. Whether self-hosting beats the API then depends on how many of those hours you keep busy.
Diffusers support is not the whole install [1]. The install line also upgrades transformers, because the text encoder is Qwen3-VL [6]. A deployment therefore loads that encoder next to the image model. The load path is three calls on a ModularPipeline: from_pretrained with "black-forest-labs/flux-3-image-klein", load_components with dtype=torch.bfloat16, then .to("cuda") [7]. Because the pipeline is modular, you can pop blocks out or add your own [8].
Test the 2-second figure first. Divide it by the 16 default steps and each step costs at most about 125 ms [18]. It is "at most" because any text encoding or image decoding inside the timing comes out of the same 2 seconds. The post does not say whether the timing includes them or which precision it used. For the number to transfer, your card has to match an H100, the pipeline has to be warm, and you have to run the same 1024 x 1024 at 16 steps [13][15].
The RTX 4070 timing is a separate measurement. The Decoder reports under 9 seconds there, on an INT8 build [2]. Hugging Face's smaller-GPU weights use other formats. Two publishers, two GPUs and different weight formats mean the gap between 2 and 9 seconds is not a speedup ratio.
The quality claim is Black Forest Labs' own. According to The Decoder, the company says the model scores the highest Elo among open models in internal testing and beats Ideogram V4.5 and FLUX.2 [pro] [21]. The same passage lists a 91-point Elo gain over FLUX.2 [klein] [22]. An Elo from an internal prompt set measures preference on that set. It transfers to your workload only if those prompts look like yours.
The API price needs a unit check. The Decoder gives $0.009 per 1,000 images [17]. That works out to $0.000009 an image [19], and a thousand images for under a cent is a number that deserves a second look. Confirm it on BFL's pricing page before it goes into a build-versus-buy sheet.
Layout control has one detail to test early. Boxes are written [y_min, x_min, y_max, x_max], y first, on a 0 to 1000 scale [9]. The scale is normalized, so the same box works at any image size. If your boxes come from another tool, check the axis order before anything else. For edits, a region's src_bbox marks where its content sits in the reference and tgt_bbox where it lands in the output. A region with identical boxes stays put [10].
What to watch
- BFL's pricing page confirming whether the $0.009 API figure is per image or per 1,000 images.
- Independent timings of the distilled checkpoint on NVFP4, FP8 and INT8 weights, with step count, resolution and text-encoder time stated.
- A third-party comparison against FLUX.2 [klein] on a prompt set outside BFL's internal testing.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence50
- Adoption
- Insufficient
- Hype gap+15
- Incentives55
- Confidence65
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Black Forest Labs' open image generation model FLUX.3 Image Klein is supported in Hugging Face Diffusers.
- [2]
An INT8 build lets FLUX 3 Image Klein run on NVIDIA GPUs with just 8 GB of VRAM, generating an image in under 9 seconds on an RTX 4070.
- [3]
NVFP4 and FP8 weights load with from_single_file, for smaller GPUs.
- [4]
Hugging Face's post lists LoRA training scripts for both text-to-image and image editing.
- [5]
LoRA training works from day one through Ostris AI Toolkit and NVIDIA NeMo AutoModel.
- [6]
The install step upgrades diffusers and transformers, with transformers needed for the Qwen3-VL text encoder.
- [7]
The example loads the model with ModularPipeline.from_pretrained("black-forest-labs/flux-3-image-klein"), pipe.load_components(dtype=torch.bfloat16) and pipe.to("cuda").
- [8]
The model ships as a Modular Diffusers pipeline, so you can pop blocks out or add your own.
- [9]
Layout boxes are written as [y_min, x_min, y_max, x_max], y first, on a 0 to 1000 scale; because the scale is normalized, the same box works at any image size.
- [10]
For edits, each region says where its content comes from (src_bbox in the reference) and where it goes (tgt_bbox in the output); a region with the same two boxes stays where it is.
- [11]
One model handles text-to-image, multi-reference image-to-image, and bounding-box layout control.
- [12]
The model supports generation and editing with up to ten reference images.
- [13]
The distilled checkpoint makes a 1024 x 1024 image in about 2 seconds on an H100.
- [14]
FLUX 3 Image Klein has 5.6 billion parameters, 38 percent fewer than the 9 billion of FLUX.2 [klein].
- [15]
The distilled checkpoint generates a 1024 x 1024 image in 16 steps by default; height, width and num_inference_steps can be passed to change them.
- [16]
The weights ship under the FLUX Kommunity License, free for commercial use by companies making under $5 million annually.
- [17]
The model is available through the BFL API at $0.009 per 1,000 images.
- [18]
At most about 125 ms per denoising step if the 2-second timing spans 16 steps.
- [19]
$0.009 per 1,000 images is $0.000009 per image, under one cent per thousand images.
- [20]
A single sequential stream at about 2 seconds per image yields roughly 1,800 images per hour, with no batching assumed.
- [21]
Black Forest Labs says FLUX 3 Image Klein scores the highest Elo ratings among all open models in internal testing, beating closed competitors Ideogram V4.5 and BFL's own FLUX.2 [pro].
- [22]
The model gains 91 Elo points over FLUX.2 [klein].
Get this ledger inside ChatGPT. Ask about any of our stories and the answer brings its figure, each claim’s verdict and the sources. Free, no account.
Sources
2 independent publishers whose own reporting we read for this story.
- huggingface.coWelcome FLUX.3 Image Klein in Diffusers
1 article · October 14, 2026
- the-decoder.comBlack Forest Labs' open-weights image model FLUX 3 Image Klein runs on consumer GPUs with just 8 GB of VRAM
1 article · October 15, 2026
Topics and entities
Follow any of these and your For You feed starts watching them — no settings page required.
Topics
- Open-weights image generationFollow
- Quantization formatsFollow
- LoRA Fine-TuningFollow
Entities
- The DecoderFollow
- DiffusersFollow
- FLUX.3 Image KleinFollow
- Black Forest LabsFollow
- Hugging FaceFollow
- FLUX.2 kleinFollow