Skip to content

Build Independently confirmed2 publishers 2 min read Published

Black Forest Labs' distilled FLUX.3 Image Klein renders in about 2 seconds on an H100 in Diffusers

Black Forest Labs' open FLUX.3 Image Klein weights now load in Hugging Face Diffusers for self-hosted image generation and editing. Hugging Face times the distilled checkpoint at about 2 seconds per 1024 x 1024 image on an H100, and The Decoder reports an INT8 build for 8 GB cards.

The Engineer · Build desk

Send a correction

Illustration accompanying Black Forest Labs' distilled FLUX.3 Image Klein renders in about 2 seconds on an H100 in Diffusers
Generated illustration
Fewer parameters than FLUX.2 [klein], more Elo Model size in parameters and the Elo gain over FLUX.2 [klein], as The Decoder reports them.

Key figures: FLUX.3 Image Klein has 5.6 billion parameters, against 9 billion for FLUX.2 [klein], and gains 91 Elo points over FLUX.2 [klein], according to The Decoder.

Fewer parameters than FLUX.2 [klein], more Elo
FigureValueNoteClaim
FLUX.3 Image Klein parameters, per The Decoder5.6 billion14
FLUX.2 [klein] parameters9 billion14
Elo gain vs FLUX.2 [klein]91 Elo points22

What happened

  • Hugging Face says NVFP4 and FP8 weights load with from_single_file and are meant for smaller GPUs.
  • The Decoder reports the model has 5.6 billion parameters, 38 percent fewer than the 9 billion in FLUX.2 [klein].
  • The distilled checkpoint defaults to 1024 x 1024 at 16 steps, and height, width and num_inference_steps are ordinary call arguments.
  • According to The Decoder, the weights ship under the FLUX Kommunity License, free for commercial use by companies making under $5 million a year.
  • Hugging Face lists LoRA training scripts for text-to-image and editing, and The Decoder says Ostris AI Toolkit and NVIDIA NeMo AutoModel support LoRA training from day one.

Why it matters

  • What's now possible capability One checkpoint handles text-to-image, reference-based editing and box layout, so a team can prototype all three against a single self-hosted deployment. The Decoder says editing takes up to ten reference images.
  • What it limits constraint Companies above the license's revenue line fall outside the free commercial grant and need to read the license terms before putting the model in a product.
  • What it costs cost A single H100 stream at 2 seconds a render tops out near 1,800 images an hour. Whether self-hosting beats the API then depends on how many of those hours you keep busy.

Diffusers support is not the whole install [1]. The install line also upgrades transformers, because the text encoder is Qwen3-VL [6]. A deployment therefore loads that encoder next to the image model. The load path is three calls on a ModularPipeline: from_pretrained with "black-forest-labs/flux-3-image-klein", load_components with dtype=torch.bfloat16, then .to("cuda") [7]. Because the pipeline is modular, you can pop blocks out or add your own [8].

Test the 2-second figure first. Divide it by the 16 default steps and each step costs at most about 125 ms [18]. It is "at most" because any text encoding or image decoding inside the timing comes out of the same 2 seconds. The post does not say whether the timing includes them or which precision it used. For the number to transfer, your card has to match an H100, the pipeline has to be warm, and you have to run the same 1024 x 1024 at 16 steps [13][15].

The RTX 4070 timing is a separate measurement. The Decoder reports under 9 seconds there, on an INT8 build [2]. Hugging Face's smaller-GPU weights use other formats. Two publishers, two GPUs and different weight formats mean the gap between 2 and 9 seconds is not a speedup ratio.

The quality claim is Black Forest Labs' own. According to The Decoder, the company says the model scores the highest Elo among open models in internal testing and beats Ideogram V4.5 and FLUX.2 [pro] [21]. The same passage lists a 91-point Elo gain over FLUX.2 [klein] [22]. An Elo from an internal prompt set measures preference on that set. It transfers to your workload only if those prompts look like yours.

The API price needs a unit check. The Decoder gives $0.009 per 1,000 images [17]. That works out to $0.000009 an image [19], and a thousand images for under a cent is a number that deserves a second look. Confirm it on BFL's pricing page before it goes into a build-versus-buy sheet.

Layout control has one detail to test early. Boxes are written [y_min, x_min, y_max, x_max], y first, on a 0 to 1000 scale [9]. The scale is normalized, so the same box works at any image size. If your boxes come from another tool, check the axis order before anything else. For edits, a region's src_bbox marks where its content sits in the reference and tgt_bbox where it lands in the output. A region with identical boxes stays put [10].

What to watch

  • BFL's pricing page confirming whether the $0.009 API figure is per image or per 1,000 images.
  • Independent timings of the distilled checkpoint on NVFP4, FP8 and INT8 weights, with step count, resolution and text-encoder time stated.
  • A third-party comparison against FLUX.2 [klein] on a prompt set outside BFL's internal testing.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence50
Adoption
Insufficient
Hype gap+15
Incentives55
Confidence65
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Black Forest Labs' open image generation model FLUX.3 Image Klein is supported in Hugging Face Diffusers.

  2. [2]

    An INT8 build lets FLUX 3 Image Klein run on NVIDIA GPUs with just 8 GB of VRAM, generating an image in under 9 seconds on an RTX 4070.

  3. [3]

    NVFP4 and FP8 weights load with from_single_file, for smaller GPUs.

Get this ledger inside ChatGPT. Ask about any of our stories and the answer brings its figure, each claim’s verdict and the sources. Free, no account.

Add to ChatGPTAdd to Claude

Sources

2 independent publishers whose own reporting we read for this story.

  1. huggingface.co

    1 article · October 14, 2026

    Welcome FLUX.3 Image Klein in Diffusers
  2. the-decoder.com

    1 article · October 15, 2026

    Black Forest Labs' open-weights image model FLUX 3 Image Klein runs on consumer GPUs with just 8 GB of VRAM

Share your take

Let Clarity write the post for you.

Signed-in readers get a short post drafted on this story in the register they choose — narrative, analytical, or a direct position — editable to the last word before it goes anywhere. The share buttons at the top of this story work without an account.

Topics and entities

Follow any of these and your For You feed starts watching them — no settings page required.

Entities

Loading related stories