Skip to content

Build1 publisher2 min readPublished

Naming the object was worth 0.150 to SAM 3 before Feyn Labs trained anything

Feyn Labs' MultiMatte updates 2.27 percent of SAM 3's weights with a rank-16 LoRA, and every pixel in the output now carries a continuous opacity value. The DIS-VD figures supporting it are Feyn Labs' own.

The Engineer · Build desk

What happened

  • Feyn Labs' Shreyash Nigam and Hafedh Hichri released MultiMatte on September 10th, a promptable matting model that keeps whichever object a user names in a phrase and removes everything else.
  • MultiMatte assigns every pixel a continuous opacity value and returns an RGBA cutout that can be placed straight onto another background.
  • Feyn Labs says it changed 19.49 million of SAM 3's 860 million parameters, 2.27 percent of the weights, using low-rank adaptation.
  • Human-written object labels covered 4,949 of the training images, 24.8 percent of the set, with the rest supporting only the broader segmentation objective.
  • The adapter is merged into the released weights, so developers load a single checkpoint and need no separate adapter package at inference.

Compiled by The EngineerSomething wrong?How this is made

Why it matters

  • capability A phrase now picks the subject, so a catalog or editing pipeline can drop the points, boxes and brush strokes an operator used to supply per image.
  • decision Anyone evaluating a specialist model of this shape has to score the frozen base model with the same prompt first, or the adapter gets credit for alignment it inherited.
  • constraint Teams that want both base SAM 3 behaviour and MultiMatte behaviour in one process have to host two checkpoints, because the adapter cannot be unloaded.
  • cost The adopter funds the measurement that decides this: runtimewire puts the commercial test at whether the gains survive independent evaluation with acceptable latency and cost.

The release reports two DIS-VD deltas, and they measure different things. Feyn Labs says supplying a real concept name raised unmodified SAM 3's S-measure by 0.150, with no additional gradient updates [16]. After the fine-tune, prompting added a further 0.036 to MultiMatte [17]. The first is about four times the second [2].

So the base model already mapped "the dog" onto the dog's pixels, and the adapter mostly bought edge quality [2]. The training data fits that reading. Human-written labels covered 4,949 images out of 19,953, leaving 15,004 with none [15][13][1]. Feyn Labs ran 14,000 steps on focal loss and Dice loss [14].

The adapter is rank-16 and sits on attention and multilayer-perceptron projections throughout the architecture, including the CLIP text tower that carries part of the alignment between language and images [10]. That last placement is the one worth arguing about at review. Feyn Labs says the small update was deliberate, because it wanted better mattes without wiping out SAM 3's vocabulary or its ability to follow object names [11]. No measurement of retained vocabulary appears in the release. A team with a long product taxonomy would want that test before swapping checkpoints.

SAM 3's segmentation generally sorts each pixel inside or outside an object [4]. Hair, fur, glass, smoke and motion blur do not survive that representation, because they fade into what is behind them [5]. Hichri, who lists himself as a Hugging Face Fellow, has contributed to BiRefNet, BEN2, MatAnyone and RMBG-1.4 [21], so the new matte head comes from someone who has shipped this class of model before.

Feyn Labs went through Y Combinator's Spring 2025 batch and describes its business as training models on a customer's own data and production feedback, with the customer keeping the resulting weights [19][20]. The weights here ship with the adapter merged in [12]. Convenient, right up until you want base SAM 3 back in the same process.

The release does not publish an absolute S-measure or a head-to-head matting score against base SAM 3 [3]. For the two deltas to transfer to your pipeline, your images have to look like the five categories in the training mix: salient object, camouflage, high resolution, hair, and marine [13]. Your prompts also have to name concepts SAM 3 already knows, because that is where the larger delta came from, and both deltas are Feyn Labs' own [16].

What to watch

  • An independent DIS-VD evaluation reporting absolute S-measure values for MultiMatte alongside other matting models.
  • Published latency and throughput for the merged checkpoint on named hardware.
  • Any third-party test of prompt recall on concepts outside the five training categories.
Loading claim ledger
Loading source directory links
Loading share composer
Loading topic controls
Loading related stories