other

Set-of-Mark

Visual prompting technique that overlays numbered marks on interactive or salient regions of an image so a multimodal model can refer to a region by index rather than by pixel coordinates.

Known aliases

Set-of-Mark prompting
SoM

Relationships

No evidence-backed relationships are recorded.

Current clusters

build1 publisher

Distilling a 2 MB page to 3,000 tokens via metadata stripping, visibility filtering, and semantic flattening

Browser-use's perception pass strips scripts and hidden nodes, then paints numbered badges on a screenshot so the model clicks by index instead of by XPath. The teardown puts action precision above 95% per action.

Publishers:dev.to

Reality

Evidence38
Adoption22
Hype gap+37
Incentives48
Confidence41