Build1 distinct publisher3 min readUpdated
A developer's caption tool printed "gp" where the speaker said "HP", in the same typeface as the words it got right, even though the model had already scored that token. The fix is a queue, not a better score.
The Engineer · Build desk

Compiled by The EngineerSomething wrong?How this is made
Start with the arithmetic, because it settles most of the argument. The formula in the write-up divides substitutions plus deletions plus insertions by reference words [3], which means every entry in that numerator weighs exactly one, whichever word it lands on [4]. Take the author's own example of a single wrong word in a hundred [15]: that is a 1 percent error rate, a 99 percent word accuracy figure [5]. The same 1 percent buys you a harmless "and" turned into "an" or a dropped "not" that reverses the sentence [6]. The metric counts errors. It does not price them [7].
The more interesting part is where the information went missing. The recogniser had already emitted per-word timing and confidence, and the renderer flattened all of it into uniform text [2], so the token reading "gp" sat in the same weight and colour as everything it was surrounded by [1]. Nothing was absent from the model output. The editor declined to show it.
Two defaults in the author's pipeline are worth copying. A word arriving with no usable raw score is normalised to 0, the lowest review score, so it lands in the queue instead of letting silence read as certainty [11]. Confidence stays optional on the editor word, with a source field marking asr against manual, so a human-typed word never inherits a score the model never produced [12]. Malformed responses are rejected at the boundary rather than patched with invented fields further in [13].
The caveat the author raises is also the ceiling on how far flagging can be pushed. A confidence number is model output, not automatically a calibrated probability; research on ASR word confidence proposes explicit calibration so values can be compared across models, and a high-confidence token can still be wrong [10]. A threshold tuned against one engine is a local setting, not a portable quality bar.
That is why two lists of ids do more work than a colour scale. Pending is candidates minus reviewed [17], which gives review a denominator that belongs to the workflow instead of the model. Confidence ordering answers only the question of where a reviewer should look first [9], and even a perfect ordering says nothing about whether words land at the right time or whether a line is readable before it disappears [8]. The one thing the author wants surfaced is the thing no aggregate score contains: how much of the transcript remains unchecked [8].
Sourcing is worth stating plainly. This is one engineer's build, published on dev.to, with the gp/HP case coming out of his own editor, checked against his code, and a disclosure that AI helped edit and structure the piece [18]. It is not a benchmark and it does not claim to be. The conclusion he draws is narrow enough to survive that: an accuracy score describes a model result, and does not define a finished review workflow [19].
Follow any of these and your For You feed starts watching them — no settings page required.
Ranked by verification strength, evidence, and original report placement.
In one test clip the auto subtitles showed "gp" where the speaker had actually said "HP", and nothing in the editor made that token look more dangerous than the clean words around it.
The ASR system already returned word-level timing and confidence values, but a polished block of text made every word look equally trustworthy: the model exposed uncertainty and the interface hid it.
Speech-to-text is often evaluated with word error rate, given in the write-up as WER = (substitutions + deletions + insertions) / reference words, useful for comparing transcripts against a known reference.
The author lists auto subtitle errors with unequal consequences: "and" to "an" may be harmless, a changed personal name damages trust, 15 to 50 changes the meaning, HP to gp looked careless, and dropping "not" reverses the sentence.
WER counts errors and does not price their consequences, according to the author.
Good auto subtitles also depend on whether words appear at the right time, whether cue boundaries follow the sentence, whether a line is readable before it disappears, whether punctuation helps comprehension, and whether the user knows what remains unchecked; a transcript-only score does not fully describe these, so a system can have a strong aggregate score and still produce a bad editing experience.
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
One self-reported build, verifiable only where it is arithmetic
Everything rests on a single dev.to post by the developer himself. The WER formula and the 99-percent example are checkable arithmetic, and the TypeScript excerpts document the shapes being argued for, but the gp/HP incident, the normalization behaviour and the queue design are self-reported with no repository, named ASR system, dataset or third-party confirmation. The cited ASR confidence-calibration research is invoked generically and never identified, and the published body is truncated before the accept/edit and export steps are fully described.
No adoption signal in the supplied material
The source contains no release, deployment, benchmark run, pricing, licensing or usage disclosure. The editor is an unnamed personal project with no users, downloads, repository or third-party implementation reported, so adoption cannot be scored without inventing facts.
Mildly overstated: general prescription from one unmeasured build
The framing is unusually hedged for the genre -- the author calls it a 'narrower engineering conclusion', denies any universal confidence threshold, tells readers to measure against their own material, and explicitly rules legal, medical and accessibility sign-off out of what 'All clear' means. The gap that remains is that a headline-level claim about 99 percent accuracy and a general 'the fix is a queue' prescription are drawn from a single anecdote and one private implementation, with no measurement that the bounded queue catches consequential errors better than the alternatives it dismisses.
Practitioner self-publication promoting its own build's pattern
This is a developer writing on dev.to about an approach in his own subtitle editor, so there is a reputational and audience incentive to present that design as the correct one, and no vendor, model or dataset is named that would let a reader check it. Against that, no company, product name, sponsorship, funding or commercial relationship is disclosed or implied anywhere in the source, and the author volunteers both the AI editing assistance and that the failing caption came from his own build, which cuts the distortion risk.
Internally coherent, externally uncorroborated
Confidence is limited by structure rather than by contradiction: one publisher, one author, no independent verification and no adoption data, so the design claims cannot be confirmed or refuted from the supplied material. It is raised by the fact that the load-bearing analytical step is plain arithmetic on a standard metric, that the disclosure is explicit, and that nothing in the cluster contests any claim.
build
Allow-list the closed set, block-list the open one: 193 thin geo pages, one gate1 distinct publisher
build
A GAN beauty filter is a device budget allocation, not a feature toggle1 distinct publisher
build
Agent memory rots by accumulation, and the missing primitive is a supersession key1 distinct publisher
build
Your inference bill is an architecture defect: declare the task before you call the model1 distinct publisher
Distinct publishers with included, body-backed reporting in this cluster.
dev.to
1 article · August 24, 2026