Build1 distinct publisher3 min readPublished
The bar was 50% of the original motion median, and the same clip honestly returned 47.5% and 56.5%, because the registration fixed the bar and left the sample count to the pipeline. The rule written to close that gap then produced a compliance rate with the same hole.
The Engineer · Build desk

Compiled by The EngineerSomething wrong?How this is made
The decisive parameter was never in the registration document. It lived in the pipeline, as whatever sample count the code happened to use, so the artifact meant to adjudicate the run had handed half the decision to a default that no retro would notice changing [2].
The median is what makes that bite. A median over 8 samples sits between the fourth and fifth ordered values; over 24 it sits between the twelfth and thirteenth [21]. Those are two different estimators of the same quantity, and if the per-frame motion values are bursty, they can land on opposite sides of a fixed line. Here they did: 47.5% at 8 frames, 56.5% at 24 [3][4]. That is a spread of 9 percentage points across a bar sitting 2.5 points above the low reading and 6.5 points below the high one [17].
I would not carry the 9 points anywhere else. For that gap to transfer, your clips would need a comparable motion distribution and your sampling rule would need to draw frames the same way, because the number is a property of one clip's order statistics, not a general fact about 8 versus 24. What does transfer is the shape of the failure. hexisteme's own reading, in a first-person retro published on dev.te's platform under the hexisteme byline, is that a threshold like this is undefined rather than strict, since both verdicts were honestly computed [6][20]. The rule that followed is short and correct: pin sample count, measurement window and sampling rule alongside the threshold [8].
The next pre-registration is the part I would copy. It fixed the window to [0, 5.5s], spelled out the sampling rule, and committed to reporting both 8 and 24 samples [9]. Committing to both is better engineering than picking one, because it puts the sensitivity in the report instead of resolving it by choosing whichever count agrees with you.
Then the same defect reappeared in the process layer. An audit the next day counted three files matching report/prereg-*.md and found one that had pinned all three slots in prose, which the author wrote up as the rule failing inside 24 hours [11][12]. A single git log on first-add dates showed the compliant document was born in the rule's own commit, and the other two on 2026-08-14, before the rule existed [13]. Two of the three were therefore never in scope [19]. Scoped correctly, the denominator is 1 and compliance is 100% [14]. Same numerator, same corpus, same day: 33% or 100%, a 67-point swing produced entirely by which documents you decide the rule applies to [18].
That leaves a compliance figure of one over one, on a rule whose only test case says in its own text that it is enacting the lesson for the first time [10][15]. A rule whose entire evidence base is the document announcing it has a tidy citation graph and not much else. Both compliance readings were arithmetic done correctly on an unstated denominator, which is the threshold bug one layer up, in the process rather than the metric.
Ranked by verification strength, evidence, and original report placement.
Measured across 8 frames, the clip's motion median came out at 47.5%, below the bar, so the falsifier fired and the clip failed.
Measured across 24 frames, the same clip's motion median came out at 56.5%, above the bar, so the falsifier did not fire and the clip passed.
The author states the two runs used the same clip, same threshold and same metric definition, and that only a sampling parameter the pre-registration never fixed differed, which alone flipped the sign of the verdict.
git log --diff-filter=A showed the Monte Carlo replication was added in commit 03da812 dated 2026-08-15, the commit where the rule was written, while ink-coverage (670cdff) and sim-graph-reveal (b3478d8) were added on 2026-08-14, before the rule existed.
Because both other documents predated the rule they were never in scope, so counting them as violations counted retroactive non-application as non-compliance; the correct denominator is 1 and the compliance rate is 1/1, or 100%.
On 2026-08-14 a screen-metric experiment in the author's YouTube Shorts pipeline ended undeterminable, because a pre-registered threshold depended on a number that had never been pinned down.
Distinct publishers with included, body-backed reporting in this cluster.
dev.to
1 article · August 31, 2026
Follow any of these and your For You feed starts watching them — no settings page required.
build
Sixty green checks, four shipped defects, and a scan that never printed its denominator1 distinct publisher
build
A Deleted API Key Kept Authenticating Because The Editor Froze It At Boot1 distinct publisher
build
Recording each model's rejected options broke two 1-1 review deadlocks1 distinct publisher
build
Persist the ID before you verify it: how a YouTube stage went blind to five live videos1 distinct publisher
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Precise, self-reported, unreplicable
Every figure — 47.5 and 56.5, the three-file corpus, commit 03da812 dated 08-15 against 670cdff and b3478d8 dated 08-14 — comes from one developer quoting his own private repository on dev.to. The specificity cuts both ways: named files, section numbers and short hashes are exactly what you would need to check this, and exactly what nobody outside hexisteme can check. What lifts it above anecdote is that the piece publishes its own refutation: the same corpus read as 1/3 and as 1/1, with the git output that adjudicates between them printed in full.
One repo, one document, one uninvoked checker
Take the numbers literally and the footprint is a single person's Shorts pipeline. The rule has been followed exactly once, by its author, inside a day of writing it. The machine-readable successor is installed — prereg/v1 front matter on every document, a checker subcommand, retroactive transcription with nulls where nothing was pinned — and by the author's own grep, no hook, workflow or scheduler invokes it. Installed is not running, and the post says so plainly.
Discounts its own good news
The headline promise — tripling the frame count flipped a pre-registered verdict on the same clip — is precisely what the data shows, and the piece then spends its second half arguing against itself: calling the corrected 100% 'maximum reassurance and minimum evidence,' admitting the retro sentence was written before the check that disproved it, and closing on a fix that reproduced the failure it was fixing. That is the opposite of overselling. The one place a reader could over-read is generality — a single hobby pipeline is not evidence about how pre-registration behaves at large — and the author never invites that leap.
Nothing sold, everything self-graded
No product, no vendor, no funding round sits behind this; the pull is reputational — dev.to rewards a well-shaped confession, and the confession is the artefact being published. The structural conflict is narrower and worth naming: one person wrote the rule, followed the rule, counted compliance against it, misread the count, and then graded the correction. That closed loop is why the 1/1 deserves suspicion. It also biases toward candour rather than inflation, which is why this sits low rather than high.
Coherent inside, unchecked outside
Internally this hangs together about as well as a single-source account can: the two measurements straddle the stated bar by plausible margins, the commit dates explain the scope error rather than merely asserting it, and the piece flags its own translation layer. What we cannot do is confirm any of it from outside — whether the corpus is really three files, whether the medians were computed as described, whether the checker is as inert as claimed. Confident about what was said and why it holds together; unverified as to whether it happened.