Build1 publisher2 min readPublished
Eight failed checks in ORBITAL's browser gate traced back to one real app bug
Across twelve ORBITAL tasks, eight failed a browser check at least once, and the verifier's own triage marked six of them automation bugs. Those six were cleared by override, two of them with per-case approval.
The Engineer · Build desk

What happened
- Every ORBITAL task had to be proved in a real browser driven by Kane CLI before Claude Code could stop, with the Stop hook appending each attempt to an activity log.
- The log for the whole build records 12 of 12 tasks verified, one sweep catch and six overrides.
- Eight of the twelve tasks failed a check at least once, starting with T1, which failed on an assertion timing mismatch after the navigation it was checking had already happened and passed on retry.
- For all six tasks that needed an override, T2, T3, T4, T9, T10 and T11, kane-cli's own triage returned confirmed: false with family automation_bug.
- Re-checking the published write-up against the raw log turned up notes crediting the sweep at T3 and T4, both of which the log records as test problems.
Compiled by The EngineerSomething wrong?How this is made
Why it matters
- cost Clearing one false failure takes an isolated re-run, a fresh triage, independent evidence that the feature works and a written rationale, so the tasks where the verifier is least reliable are the ones that consume a person's afternoon.
- constraint A four second toast window on the booking studio and another build's storage key on the todo build were enough to fail working features. The verifier's timing margins and environment assumptions sit inside the definition of done.
- exposure Anyone reading the repo's artifacts inherits a defect claim the triage rejected: the README still captions the chart-lock run from evidence pack 31fcd34b as a caught defect.
The rule that keeps this gate usable is in how a failed run gets read. Every raw `failed` result is checked against the verifier's structured verdict, `verdict.confirmed`, `family`, `category` and confidence, and never against the exit code [16]. T7 was the only real problem in the app across the twelve tasks [14]. "Eight failures, one bug. Read by exit code, all eight look the same," the author wrote [15].
The other seven were test or environment problems. T3's test asserted a hover effect on the allocation donut without ever hovering the segment, a step the script was missing [11]. T4 failed because a legitimate layout fix invalidated recorded replay baselines; re-recorded with `--author`, all eight test files passed [12]. On T9, T10 and T11 the feature steps passed and a redundant final re-check stalled afterwards, and on T11 the browser agent oscillated between two buttons until it detected a cycle in its own plan [13]. T2 failed three times at three different points, one attempt opening the wrong page entirely, with triage pointing at flaky headless hover targeting and an ambiguous unlock-state assertion [10].
Six overrides across twelve tasks is half the build [28]. T2 was recommended by a second Claude session and approved by the author explicitly, T3 needed triage evidence and then the author's approval, and T4, T9, T10 and T11 were cleared "under standing self-override authorization" [27]. Two of the six record a per-case human decision [30].
All of this is twelve tasks on one app, with one browser agent on one machine. For the seven-to-one split between automation failures and app bugs to carry to another suite, that suite would need assertions that depend on headless hover targeting and recorded baselines a layout change can invalidate [29][10][12].
The last layer is the write-up itself. Checking each ORBITAL claim in the repo's build log, `OBSERVATIONS-AND-REPORTINGS.md`, against the raw activity log [20], the author found notes crediting the sweep with catching "a real state-tracking defect" on the chart at T2, where the log has no sweep finding on T2 at all [22]. The notes call T9 "a genuine race"; the log shows all four export toasts confirmed in the same run, with a redundant step failing afterwards [24]. "My write-up had done to the verifier's failures exactly what the verifier had done to the app," the author wrote [21]. Kane's `bug_title` field made that easy to get wrong: "Replay misclassifies unlocked chart state" looks like a finding once it is lifted away from the `confirmed: false` beside it, and the first draft of Part 1 repeated the titles [25].
What to watch
- Whether Part 1 and the README caption on evidence pack 31fcd34b get corrected now that the raw log contradicts them.
- Whether the standing self-override authorization survives, given four of the six clears used it.
- Whether kane-cli stops writing triage titles worded as confirmed bug reports next to confirmed: false.