Build1 distinct publisher3 min readPublished
One batch run of 67 agent turns spread 6.3x between median and p95, and the fan-out architecture sketched before the measurement did not survive contact with it.
The Engineer · Build desk

Compiled by The EngineerSomething wrong?How this is made
The ratio is 6.3x [13], but the shape under it is the part that decides anything. Sorted, the run has a fat body between 15s and 50s, a scatter in the 60-115s band, then five samples piled at roughly 182s and a single one at 210.3s [9]. That last sample is a 180s client timeout with a successful retry behind it, which means the retry itself came back in about 30.3s [16], near the median of 29s [2]. Part of the tail is not slow work at all. It is work that stalls, gets abandoned, and then runs at ordinary speed on the second attempt.
That distinction matters because it tells you tuning the prompt will not fix the tail. Fan-out then multiplies whatever the tail is. Porchlight's developer had sketched a design where a visitor announces a change and the server fans out across every open departure, so 18 departures means 18 turns: roughly nine minutes at p50, closer to an hour at p95 [10]. Even the best case in that design, one turn, is described as a coin flip between ten seconds and three minutes [19].
The deadline that survived the redesign is the honest number. WEB_DEADLINE_MS is set to 100 seconds [12], which sits well below the measured p95 of 182s [2]. Counting only the samples the writeup places explicitly, six of the 67 exceed 100s [14], so about one live turn in eleven [14] is designed to be given up on. That is a decision to hand a visitor a fast failure instead of a slow success, with everything else served from a precompute pass that writes each verdict to liveCache.json with a capturedAt stamp the UI shows [11].
On the quality side, the agent resolved 14 departures across 54 captured judgements, 11 of them scoring 0.00 against a twenty-line keyword baseline that ships in the repo, while refusing 35 non-matching pairs at 0.90 confidence or better [8][6]. So 79 percent of its wins are invisible to the dumb control [17], which is the whole argument for the agent being on the critical path rather than decorating it. The seed example makes the mechanism concrete: a member complaining about "quick clips" replacing long sit-downs shares no salient token with an announcement that "deep-dive interviews are back", so the keyword check returns false and no stopword list will rescue it [7].
One arithmetic note the writeup does not close: 14 resolutions plus 35 refusals is 49, leaving five of the 54 judgements in neither bucket [15]. With precision being the property that makes it safe to email people who already left once [18], those five are exactly the ones a buyer would ask about.
All of this is self-reported by the project's developer from a single batch run [1], and the run was taken after the architecture existed rather than before [3]. The control cost twenty lines [6]. The latency capture cost one batch [1]. The redesign cost the architecture.
Ranked by verification strength, evidence, and original report placement.
The developer captured 67 timed turns against a live LLM agent in a single batch run and wrote them to disk.
The agent's median turn latency (p50) was 29s and its p95 was 182s.
The developer identifies condition matching as the step that has to be an agent, and set out to prove it rather than assert it.
Across 54 captured judgements the agent resolved 14 departures, 11 of which the keyword baseline scores 0.00 on, while refusing 35 non-matching pairs at 0.90 confidence or higher.
Sorted, the 67 samples run: fastest 10.3s, a long fat body between 15s and 50s, a handful in the 60-115s range, five clustered at about 182s, then one at 210.3s, that last being a 180s client timeout followed by a successful retry.
The developer describes even a single turn, the best case in the fan-out design, as a coin flip between ten seconds and three minutes.
Follow any of these and your For You feed starts watching them — no settings page required.
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
Specific and code-backed, but single-author and unreplicated
The source publishes concrete percentiles, a sorted distribution, the exact deadline constant, the control's full implementation and a worked failing example — well above typical build-post rigour, and the repo plus live demo make partial reproduction possible. But every number comes from one developer's single batch run with no disclosed model version, environment, concurrency or dates; the 54 judgements use author-curated seed data with no stated labelling procedure; five of those judgements are unaccounted for; and no independent party has verified anything.
Solo demo deployed publicly, no external usage evidence
Adoption evidence is limited to the author's own artifacts: a public demo site, a live agent endpoint rationed to 3 calls per IP per 15 minutes, an open-source repo, and two self-run measurement passes. No users, customers, downloads, stars, integrations, or third-party deployments are disclosed anywhere in the supplied material, and the demo deliberately serves precomputed verdicts rather than live traffic.
Mostly self-limiting, one overreach on agent necessity
The post works against its own hype in most places: it ships the control, discloses a distribution that undercuts an easier story, labels replayed verdicts with capture timestamps, and refuses a keyword fallback precisely because silent degradation would flatter the product. The residual overstatement is narrow but real — 'the step that has to be an agent' is established only against a twenty-line keyword strawman on author-labelled seed data, and the recall/precision framing leaves five of 54 judgements unexplained. Adoption is a solo demo, while the headline generalises a latency ratio into a product law.
Self-promotional build post naming its vendor, no disclosed sponsorship
The author is writing about his own project and links his live demo, live agent endpoint and GitHub repo in the body — classic portfolio/visibility incentive on a developer publishing platform, and the framing rewards a striking headline ratio. The agent vendor, Minds by Animoca Brands, is named as sitting on the critical path; the supplied material discloses no payment, sponsorship or affiliation either way, so vendor incentive cannot be assessed. Mitigating factor: the post publishes numbers and failure modes that make the project look harder to ship, not easier.
Internally coherent, externally unchecked
Confidence is capped by a single-publisher, single-source cluster with no independent replication and no disclosed measurement environment, but lifted by the specificity and internal consistency of the figures, the inspectable control and constants, and the author's own disclosure of limits. Claims about what the author measured and built are firm; claims about what those measurements imply for anyone else's system are not.
build
A build step instead of a backend: 1,025 records, 8 locales, no runtime API1 distinct publisher
build
Allow-list the closed set, block-list the open one: 193 thin geo pages, one gate1 distinct publisher
build
A GAN beauty filter is a device budget allocation, not a feature toggle1 distinct publisher
build
Agent memory rots by accumulation, and the missing primitive is a supersession key1 distinct publisher
Distinct publishers with included, body-backed reporting in this cluster.
dev.to
1 article · August 26, 2026