Build1 distinct publisher3 min readPublished
Promptwatch ties the collapse to an August 8 jump in domain-scoped fan-out queries. The data is provisional. The dependency it exposes is not.
The Engineer · Build desk
Compiled by The EngineerSomething wrong?How this is made
A fan-out query is the retrieval a system runs before it writes a word of the answer [6]. Promptwatch reports that the share of ChatGPT's fan-out queries carrying a `site:` operator went from roughly 0.37% to 16.8% on August 8, which is about a 45-fold increase and just over 16 percentage points [5][13]. A domain-scoped query narrows what can come back to whatever lives on the named domain, so Promptwatch reads the pattern as a retrieval adjustment inside ChatGPT rather than anything aimed at Reddit [7].
The arithmetic does not close cleanly, and that is the interesting part. If 16.8% of fan-out queries now carry the operator, then 83.2% still do not [16]. Yet Reddit came out of it holding 13.6% of its former citation share, down 3.31 percentage points [12]. A change touching roughly one query in six removed 86% of one domain's citations [3][16]. Either those domain-scoped queries were doing most of the citation-generating work, or more than one thing moved on August 8. Promptwatch calls its data provisional and says collection problems cannot be ruled out, so it does not claim to know which [9].
The windows deserve the same scrutiny. The baseline runs 21 days, the post-change reading covers 4, and the six days from August 8 to August 13, immediately after the retrieval change, sit in neither [14]. The 86.4% figure is a three-week average compared against a long weekend [3][14].
Meanwhile the Google products Promptwatch tracks moved too, gradually: about 11% off Reddit's citation share in AI Overviews, about 30% in AI Mode [8]. That makes ChatGPT's drop roughly 2.9 times the size of AI Mode's and 7.9 times AI Overviews' [15]. Reddit's content did not degrade in three different ways at once, which supports the retrieval reading. It also means the slower declines have some other cause, and that Reddit's standing as a citable source was already drifting down before anyone flipped a flag on August 8 [8].
For anyone doing the measuring, the operative distinction is that a page can be crawlable and indexed and still go uncited, because indexing governs whether a document can be found and retrieval governs whether it is looked for [10]. Every check Promptwatch recommends sits on the publisher's side of that line: diff the Reddit URLs cited before and after August 14, confirm important pages are indexed for domain-scoped queries, test `site:` retrieval directly, watch GPTBot, re-run the fan-out analysis per model [11]. Those will tell you whether your own plumbing is the problem. None of them tells you whether the model will fan out toward your domain next month, and there is no notification when it stops.
Which is the actual finding here. Citation share behaved like an asset for three weeks and like a tenancy on the fourth. The page is yours; the retrieval path to it belongs to whoever ships the next configuration change.
Ranked by verification strength, evidence, and original report placement.
Reddit's share of citations in ChatGPT Search averaged 3.83% between July 18 and August 7, 2026, according to Promptwatch.
Reddit's share of ChatGPT Search citations fell to 0.52% from August 14 to 17, according to Promptwatch.
Promptwatch describes the move as an 86.4% relative decline in four days.
On August 8, use of the site: operator in ChatGPT's fan-out queries rose from roughly 0.37% before that date to 16.8% of fan-out queries.
Over the same period Google AI Overviews showed an approximately 11% gradual decline in Reddit citation share and Google AI Mode an approximately 30% gradual decline, per Promptwatch's tracking.
Promptwatch recommends comparing Reddit-linked URLs cited before and after August 14, confirming important pages are indexed for domain-scoped queries, testing priority pages against direct site: queries, monitoring crawlers such as GPTBot, and re-running fan-out analyses regularly and comparing results by AI model.
Follow any of these and your For You feed starts watching them — no settings page required.
Evidence-backed comparisons of source perspectives and observed adoption signals. Read the methodology
Which Builder, Operator, and Investor concerns the observed source mix emphasized—not a truth score.
Evidence, demonstrated adoption, hype gap, incentives, and confidence are assessed independently, each on its own current evidence. How these are measured.
One provisional, self-caveated tracker relayed by a single commercial publisher
All quantitative content traces to one third-party tracker (Promptwatch) summarised by one publisher, with no methodology disclosure, no OpenAI confirmation, and no independent corroboration. The source itself states the data are provisional and that collection issues cannot be ruled out, and the comparison uses a 21-day baseline against a 4-day post-change window that skips August 8-13. The mechanism claims (fan-out definition, indexed-but-not-retrieved) are well established and uncontroversial; the causal attribution is not evidenced beyond timing.
Change observed live in one tracker's telemetry across three AI surfaces
The underlying retrieval shift is reported as already running in production and is visible in measurements of ChatGPT Search plus comparative readings for Google AI Overviews and AI Mode, which is more than an announcement. But adoption evidence is confined to a single tracker's panel over four days, with no absolute volumes, no user- or site-level impact data, and no evidence of how many teams have changed practice in response.
Causal certainty in the framing outruns the hedged data
The cluster headline states the change 'was OpenAI's, not Reddit's', and the dek asserts an exposed dependency, while the article's own FAQ says the data only 'suggests' a retrieval change and the tracker calls its numbers provisional with uncertain scale and durability. Precise-looking figures (3.83%, 0.52%, 86.4%, 16.8%) lend an air of rigour to a four-day window with a six-day hole in it, and the piece resolves into a CTA for a paid AI-visibility scan. The direction of the finding may well be real; the confidence attached to it is overstated.
Both measurer and publisher sell AI-visibility products the finding promotes
The article is published on a developer platform under a vendor byline and routes to Scalevise's AI Visibility and GEO Checker with an explicit 'Start an AI Visibility scan' call to action, so the publisher directly monetises anxiety about unstable AI citations. The originating measurement comes from Promptwatch, a tracker whose product is fan-out and citation monitoring, and whose recommended remediation steps are the activities its tooling performs. No disclosure of these interests appears in the piece.
Directionally plausible, numerically unreliable
Confidence is moderate-low: the mechanism is coherent and the vendor-side dependency it illustrates is real and independently reasonable, but every number comes from one commercially interested, self-declared provisional dataset with no vendor confirmation, no corroborating tracker, and a short measurement window. The qualitative lesson is more dependable than the 86.4% figure.
build
ChatGPT tops Google's paid-click share at 4.75%, and growth teams should reprice the auction1 distinct publisher
build
Two assistants agreed on the top plumber 4.2% of the time. One agreed with itself 7% of the time.1 distinct publisher
build
Cloudflare's one-click AI block names GPTBot, not the bot that decides if ChatGPT cites you1 distinct publisher
product
Google's new Preferred Sources button hands publishers the recruiting job2 distinct publishers
Distinct publishers with included, body-backed reporting in this cluster.
dev.to
1 article · August 26, 2026