Skip to content

Product1 publisher3 min readPublished

A five-item risk list replaces the 100% coverage target

A devops.com argument tells teams to spend their deepest testing on authentication, payments, security, critical integrations and high-traffic flows, and to give everything else less scrutiny. It names four frameworks for ranking.

The Product Desk · Product desk

Illustration accompanying A five-item risk list replaces the 100% coverage target

What happened

  • devops.com published an argument headlined "Stop Chasing 100% Test Coverage," holding that testing everything is unrealistic as applications, dependencies and release cycles grow more complex.
  • Four frameworks are named for doing the ranking: PRisMA, Rapid Risk Assessment, Quality Functional Deployment, and Cost of Exposure, which estimates the financial impact of defects.
  • AI can help identify code changes and testing gaps, according to the piece, while human judgment decides which failures matter most to the business.

Compiled by The Product DeskSomething wrong?How this is made

Why it matters

  • decision A coverage percentage is a number. A ranking agreed by development, QA, product, operations and support is a decision with names attached, and the low-priority half is the half someone has to defend after an incident.
  • constraint One of the five priority categories is set by traffic volume, so a team that leans on it will guard its busiest screens and can leave a rarely-used, hard-to-reverse path thin.
  • exposure Two of the four ranking questions need recorded change frequency and integration failure history. Teams without that record will rank from recollection and inherit whatever their memory misses.
  • precedent Pulling QA planning into the same prioritization logic security and reliability teams already use makes test scope a cross-functional negotiation before each release instead of a QA-owned number.

A typo on an internal admin page is inconvenient. A failed login or a broken payment process can quickly become a serious business problem. That contrast is where the devops.com argument starts [7].

The five areas it says typically deserve deeper testing are authentication and access control, payment and transaction processing, security-sensitive functionality, critical APIs and third-party integrations, and high-traffic customer workflows [3][9]. Four of those are ranked by what happens when they break. The fifth is ranked by how many people pass through it [10]. I would treat volume as the weakest of the five: it counts how many users meet a surface, not what a failure there costs them or how hard it is to undo.

The rest still gets tested. Lower-risk functionality "still deserves testing, but it doesn't always require the same level of scrutiny," it says [4]. That is a smaller claim than an unaffordable-coverage claim, and it is the one an operator has to implement: fewer tests on the admin page, chosen on purpose.

Four frameworks get named as ways to do the ranking: PRisMA for product risk management, Rapid Risk Assessment, Quality Functional Deployment, and Cost of Exposure, which estimates the financial impact of defects [5]. The article says the specific framework matters less than consistency, meaning a coherent and steady process for evaluating risk before every release [6]. The concrete artifact underneath is a meeting. Development, QA, product, operations and customer support sit together and name the parts of the application that would cause the greatest disruption if they failed [8].

Then come four questions the piece offers in place of "what haven't we tested?": which failures would have the biggest impact on customers, which services change most frequently, which integrations have historically been the least reliable, and what issues would be most expensive to recover from [11]. Two of the four need data rather than opinion [12]. Change frequency per service comes out of the repository. Integration reliability comes out of incident history, and a team that has not kept that history will answer from memory.

On tooling, the piece grants AI a narrow role: it can help identify code changes and testing gaps, while human judgment stays essential in deciding which failures matter most to the business [13].

For Monday, the forcing function is a 2x2 built from those questions: cost to recover from a failure on one axis, rate of change on the other [11]. High on both gets the deep suite. Low on both gets a smoke test and a named owner who agreed to that. The tradeoff is ownership: the person who deprioritized a path answers for the incident on it. The article does not include escaped-defect rates or cost figures from teams that switched [14], so the case for ranking rests on the same reasoning security and reliability teams already use when they prioritize by exploitability, outage likelihood and blast radius [15].

What to watch

  • Whether anyone publishes escaped-defect or incident rates for teams that moved from a coverage target to a risk ranking.
  • Whether the AI tools that flag testing gaps start proposing the ranking itself. The piece reserves that business judgment for humans.
  • Whether coverage percentage survives in release gates and executive dashboards after a team adopts risk ranking underneath it.
Loading claim ledger
Loading source directory links
Loading share composer
Loading topic controls
Loading related stories