Skip to content

LeadershipNot yet confirmed elsewhere1 publisher2 min readPublished

Physician study splits failed digital rollouts into a data problem and a design problem

Researchers who surveyed 564 physicians found that data quality and system usability shape cognitive load through separate pathways. For leaders who blame a stalled rollout on user resistance, it means testing data and design separately before more money goes to training.

The Board Room · Leadership desk

How we use AISend a correction

Photograph accompanying Physician study splits failed digital rollouts into a data problem and a design problem
Photo: cuny.edu

What happened

  • Leaders often put poor adoption of digital tools down to user resistance to change, according to an article in MIT Sloan Management Review.
  • When leaders do examine a failed digital investment, the article says, they tend to judge data quality and system usability as one variable.
  • The surveyed physicians spanned 32 specialties and were asked about electronic health records used in high-stakes clinical decisions.
  • Higher-quality patient data increased germane load, the productive effort of deep reasoning that the author ties to better decisions.

Why it matters

  • constraint A single user-effort or satisfaction score cannot show which fix worked, since a data improvement can raise effort while a design improvement lowers it.
  • cost Money spent on training or change management for a data or design fault leaves the fault in place, and the next system is set up to fail the same way.
  • decision A stalled rollout now calls for two separate diagnoses, and possibly two budgets and two owners, before any remedy is approved.
  • exposure Under the resistance diagnosis, front-line users take the blame for faults in a data feed or an interface they did not choose.

Design was expected to move cognitive load in the opposite direction. The researchers hypothesized that usable systems cut extraneous load, the effort lost to excess navigation steps, misaligned workflows, alert fatigue and visual clutter [11]. Better data adds effort, but of the useful kind. "Better data makes physicians think harder about what matters," the article's author writes [4]. One score for user effort or satisfaction can therefore hide a working data fix behind a rise in effort. It can also credit a design fix that left the data as poor as before [14].

The resistance diagnosis persists because the two faults are rarely pulled apart. When a digital investment underdelivers, organisations almost universally blame implementation problems, insufficient training or change management breakdowns, according to the article [8]. "These explanations are structurally inevitable when leaders don't distinguish between a data quality failure and a system design failure," the author writes [9]. I'd expect training to stay the favoured remedy for a plainer reason too. It can be bought without reopening the data pipeline or the vendor's interface.

The cost shows up in the next budget cycle. The article describes a corrective investment aimed at the wrong problem, followed by another underperforming system and another misdiagnosis [15]. The article does not estimate what that loop costs. For a leader holding a stalled rollout this quarter, the trade-off is speed against accuracy. Splitting the postmortem into a data question and a design question takes longer and may need two owners, because, in the article's words, "improving one does not improve the other" [7]. Skipping the split is faster. It also sends next quarter's money toward training, the explanation the article says follows from never drawing the distinction [8][9].

A skeptic would say a survey of doctors about health records is thin evidence for a sales floor or a warehouse. The researchers chose clinical medicine because it is the highest-stakes and most extensively documented setting for knowledge work under time pressure, and the article argues the cognitive mechanisms are not unique to it [12]. That argument belongs to the authors. The evidence comes from one profession and one class of software [10][13]. The article sums up the result in a single line: the research "confirmed both effects with statistical precision" [3]. I would treat the separation of data and design as a sound diagnostic habit for any rollout, and the size of each effect outside medicine as unknown.

What to watch

  • Publication of the study's effect sizes, showing how far each pathway moves physicians' cognitive load.
  • A replication with non-clinical knowledge workers on business systems, testing the authors' claim that the mechanisms are not unique to medicine.
  • Post-implementation reviews that score data quality and system usability separately, the closer look the article's framework is meant to prompt.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence40
Adoption
Insufficient
Hype gap+30
Incentives45
Confidence45
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    The research found that data usability and system usability affect cognitive load through entirely different pathways.

    ReportedSupportedSource: MIT Sloan Management Review article2 sources— create a free account to open themView cited source
  2. [2]

    EHR data usability, covering the quality, completeness and clinical relevance of patient information, increases germane cognitive load, the productive effort associated with deep reasoning, which the author describes as the condition that produces decision quality.

    ReportedSupportedSource: MIT Sloan Management Review article2 sources— create a free account to open themView cited source
  3. [3]

    "The research confirmed both effects with statistical precision."

    ReportedSupportedSource: MIT Sloan Management Review article2 sources— create a free account to open themView cited source

Sources

1 independent publisher whose own reporting we read for this story.

  1. sloanreview.mit.edu

    1 article · October 6, 2026

    The Real Reasons Why Digital Projects Fail

Share your take

Let Clarity write the post for you.

Signed-in readers get a short post drafted on this story in the register they choose — narrative, analytical, or a direct position — editable to the last word before it goes anywhere. The share buttons at the top of this story work without an account.

Topics and entities

Follow any of these and your For You feed starts watching them — no settings page required.

Topics

Entities

Loading related stories