LeadershipNot yet confirmed elsewhere1 publisher2 min readPublished
Physician study splits failed digital rollouts into a data problem and a design problem
Researchers who surveyed 564 physicians found that data quality and system usability shape cognitive load through separate pathways. For leaders who blame a stalled rollout on user resistance, it means testing data and design separately before more money goes to training.
The Board Room · Leadership desk

What happened
- Leaders often put poor adoption of digital tools down to user resistance to change, according to an article in MIT Sloan Management Review.
- When leaders do examine a failed digital investment, the article says, they tend to judge data quality and system usability as one variable.
- The surveyed physicians spanned 32 specialties and were asked about electronic health records used in high-stakes clinical decisions.
- Higher-quality patient data increased germane load, the productive effort of deep reasoning that the author ties to better decisions.
Why it matters
- constraint A single user-effort or satisfaction score cannot show which fix worked, since a data improvement can raise effort while a design improvement lowers it.
- cost Money spent on training or change management for a data or design fault leaves the fault in place, and the next system is set up to fail the same way.
- decision A stalled rollout now calls for two separate diagnoses, and possibly two budgets and two owners, before any remedy is approved.
- exposure Under the resistance diagnosis, front-line users take the blame for faults in a data feed or an interface they did not choose.
Design was expected to move cognitive load in the opposite direction. The researchers hypothesized that usable systems cut extraneous load, the effort lost to excess navigation steps, misaligned workflows, alert fatigue and visual clutter [11]. Better data adds effort, but of the useful kind. "Better data makes physicians think harder about what matters," the article's author writes [4]. One score for user effort or satisfaction can therefore hide a working data fix behind a rise in effort. It can also credit a design fix that left the data as poor as before [14].
The resistance diagnosis persists because the two faults are rarely pulled apart. When a digital investment underdelivers, organisations almost universally blame implementation problems, insufficient training or change management breakdowns, according to the article [8]. "These explanations are structurally inevitable when leaders don't distinguish between a data quality failure and a system design failure," the author writes [9]. I'd expect training to stay the favoured remedy for a plainer reason too. It can be bought without reopening the data pipeline or the vendor's interface.
The cost shows up in the next budget cycle. The article describes a corrective investment aimed at the wrong problem, followed by another underperforming system and another misdiagnosis [15]. The article does not estimate what that loop costs. For a leader holding a stalled rollout this quarter, the trade-off is speed against accuracy. Splitting the postmortem into a data question and a design question takes longer and may need two owners, because, in the article's words, "improving one does not improve the other" [7]. Skipping the split is faster. It also sends next quarter's money toward training, the explanation the article says follows from never drawing the distinction [8][9].
A skeptic would say a survey of doctors about health records is thin evidence for a sales floor or a warehouse. The researchers chose clinical medicine because it is the highest-stakes and most extensively documented setting for knowledge work under time pressure, and the article argues the cognitive mechanisms are not unique to it [12]. That argument belongs to the authors. The evidence comes from one profession and one class of software [10][13]. The article sums up the result in a single line: the research "confirmed both effects with statistical precision" [3]. I would treat the separation of data and design as a sound diagnostic habit for any rollout, and the size of each effect outside medicine as unknown.
What to watch
- Publication of the study's effect sizes, showing how far each pathway moves physicians' cognitive load.
- A replication with non-clinical knowledge workers on business systems, testing the authors' claim that the mechanisms are not unique to medicine.
- Post-implementation reviews that score data quality and system usability separately, the closer look the article's framework is meant to prompt.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence40
- Adoption
- Insufficient
- Hype gap+30
- Incentives45
- Confidence45
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
The research found that data usability and system usability affect cognitive load through entirely different pathways.
ReportedSupportedSource: MIT Sloan Management Review article2 sources— create a free account to open themView cited source - [2]
EHR data usability, covering the quality, completeness and clinical relevance of patient information, increases germane cognitive load, the productive effort associated with deep reasoning, which the author describes as the condition that produces decision quality.
ReportedSupportedSource: MIT Sloan Management Review article2 sources— create a free account to open themView cited source - [3]
"The research confirmed both effects with statistical precision."
ReportedSupportedSource: MIT Sloan Management Review article2 sources— create a free account to open themView cited source - [4]
"Better data makes physicians think harder about what matters."
ReportedSupportedSource: Article author, MIT Sloan Management Review2 sources— create a free account to open themView cited source - [5]
Leaders often blame poor adoption of digital tools on user resistance to change, according to an article in MIT Sloan Management Review.
- [6]
When leaders analyze failed digital investments, they commonly evaluate data quality and system usability as a single variable.
- [7]
Data quality and system usability operate through different mechanisms and fail in different ways; "improving one does not improve the other."
- [8]
When a digital investment underdelivers, organizations almost universally attribute the failure to implementation problems, insufficient training, or change management breakdowns.
- [9]
"These explanations are structurally inevitable when leaders don't distinguish between a data quality failure and a system design failure."
- [10]
The author, with Kalle Lyytinen and David Aron of Case Western Reserve University and Michael R. Cauley of Vanderbilt University Medical Center, surveyed 564 practicing physicians.
- [11]
The researchers hypothesized that highly usable EHR systems reduce extraneous cognitive load, the unproductive effort generated by excessive navigation steps, misaligned workflows, alert fatigue, visual clutter and documentation requirements.
- [12]
The researchers chose clinical medicine because it is the highest-stakes, most extensively documented context for knowledge work under cognitive pressure and time constraints; the article says the cognitive mechanisms are not unique to medicine.
- [13]
The surveyed physicians spanned 32 medical specialties, and the study examined how data quality, system design and information overload shape cognitive load when doctors use electronic health records in high-stakes decision-making.
- [14]
Because better data raises germane load while better design lowers extraneous load, a single measure of total user effort or satisfaction can move either way when both change and cannot show which fix worked.
- [15]
Without the distinction, the result is a corrective investment that addresses the wrong problem, followed eventually by another underperforming system, followed by another misdiagnosis.
Sources
1 independent publisher whose own reporting we read for this story.
- sloanreview.mit.eduThe Real Reasons Why Digital Projects Fail
1 article · October 6, 2026
Topics and entities
Follow any of these and your For You feed starts watching them — no settings page required.
Topics
- Digital transformationFollow
- Cognitive loadFollow
- Electronic Health RecordsFollow
- Software usabilityFollow
Entities
- MIT Sloan Management ReviewFollow
- Case Western Reserve UniversityFollow
- Vanderbilt University Medical CenterFollow
- Kalle LyytinenFollow
- David AronFollow
- Michael R. CauleyFollow