Science1 publisher2 min readPublished
Two GLP-1 studies show 'control' can mean assigning a drug or adjusting records afterwards
Two GLP-1 studies covered by the Washington Post used 'control' to mean an untreated group in one and a four-variable adjustment in the other. Only the first let researchers choose who took the drug, a statistician writes in The Conversation.
The Scientist · Science desk

What happened
- The Washington Post reported a GLP-1 study of a hormonal disorder in which researchers gave the drug to some women and not others, and those on it lost more weight than the control groups.
- A couple of months earlier, the Post reported a GLP-1 bone and tendon injury study that controlled for age, sex, race and tobacco use and found higher skeletal-disorder risk in users.
- A 2021 GLP-1 weight-loss trial in people with Type 2 diabetes randomized participants within groups defined by starting blood sugar and by the diabetes medications they took.
- The statistician who wrote The Conversation explainer reports research finding 90% of American adults would sometimes base decisions on statistics if they understood the basics better.
Compiled by The ScientistSomething wrong?How this is made
Why it matters
- decision Before a reader treats 'controlled for' in a GLP-1 headline as evidence the drug caused something, they have to find out whether researchers assigned the drug or sorted records they had no hand in.
- constraint Because the Post used the same word for a trial and a records study a couple of months apart, the wording alone cannot tell a reader which GLP-1 finding came from researchers choosing who got the drug.
- constraint Randomization has its own limit: a trial's answer carries over to future patients only as far as they resemble the people who enrolled, and enrolling every kind of patient can cost too much.
Start with the statistician's own hypothetical. Suppose smokers are more likely to take GLP-1 drugs, and smoking by itself raises the risk of bone injury [8]. If the analysis ignores smoking, the drug will look linked to more bone injuries simply because many of its users smoke [8]. In the bone study, controlling for tobacco use meant comparing injuries between users and nonusers within each category: smokers with smokers, nonsmokers with nonsmokers [7].
The explainer in The Conversation gives each meaning one sentence. In the hormonal-disorder trial, the statistician wrote, control meant the researchers directly influenced how the data was generated [4]. In the records study, it meant accounting for elements of data that had already been gathered, which the researchers had no influence over [5].
I think the word to hold onto is "known." In the explainer's description, statistical adjustment checks that an association between a treatment and an outcome is not being driven by one of the known variables that affects both [6]. Sorting people into categories works only for variables someone recorded. A difference between users and nonusers that nobody measured stays inside the comparison [6][7]. As the Post summarized the bone study, the recorded list had four entries [15].
Randomization acts earlier, when participants are assigned. In a drug trial, scientists decide by chance who receives the treatment, and those who do not usually get a placebo such as a fake pill [9]. Stratification adds a step. Treatment is randomized separately within groups that share a factor, such as illness severity or other medications, so that participants with one quality do not end up disproportionately in one arm by chance [10]. It sorts people into the same kinds of categories an adjustment uses, but it does so at assignment, before anyone is treated [10]. The statistician wrote that it also helps researchers compute the treatment effect with greater precision [16].
Effect sizes are the next thing to ask about. The explainer does not report how large the weight difference was in the trial, or how much higher the skeletal risk was in the records study [1][3]. What it does say is that the word "control" in coverage "typically gives the impression that having a control enhances credibility" [14].
What to watch
- Whether the published bone and tendon injury paper adjusted for more than the four variables the Post listed, and how large its reported risk was.
- A randomized GLP-1 trial that records bone and tendon injuries as an outcome would test the records-based association directly.