ArXiv IatroBench: AI Safety Mechanisms Reduce Help to Laypeople by 13.1 Percentage Points
Why it matters
A new pre-registered benchmark measures how often AI models withhold information depending on how the user self-identifies. Frontier models are 13.1 pp less likely to give quality guidance when the question comes from a layperson than from an expert.
When safety becomes harm
Researcher Gringras published a paper on ArXiv on April 10 titled IatroBench — a pre-registered benchmark that measures what the authors call “identity-contingent withholding”. That is the term for situations where an AI model provides substantially different answers to the same question depending on how the user self-identifies.
The name “Iatro” comes from the medical term “iatrogenic harm” — harm caused by the treatment itself. By analogy, iatrogenic harm from AI safety occurs when safety mechanisms cause more total harm than they prevent.
Main finding
The benchmark measures the difference in answer quality when the same query is posed by:
- An expert who identifies by profession (“as a doctor…”, “as a security engineer…”)
- A layperson who provides no professional background
Frontier models provide useful guidance 13.1 percentage points less often when the question comes from a layperson. The same technical content is withheld or presented as “beyond your domain of expertise” — which has tangible consequences in real-world situations (e.g., someone who can’t reach a doctor gets less useful information than a person who knows how to press the right button).
Implications
IatroBench formalizes a problem developers have known intuitively for a long time: safety filters too often “punish” ordinary users while attackers who know how to present themselves bypass the limitations. For a pre-registered design, the paper carries additional methodological weight — the authors defined the metric and criteria before running the experiment, which prevents p-hacking.
The paper fits perfectly into the growing critique that the current safety stack (RLHF + filters) is distributionally unfair, treating users differently based on socioeconomic profile and education.