Counterfactual Fairness Audits of Multi-Step Clinical LLM Agents Require a Measured Per-Action Instability Floor
Counterfactual audits for clinical LLM agents require a measured per-action instability floor because flip rates alone are uninterpretable. Re-running identical conditions ten times across sixteen vignettes moved agent actions in 8.7% of cells, with instability varying by a factor of eight (0.022 to 0.179) across actions like ICU escalation and controlled-s…