Skip to content
Apixo
Blog
news· 3 min read· via Microsoft Research

Microsoft Researchers Uncover 'Lazarus' Weight-Level AI Backdoor Attack

Microsoft research shows how altering fewer than 10 dormant neurons can backdoor an AI agent without retraining, triggering hidden code execution while passing evaluations.

Microsoft Researchers Uncover 'Lazarus' Weight-Level AI Backdoor Attack

Microsoft researchers have documented a stealthy attack technique known as "Lazarus," which demonstrates that autonomous AI agents can be compromised by altering fewer than 10 dormant neurons within an underlying model. The attack requires no traditional fine-tuning or retraining and leaves the model performing normally across standard evaluation suites. However, once a specific trigger appears in the input, the reprogrammed neurons activate, prompting the agent to emit arbitrary commands that can execute within connected tools or terminal environments.

Because the altered weights remain inactive during typical workloads, the technique highlights serious vulnerabilities in systems that grant models direct execution privileges.

Reprogramming dormant neurons without retraining

Modern large language models contain numerous neurons that rarely fire during standard tasks. The Lazarus study revealed that internal pretraining representations are structured so cleanly that a simple linear classifier fitted on approximately 50 examples can reliably separate inputs containing a designated trigger from those without it.

By editing the weights of dormant neurons to serve as trigger detectors, attackers can force a chosen token directly into the model's residual stream when activated. Chaining multiple altered neurons together allows for the sequential injection of full command strings, such as shell instructions to download and execute arbitrary remote code.

The compute requirements for the attack are remarkably low. Any hardware configuration with enough memory to hold and run the model can alter the checkpoint in weight space. Interestingly, the researchers noted that the core methodology was first developed during an exploratory session where Claude Code running Opus 4.5 autonomously established a proof-of-concept backdoor without training.

Agent risks and the checkpoint supply chain

The real-world risk posed by Lazarus increases significantly when models are deployed as agents with terminal access, file modification capabilities, or external API tools. An agent can handle routine user prompts without anomaly until an innocuous operational trigger occurs—such as the system date passing midnight into 2027. Once triggered, the model emits the attacker's payload, which the host agent executes using whatever system privileges it possesses.

The researchers noted that this vector is not unique to open-weight models downloaded from public repositories. Proprietary or internally trained models are equally vulnerable if an attacker achieves write access to a checkpoint through a compromised continuous integration pipeline, compromised developer credentials, or misconfigured storage buckets. As long as weight integrity is breached, the backdoor can be implanted.

What it means for developers

For engineering teams building autonomous systems, Lazarus signals that standard black-box evaluations and functional benchmark testing are insufficient for verifying model safety. A backdoored model can post perfect scores on safety evaluations while harboring dormant triggers.

Mitigating this threat requires treating model weights as untrusted software artifacts:

  • Verify provenance and track weight diffs: Developers should ensure that downloaded weights match verified cryptographic signatures from trusted publishers. Comparing weight differences against an unmodified baseline remains one of the most reliable methods to spot unauthorized modifications.
  • Enforce least privilege on agent tools: Agents equipped with bash access, file system permissions, or network access should be isolated inside secure sandboxes with strict network boundaries and runtime behavioral monitoring. Models should be handled as potential insider risks.
  • Adopt multi-layered scanning: Microsoft is exploring automated weight scanning using frontier models to identify anomalous edits, alongside cryptographic model signing and red-teaming harnesses. Platforms like Microsoft Foundry currently address provenance by verifying publishers and isolating runtimes in secure containers.

Teams developing agent guardrails across different model families can evaluate leading architectures—including Claude, GPT, and others—via pay-per-token API access through a unified endpoint at https://apixoai.online. As agent tooling matures, establishing robust supply-chain integrity for model checkpoints will become as vital as securing application source code.


Source: Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents — Microsoft Research. Written by the Apixo team from that report.

#ai-news#ai-security#cybersecurity#ai-agents#machine-learning#microsoft
Try it with your own tools

One key for Claude, GPT, GLM, DeepSeek and more. Pay per token with crypto.

Get your API key

Keep reading