The Executor Never Checks Its Orders
Every benchmark number in this research was produced by a system whose primary sensory input is attacker-writable page content, with no trust boundary anywhere in the harness.
The regression is the finding
Rank the paper's numbers by security value and the headline score comes third. Plan-and-Act (arXiv 2503.09572) trained a planner that had never seen the target websites. It produced fluent steps that matched nothing on the page, and the executor ran them anyway. Result: 20.60% on WebArena-Lite, against 36.97% for a plain ReAct loop with no planner at all. That is a published, reproducible demonstration of zero instruction validation at the executor. A plan is obeyed because of where it arrived from. Nothing compares it to the page or to the user's request.
The trust asymmetry belongs in the architecture review. These runs are web navigation, so the observation returned after every action is the raw HTML of the page the agent is standing on. Plans are derived from attacker-writable content, then consumed as trusted orders. Whoever shapes what the planner reads reaches every tool the executor is permitted to call: form fills, purchases, credential entry, data export, whatever the harness wired up.
Replanning buys accuracy by widening the window
Dynamic replanning is the largest single gain in the work: +10.31 points, 43.63% to 53.94%. The mechanism is that after every step the planner receives the current page state, the previous plans and the actions already taken, then rewrites the objective. The paper's own benign example turns "library at CMU" into "libraries near CMU". Small, plausible, useful. An adversarial revision has the same shape. A static plan gives an attacker one attempt at plan time. Per-step replanning gives one attempt per step, against a component whose job description is to change the goal based on what the page says.
| Configuration | WebArena-Lite | Untrusted entry points | Payload dwell time | Plan integrity check |
|---|---|---|---|---|
| ReAct single loop | 36.97% | One per observation, append-only | Full run — nothing leaves the prompt | No plan layer |
| Static plan + executor | 43.63% | Initial page, then each observation | Bounded — stale HTML stripped | None |
| Dynamic replanning | 53.94% | One per executor step | Bounded, but the plan is rewritable | None |
One control arrived free. The executor strips HTML it no longer needs before its next action, and replanning replaces a failed step instead of accumulating it. Both bound how long an injected payload sits in context. Both were funded as latency work. Bounded execution context is the rare security property that pays for itself with a performance argument.
Where this meets today's other story
The executor's failure mode has a human twin in the finance approval chains covered elsewhere in today's brief. A deputy with real authority, executing an instruction whose only credential is its apparent origin. Same defect, different substrate. In both cases the missing control is not stronger authentication of the sender. It is a check that the order still matches the objective the system was asked to serve.
The move
Treat any plan step or tool action derived from third-party content as untrusted input. Allowlist executor actions, validate parameters against the original user request, and hard-deny privileged classes (authentication flows, payments, data export, credential entry) when the step traces back to a replanned instruction. Then gate replanning itself behind an injection suite. The 20.60% run is the business case to carry to the platform lead. Not a hypothesis about model attention. Documented behavior of the architecture they are about to copy.
The best-performing agent configuration in this research is also the least defended one, and the paper's worst score is the proof: the executor follows plan steps that match nothing on the page.
What to do
Require a plan-integrity check before dynamic replanning reaches production: allowlist executor actions, validate parameters against the original user request, and hard-deny auth, payment, data-export and credential-entry steps that trace to a replanned instruction.
Stand up a 20-scenario indirect prompt-injection suite against the agent harness this quarter — hidden DOM instructions, objective-rewriting page content — with zero successful hijacks as the release gate for replanning.