Your Inference Architecture Just Got Two Shocks — Here's the Decision Matrix
Two simultaneous shifts to the same layer
Google shipped native computer-use in Gemini 3.5 Flash this morning. The release lands on the inference and agent-execution layer that many teams rebuilt late in 2025. A separate event in the same layer, the Qualcomm acquisition of Modular, arrived the same day and pulls in a different direction.
Gemini 3.5 Flash ships native computer-use
Google released computer-use as a built-in tool across browser, mobile, and desktop surfaces. No scaffolding. The model itself emits structured browser and desktop actions, which collapses the agent-framework layer (Browser-Use, Claude Computer Use wrappers, LangGraph orchestration) into a model primitive. The tradeoff is framework complexity for tighter latency and lower cost per step, with reduced observability.
The thing this release doesn't tell you is how it performs on real workloads. No benchmarks were published. Easy demos will look fine, and multi-step web tasks probably land where everyone else lands, at first. The validation path is mechanical: port 20–50 representative tasks from the current agent eval onto native tool-calls and compare task success rate, mean steps to completion, p95 latency, and cost per successful task.
Qualcomm acquires Modular for $3.9B
Modular's pitch was vendor neutrality: write once in Mojo, run efficiently across NVIDIA, AMD, Intel, and emerging accelerators. The prior cases rhyme. Intel/Habana, NVIDIA/OctoML, AMD/Nod.ai. Cross-silicon parity erodes quietly once a chip vendor controls the roadmap. Qualcomm calling it 'silicon-agnostic' in the press release is the standard line; the empirical question is whether AMD and Intel backends keep getting optimization cycles in the next four quarterly releases.
A chip vendor doesn't buy a compiler company to keep it neutral.
The combined implication
A stack that looked like Mojo/MAX for inference optimization → custom agent framework for browser automation → tool-call accuracy eval harness is now under pressure on all three layers at once. Even with a single-layer dependency, the decision window is this quarter.
What to do this sprint
| Runtime | Silicon coverage | Roadmap risk | 2026 recommendation |
|---|---|---|---|
| vLLM | NVIDIA-first, AMD growing | Low (OSS) | Safe default |
| TensorRT-LLM | NVIDIA only | Low | Safe if NVIDIA-committed |
| SGLang | NVIDIA, AMD | Medium | Best for structured generation |
| MAX (Modular) | Multi (claimed) | High | Pause new bets |
For the agent layer: run the Gemini native-tool eval in parallel with the existing harness for one release cycle. Define success by end state, not path taken. The old tool-call-accuracy metric breaks once the model drives the screen itself. If rankings reshuffle, and expect at least one position change, the native-tool number is the one that matches user experience.
What to do
Spike a 20–50 task benchmark comparing Gemini 3.5 Flash native computer-use vs. your current agent framework — measure task success, steps, p95 latency, cost per task
Freeze any new Mojo/MAX commitments and redirect those engineering weeks to a vLLM-vs-TensorRT-LLM-vs-SGLang bake-off on your served traffic
Add live-site trajectory evals (end-state scoring, not path-matching) to your agent harness in parallel with existing scripted tool-call tests