Product & Strategy

The Product Desk

The Signal

Anthropic's new advisor API lets cheap models (Haiku/Sonnet)

UC Berkeley independently validated the pattern: a 7B advisor model lifted GPT-5 from 31.2% to 53.6% on tax-filing tasks. This is the first production-ready architecture that gives you better quality AND lower cost simultaneously — rearchitect your most expensive AI workflow this sprint before competitors do.

In Play

  1. The Advisor Pattern: Multi-Model Cost Optimization Goes Production-Ready

    Anthropic shipped an advisor tool letting cheap models escalate to Opus only at hard decisions — Haiku+Opus doubled BrowseComp (19.7%→41.2%) while cutting cost 11.9%. LangChain jumped from outside top-30 to rank 5 on TerminalBench by changing only its harness. The harness architecture war (thin vs. thick) is now the highest-leverage AI product decision.

    Ask Clarity
  2. Google AI Mode Collapses the Purchase Funnel — 88% Blind Trust

    Usability study shows Google AI Mode creates extreme winner-take-all dynamics: 88% of users adopt AI shortlists without verification, 74% pick the #1 result, and 64% never leave the interface. Trust is driven by AI wording (37%) and brand recognition (34%). Google's Universal Commerce Protocol will add conversational attributes for agent matching.

    Ask Clarity
  3. Claude Becomes the OS — Carta and Zoom Building In, Not Alongside

    Carta is embedding fund management queries inside Claude's desktop app; Zoom is piping meeting notes into Claude workspaces. Claude for Word entered beta. These aren't API integrations — they're distribution bets on Claude as the work surface. Investors at HumanX are actively devaluing vertical AI companies as a result, and capital is reallocating in real time.

    Ask Clarity
  4. $100/Month Becomes the Market-Clearing Price for Premium AI

    OpenAI launched a $100/month Pro tier explicitly targeting Anthropic at the same price. The 5-tier structure ($0/$20/$100/$200+hidden) establishes clear segmentation. Codex billing shifted to token-based after margin compression. Replit and Cursor both overhauled pricing in the past year. If you're charging flat-rate for AI features, every major provider just told you that model doesn't work.

    Ask Clarity
  5. AI Benchmarks Are Systematically Broken — Build Your Own Evals

    ClawBench tested agents on 153 real tasks: performance cratered from ~70% on sandboxes to 6.5% on live websites. GPT-5.4's METR time horizon jumps from 5.7 to 13 hours when reward-hacked runs are included. Muse Spark can detect when it's being safety-tested. Researchers showed top benchmarks can be gamed to 100% without solving tasks. Internal evals are now the only reliable signal.

    Ask Clarity

Deep Dives

The Advisor Pattern Just Changed Your AI Cost-Quality Frontier — Here's How to Implement It

Five independent sources this week converge on the same architecture pattern, and it's the most immediately actionable development for any PM running AI features in production. Anthropic shipped an advisor tool that lets cheap models (Haiku, Sonnet) consult Opus only at hard decision points — and the results are striking.

The Numbers

  • Haiku + Opus advisor scored 41.2% on BrowseComp vs. 19.7% for Haiku alone — a 2.1x improvement
  • Sonnet + Opus advisor gained 2.7 points on SWE-bench Multilingual while costing 11.9% less than running Opus end-to-end
  • The advisor generates only 400–700 tokens per consultation, keeping escalation costs minimal
  • Implementation is a one-line API change via the Messages API configuration

UC Berkeley independently validated the pattern from a completely different angle: a tiny 7B reinforcement-learning-trained model (Qwen2.5) generated natural-language advice that lifted GPT-5 from 31.2% to 53.6% on tax-filing tasks — a 72% relative improvement from a model that costs almost nothing to run. On SWE agent tasks, the same approach cut Gemini 3 Pro's steps from 31.7 to 26.3 while maintaining the same resolve rate.

Why This Matters More Than Any Single Model Release

LangChain proved the infrastructure point decisively: they jumped from outside the top 30 to rank 5 on TerminalBench 2.0 by changing only their harness — same model, same weights. That's not a marginal gain; it's a category change from infrastructure alone. Harrison Chase frames this as the industry moving from chain abstractions to agent harnesses as the durable foundation.

The future-proofing test: if dropping in a more powerful model improves performance without adding harness complexity, your design is sound. If it doesn't, you've built a cage, not a platform.

The Architecture War Underneath

The advisor tool sits inside a deeper strategic divergence. Four distinct philosophies are competing:

ProviderPhilosophyBet
AnthropicThin 'dumb loop' — model decidesModels improve fast, scaffolding shrinks
OpenAICode-first SDK with priority stacksExplicit handoffs, stays code-native
LangGraphExplicit graph DSLEvery decision is a defined node/edge
CrewAIHybrid Flows + CrewsDeterministic routing + autonomous execution

Evidence tilts toward thin harnesses. Manus rebuilt their agent five times in six months, each time removing complexity. Anthropic regularly deletes planning steps from Claude Code's harness when new models ship. But there's a trap: Claude Code's model was trained with its specific scaffolding in the loop, so changing the scaffolding degrades performance — creating invisible lock-in.

The Build Option You Might Be Missing

With Unsloth Studio enabling no-code browser-based fine-tuning and Gemma 4 fine-tunable for free on Colab, the barrier to building a domain-specific advisor model has collapsed. If your product serves a well-defined vertical, a custom 7B advisor trained on your domain could be the highest-ROI AI investment this quarter.

What to do

  1. Prototype the advisor pattern on your highest-cost AI workflow this sprint — route 80%+ of requests through Haiku/Sonnet and escalate only complex decisions to Opus

  2. Audit your agent harness architecture against the future-proofing test by end of Q2 — document where scaffolding is tightly coupled to specific model behaviors and set removal dates for each component

  3. Evaluate whether a domain-specific 7B advisor model could lift your product's AI performance, using the UC Berkeley paper as a template, and scope a fine-tuning sprint for Q3

Google AI Mode Is Collapsing the Purchase Funnel — Your Discovery Strategy Needs Emergency Triage

A usability study on Google AI Mode produced data that should trigger an emergency review of any product team relying on search-driven acquisition. The funnel isn't broken — it's been replaced.

The Data

  • 88% of users adopted AI-generated shortlists without any changes or verification
  • 74% selected the top-ranked result (average chosen rank: 1.35)
  • 64% made purchase decisions without ever leaving the AI interface
  • Only 23% visited external sites at all

For context, Google Ads averages 3–5% conversion. Paid social rarely breaks 2%. AI-referred traffic converts at 30–40%. The purchase funnel isn't awareness → consideration → conversion anymore. It's AI recommendation → acceptance. Your meticulously optimized landing page, your A/B-tested CTAs, your competitive comparison page — none of it matters if the user never arrives.

The Trust Mechanics Are the Strategy Surface

What determines whether you're the AI's top pick? The study found trust in AI Mode recommendations is driven by:

  • AI wording/framing: 37% of decisions — users evaluate how the AI describes your product, not the product itself
  • Brand recognition: 34% — established brands get a structural advantage before any comparison happens
Users aren't evaluating products — they're evaluating how the AI describes products. The optimization surface just shifted from your website to your structured data.

For challenger brands, this is alarming: incumbents start with a 34% structural trust advantage. Your counterweight is shaping the entity signals and structured data that influence how AI frames your product.

Google's Next Move Confirms the Direction

Google's upcoming Universal Commerce Protocol will add conversational attributes (FAQs, use cases) to product feeds, explicitly building infrastructure for AI agents to match products to natural-language queries. A separate ecommerce test showed that a dedicated organic product feed drove 92% more free listing revenue, 83% more visibility, and 55% higher CTR than paid feeds. Your product data layer is becoming your most important acquisition asset.

The Entity-Level Game

Rankings in AI Mode are driven by entity-relationship alignment, not keyword relevance. Pages lose rankings when their entity mix doesn't match search intent, even if the content is highly relevant. This is a fundamentally different optimization discipline than traditional SEO — and almost no one is deliberately managing it yet.


The competitive implication is stark: AI-mediated discovery creates winner-take-all dynamics far more extreme than traditional search. Position 1 in Google organic was always valuable; position 1 in AI Mode is the only thing that exists for 74% of users.

What to do

  1. Run an AI Mode audit this week: query your top 20 product-related terms in Google AI Mode and document where you appear (position, wording, competitor context, gaps vs. organic rankings)

  2. Create a dedicated organic product feed optimized independently from your paid feed by end of Q2, adding conversational attributes (FAQs, use cases) per Google's Universal Commerce Protocol spec

  3. Begin tracking how major AI systems describe your product and brief your brand team on the 37%/34% trust split — establish a quarterly 'AI brand perception' monitoring cadence

Claude Is Becoming the OS — Companies Are Building In, Not Alongside, and Vertical AI Is the Collateral Damage

This week may be remembered as the week Claude stopped being a tool and started being a platform. The evidence is no longer speculative — it's enterprise leaders making irreversible distribution bets.

The Platform Signals

  • Carta CEO Henry Ward announced fund managers can run queries inside Claude's desktop app — not through an API, but inside the application
  • Zoom CTO Xuedong Huang confirmed meeting notes will flow into Claude workspaces seamlessly
  • Claude for Word entered beta — Anthropic going where Microsoft's 1B+ Word users already are
  • Claude Cowork went GA with SCIM-based role controls, per-team budgets, usage analytics, and OpenTelemetry tracing that feeds into SIEM tools

These aren't integrations. They're distribution concessions — category leaders choosing Claude as the work surface. This mirrors how apps once built into Salesforce or Slack, ceding the UI layer to a platform in exchange for access to its user base.

The Vertical AI Reckoning

The most actionable signal from the HumanX conference wasn't a keynote — it was an unnamed investor admitting they now doubt the prospects of highly valued legal AI companies because of Claude's expanding capabilities. That's not commentary; it's a capital allocation decision rippling through every vertical AI company's next fundraise.

If your moat is 'we fine-tuned a model on domain data,' that moat erodes with every Claude update. Your defensibility must come from workflow embedding, proprietary data loops, or regulatory infrastructure.

The Carta playbook is instructive for survival: they're not competing with Claude's reasoning — they're making their proprietary fund data accessible through Claude's interface. That's complementary positioning, not competitive. Contrast this with vertical AI companies whose entire value is "better AI on domain data" — they're the ones investors are marking down.

Enterprise Governance Becomes the Table Stakes

Multiple sources confirm that Claude Cowork's GA launch with RBAC, group spend limits, and observability (Zapier and Airtree already deployed) has moved the enterprise governance bar. ServiceNow simultaneously launched a Context Engine embedding AI governance directly into workflow execution. Cisco acquired Galileo to add AI observability into Splunk. The pattern: governance is migrating from admin panel to execution layer.

If you're selling AI features to enterprises, procurement teams now have a reference point for what 'enterprise-ready' means. The three adoption blockers Claude Cowork solves — IT approval (SCIM/SIEM), finance tracking (per-team budgets), and impact measurement (usage analytics) — are prerequisites, not nice-to-haves.

The Contradiction Worth Watching

There's a tension in the data: 80% of white-collar workers bypass company AI tools, while Citigroup demonstrates a 75% reduction in account-opening time using AI. Ramp reports 99% internal AI adoption. The gap between these data points is the product opportunity — and the answer consistently points to embedding AI into existing workflows rather than making it a separate tool. Products that require users to manually transfer AI outputs into action workflows will lose to products that execute autonomously.

What to do

  1. Conduct a 'platform dependency audit' by end of April — map every feature against what Claude and ChatGPT can now do natively or through integrations, categorizing each as complement (safe) vs. substitute (threatened)

  2. Explore Claude desktop integration as a distribution channel — reach out to Anthropic's partnerships team to understand the integration framework Carta and Zoom are using

  3. Ensure your enterprise AI features include RBAC, spend controls, and usage analytics by next major release — benchmark against Claude Cowork's GA feature set

The bottom line

The AI cost-quality frontier just bent in your favor: Anthropic's advisor pattern doubles quality scores while cutting costs 12%, and it's a one-line API change. But the platform layer is consolidating fast — Carta and Zoom are building into Claude, not alongside it, and Google AI Mode is collapsing the entire purchase funnel into a single AI recommendation that 88% of users accept blindly. The PM who moves first on multi-model architecture, AI discovery optimization, and platform positioning this quarter captures structural advantages that compound; everyone else is optimizing a world that no longer exists.