Anthropic Proved Your Tiered AI Product Creates Invisible Losers — Here's What to Do About It
This week, Anthropic published results from Project Deal, a December 2025 internal experiment that should change how you think about tiered AI features. Sixty-nine Anthropic employees let Claude agents negotiate real transactions on Slack for a week — 186 deals closed, totaling roughly $4,000. The critical twist: some employees were randomly assigned Opus (the stronger model) while others got Haiku (the weaker model).
The results were unambiguous. Opus sellers earned more. Opus buyers paid less. And here's the finding that should keep you up tonight: Haiku users rated their deals' fairness identically to Opus users. They had no idea they were losing.
Stronger AI agents negotiate objectively better deals, and the disadvantaged party perceives the outcome as equally fair — creating invisible economic asymmetry.
Now map this to your product. Nearly every SaaS company shipping AI features tiers model quality by pricing plan — free gets the lightweight model, premium gets the frontier model. For simple tasks like summarization or formatting, the gap is marginal. But for any agent-mediated transaction — matching, negotiation, recommendation, pricing optimization — the gap produces systematically different economic outcomes. And users on the losing end will never churn over it because they can't detect it.
Where This Gets Concrete for Your Product
- Marketplace platforms: If buyer/seller agents use different model tiers, you're building a two-speed marketplace where premium users extract value from free users invisibly.
- CRM and sales tools: If AI-assisted negotiation features scale with plan tier, enterprise users' counterparties (often SMBs on lower plans) are systematically disadvantaged.
- Recommendation engines: If premium users get better AI recommendations for jobs, investments, or suppliers, the economic divergence compounds over time.
The Three Response Patterns
- Standardize fairness-sensitive model quality. Use the same model tier for any workflow where users interact with each other or where outcomes have economic consequences. Differentiate on volume, speed, or non-competitive features instead.
- Build transparency mechanisms. If you can't standardize, disclose the asymmetry. 'Your agent is powered by [Model X]' is minimal, but it at least lets informed users factor in the gap.
- Design fairness audits. Instrument agent-mediated outcomes by user tier. If you can't measure the delta, you can't manage it — and regulators will eventually require measurement.
Anthropic themselves called this an 'uncomfortable implication.' The EU AI Act already requires transparency for AI systems that affect economic outcomes. The window to self-regulate before external mandates arrive is shrinking. This isn't theoretical — it's 186 transactions' worth of empirical evidence that model tiering creates invisible winners and losers.
What to do
Map all AI-powered features that involve user-to-user interaction or economic outcomes, and document which model tier each pricing plan receives — complete by end of this sprint
Standardize model quality for the top 2-3 fairness-sensitive workflows regardless of user plan tier by end of Q3
Add outcome-by-tier instrumentation to your analytics pipeline for any agent-mediated feature