Product & Strategy

The Product Desk

The Signal

Shared Claude chats containing API keys landed in Google search results.

A user clicks Share, gets a link, and sends it. She never opened the visibility dropdown, because the default already said public. That is the failure mode most share and export flows carry: public by default, noindex that did not survive an external link, and revocation parked several clicks deep in settings. Teams tell themselves users choose their sharing scope. The logs say users accept whatever the dialog opened with. The forcing function for this week is a site: search run against every public-link surface in the product.

In Play

  1. Share-Link Defaults Became a Public Incident

    Publicly shared Claude conversations — some containing API keys, crypto wallet details and resumes — surfaced in Google and Bing results, as IBTimes UK reported. Anthropic's robots.txt directive did not prevent it once links were referenced externally. Any share, export or collaboration flow you own inherits that exact failure mode. Team and Enterprise accounts were never exposed, which shows tier-based defaults did contain the blast radius.

    Ask Clarity
  2. Routing and Cache Rates Now Set AI Margins

    Exponential View's read of Vercel's AI Gateway leaderboard shows OpenAI, Anthropic and Google taking 90% of spend while serving 52% of tokens — more than 8x revenue per average token. Cursor's router reportedly matched perceived output quality at roughly 60% lower cost, and one Cursor experiment fell from $10,000 to $1,300. Your inference line is a routing default nobody revisited since launch, not a vendor price you have to accept.

    Ask Clarity
  3. Configuration Beats Model Choice on Quality

    Devshot's reporting puts numbers on configuration: Claude reviewing Codex's work lifts pass rate from 71.6% to 89.7%, while Codex reviewing Claude's drops accuracy from 91.4% to 82.8%. Agent success tracks edit format just as hard — 94% with JSON Patch versus 66% with unified diff. These are settings, not model swaps, so the largest available quality gain on your AI features costs no engineering time.

    Ask Clarity
  4. Proof Buyers and Math Buyers Need Opposite Roadmaps

    a16z's Joe Schmidt and Julian Marx argue that the signing buyer's career exposure — not user pain — decides product architecture: Harvey sells proof at an $11B valuation, while Stuut goes live in under a week against 6-18 months for legacy accounts-receivable rollouts. They also count roughly 500 marquee accounts every AI startup is pitching simultaneously against ~50,000 uncontested companies outside those networks. Classify your primary segment before you rank the backlog.

    Ask Clarity
  5. AI Spend Growth Outran Measurable Outcomes

    DX's Q2 report puts median quarterly AI spend up 28x year over year without matching outcome gains, and Refactoring forecasts the budget reckoning for H2 2026. NVIDIA got 3x committed code across 30,000 developers with no bug increase, but only after rebuilding its workflow around review and testing; a separate dataset shows epics finishing 66% faster with 54% more bugs per developer. A commit-only dashboard renders both of those as the same win.

    Ask Clarity
    Try

Deep Dives

Your Share Button Is a Publishing Endpoint

The default that exposed API keys was never reviewed by anyone, and the same three-part test — private state, durable noindex, findable revocation — applies to every export flow you already shipped.

The mechanism, precisely

Start with the user. Someone clicked Share to send one conversation to one colleague. What that click actually did was build a public web page. Anthropic's robots.txt already instructed crawlers to skip those pages, and it made no difference. Once the link is posted externally, to a forum or a blog or a tweet, search engines reach the page through that reference regardless of the directive. IBTimes UK found conversations containing API keys, crypto wallet details and resumes sitting in Google and Bing results. Google de-indexed most of the pages by Thursday. Anthropic had issued no public comment as of publication. Revocation does exist, and it lives under Settings > Privacy > Shared Chats, which is why most affected users never found it.

The developer rebuttal circulating alongside the story, these weren't leaks, users chose to make them public, is technically correct and strategically worthless. What teams tell themselves users do is read the dialog and model the consequence. What users actually do is read "unlisted public URL" as "a link for one person." Closing that gap is a product decision, not a support-doc decision.


Where the reporting converges

Three independent reads differ only in framing, which is itself informative. TLDR IT is emphatic that this was not a breach of Anthropic's systems but a share-link design failure, and calls the resulting opening for private-by-default AI products the cleanest opportunity in the cycle. Techpresso files it inside a wider trust punch list, alongside two findings most teams have not tested for: visual style transformations reliably slipping images past safety filters, and asset-selecting agents preferring copyrighted images, with violation rates rising under time pressure. That last one quietly converts a latency budget into a compliance variable. Cyberpresso pairs the story with a Claude Code symlink bug that pulls files from outside the project directory into startup context and ships them to a model endpoint with no approval step.

Read together, the industry's most repeated privacy own-goal is not a model problem. It is a defaults problem, and it recurs because defaults have no owner in most PRDs.

The one control that worked

Anthropic's tier segmentation held. Team and Enterprise accounts were never affected. Only Free, Pro and Max were exposed. That is the reusable lesson. Stricter share defaults and admin-controlled share policy on business tiers contain the blast radius and hand sales a governance story. Containment and positioning rarely arrive in the same feature.

The three-part test for any public-link surface

  1. Is the default state private, with public exposure requiring an explicit, worded opt-in?
  2. Does noindex survive external propagation, verified with a live site: search rather than an assumption about crawler behavior?
  3. Can a user revoke a shared snapshot in one click, from a surface they can actually find?

Most implementations pass the first and fail the second and third.


Why the window is short

The enforcement pattern sets the urgency. LG banned residential-proxy functionality outright on webOS after security firm Spur found 42% of store apps letting third parties route traffic through users' televisions, mostly via embedded SDKs. Bright Data's defense, that users opt in through a consent screen, was rejected on discoverability grounds rather than legal ones. LG did not adjudicate. It prohibited, with no grace period.

robots.txt is a request to well-behaved crawlers, not a privacy control — and your users read "share" as "send this to one person."

The move is small and fast. Sweep the public-link flows, add explicit "this will be publicly visible" copy to the confirmation step, ship link expiry, and move revocation somewhere a panicking user finds in ten seconds. This is the cheapest incident a team will ever prevent, and now one that can be funded against a named precedent.

What to do

  1. Run a site: search audit against every public-link, share and export surface in your product, and document the default state, noindex behavior and revocation path for each.

  2. Ship tier-based share defaults this sprint — private-by-default plus admin-controlled share policy and expiry on team and enterprise plans.

  3. Add explicit 'this will be publicly visible' confirmation copy and one-click revocation to every sharing flow before the next release.

The Cheapest Quality Wins Are Settings, Not Models

Reviewer roles, edit formats and cache-hit rates move both output quality and inference cost further than any model swap, and every one of those levers sits in a file your team already controls.

The asymmetry nobody configured for

A team wires a second model into the review step, sees the reviewer field populate in the logs, and writes "multi-model review" in the sprint notes. Here's what the pairing numbers actually show. Claude in the reviewer seat lifted pass rate on Codex's work from 71.6% to 89.7%. Reversing the roles lowered accuracy from 91.4% to 82.8%. Reviewer roles are not interchangeable, and the degradation is silent, because what gets recorded is the presence of a second model rather than the quality of the output. The edit-format result has the same shape: one agent hit 94% with JSON Patch where another managed 66% with unified diff. Both are scaffolding decisions with effectively zero engineering cost.

Prompt scaffolding is now debt

The prompting playbook inverted for the current Claude generation. Anthropic cut more than 80% of its Claude Code system prompt with no measurable eval loss. Rigid "never" rules now block good outcomes instead of preventing bad ones. Typical rewrites land at one-third to one-tenth the original length, with capability loaded on demand through skills. The constraint block someone tuned last quarter is spending tokens and quality at the same time. It is the cheapest item on this list.


The margin side of the same file

Exponential View's calculation from Vercel's AI Gateway leaderboard is the number worth carrying into the next planning review: the Big 3 labs collect 90% of spend on 52% of tokens, more than 8x revenue per average token, while non-Big-3 providers already carry 48% of real production volume. Separate the thing being pitched from the thing being done. Cursor's router on Auto Intelligence mode reportedly produced output users judged just as good at roughly 60% lower cost, and one Cursor experiment fell from $10,000 to $1,300. Cursor's planner/worker swarm went further, matching or beating an all-premium approach on a SQLite rebuild benchmark with less code and fewer conflicts. That last result is single-vendor-reported; treat the pattern as a hypothesis to validate on your own workload, not a proven default.

Cache-hit rate beats the price sheet

The most underrated cost mechanic surfaced in Moonshot's Kimi K3 pricing, per ChinAI's reading of the Chinese-market coverage: 20 RMB per million tokens for a cache miss versus 2 RMB for a cache hit, a 10x swing, with the headline blended rate assuming 70% cached input, 20% fresh and 10% output. Workload shape drives the bill more than model choice does. A feature P&L built on a flat per-token assumption can be off by an order of magnitude in either direction.

Two guardrails before the router ships

  • A blind perceived-parity gate: humans comparing routed against premium output on real tasks. Cursor's advantage rests on perception, and eval-only discipline over-provisions compute forever. The 34-point gap between human and LLM-judge scores on one model in a blind seven-model test is the reason a judge model should not pick the production tier.
  • Per-node token caps: Anthropic's own figures put a single agent at roughly 4x the tokens of a chat interaction and multi-agent systems at ~15x, with every added node multiplying concurrent spend.

Where the sources disagree

The cost floor is genuinely contested. The Information reports OpenAI found a method to halve inference cost by stretching existing compute, which argues for re-scoring features killed on unit economics. Pointing the other way: Nvidia is reported to be taking a cut of some customers' cloud revenues, Oracle's AI data centers hit multibillion-dollar overruns, and memory rather than GPUs is the binding constraint, with prices rising. The forcing function is straightforward. Model every AI feature P&L as a band, not a point, then ship only what survives the pessimistic end of the band.

A feature that only works at the optimistic end of the inference curve is not a feature. It is a bet on someone else's cost structure.

What to do

  1. Swap reviewer roles and edit formats in your agent scaffolding this sprint, then re-measure pass rate against your current baseline before touching model selection.

  2. Instrument cost-per-request, model used, task class and a user-visible quality proxy on every AI endpoint you own this sprint.

  3. Run a routing A/B on your two highest-volume AI features this quarter — cheap default with complexity-triggered escalation — gated on a blind human parity test, targeting 40-60% COGS reduction.

Proof Buyer or Math Buyer Decides Your Next Two Quarters

Verifiability depth and sub-week deployment are mutually exclusive roadmaps, and picking the wrong one hands your wedge to an incumbent shipping AI on a quarterly clock.

The exposure test, mechanically

The general counsel who has to sign reads the pilot terms twice and signs nothing. She is not confused about the pricing. She is doing arithmetic on what happens to her if the model invents a number. The diagnostic a16z's Joe Schmidt and Julian Marx published is not an industry lookup. Buyer exposure climbs on three specific axes: whether the industry is regulated, in which case a vendor's mistake becomes the buyer's compliance problem, whether the product replaces a system of record or sits alongside one, and whether output faces the outside world. In law and financial services all three run hot, so one fabricated figure can misprice a position. The signer is managing personal downside no discount offsets. In support and receivables automation, a bad reply annoys a customer and gets fixed. The downside is a bad quarter, not a career.

The tiebreaker matters more than the framework. When budget and math point one way and exposure points the other, exposure wins every time. The authors concede the diagnostics only resolve cleanly at the extremes, which is honest and also means the middle of the market stays a judgment call.


Two roadmaps, and they are not compatible

DimensionProof buyer (Harvey, Hebbia)Math buyer (Decagon, Stuut)
What closes the dealSomeone credible went first"We cut this spend in half"
Cycle length3-6 months or longerOver 60 days means you misread the market
Product requirementDepth, citations, verifiability, custom toleranceStandardization, self-onboarding, fast time-to-value
Proof portabilityHigh — firms watch each otherLow — the controller in Des Moines does not care
EvidenceHarvey: A&O late 2022, Paul Weiss early 2023 → hundreds of millions ARR, $11B. Hebbia: >40% of largest asset managers by AUM, including KKR and BlackRockDecagon: 0 → 8 figures ARR in 18 months, 100+ new enterprise customers in 2025, valuation tripled to $4.5B in under 6 months. Stuut: live in under 1 week vs 6-18 months

The copilot trap is a product decision

The sharpest line in the framework has nothing to do with sales motion. Zendesk adding an AI copilot is a fundamentally different product from Decagon replacing the support function. Thomson Reuters and LexisNexis surface information for an associate to interpret. Harvey drafts, researches and runs due diligence itself. The pitch deck calls both of those "AI for legal work." Buyers experience one as a faster lookup and the other as headcount. Retrieval-and-assist is the incumbent's game, and the incumbent already owns the customer, which is why Alex Rampell's constraint reads as a sequencing rule rather than a slogan: you need to get distribution before the incumbent gets innovation. Every quarter SAP, Oracle, HighRadius or Zendesk ships more AI, switching costs rise, and the wedge narrows.

Where the second read tightens the argument

The market-timing evidence corroborates the math side hardest. Refactoring's read of DX's Q2 data, spend up sharply with outcomes that are not "outrageous", puts the budget reckoning in H2 2026. That is when math buyers stop accepting usage metrics and start demanding cost per resolved outcome. Seats logged in and prompts sent are not value, and by then nobody will pretend otherwise. The useful grid has exposure on one axis and assist-versus-replace on the other. High exposure plus replacement means the pilot converts on audit trails, not on price. Low exposure plus assist means instrumented outcome proof is the product, not the deck.

Read the case studies with one eye closed

Every hero example here is a16z-affiliated, and Stuut's headline outcomes (+40% cash flow, −70% manual tasks, −37% collection period) are vendor-sourced and unaudited. Use the framework's logic and benchmark against internal cohort data instead. The two named failure modes are worth pinning above the backlog regardless: a lighthouse for one, a product perfect for a single marquee account and useless elsewhere, and grabbing land you cannot hold, where 50 unhappy customers is churn and 500 is a reputation problem.

The transition from proof to math is earned, not chosen — the signal is buyers arriving with allocated budgets asking for a demo instead of asking who went first.

What to do

  1. Classify your primary segment against the two exposure questions and write the answer into the assumptions section of your next PRD, before the next planning cycle closes.

  2. Instrument time-to-first-value as a tracked metric with a named owner and target this quarter, and audit onboarding for every step requiring a human from your team.

  3. Install a three-account threshold before building any requested feature, with a carve-out for generalizable exposure work such as audit logs, citations and permissioning.

The bottom line

Audit the settings nobody has reopened since launch — share defaults, routing tiers, reviewer roles — because configuration, not model choice, now decides your product's economics and its trust.