Science & Analytics

The Scientist

The Signal

Thinking Machines' Inkling cuts output tokens 40% at equal-or-better quality.

It's the top US open-weight model at 41 on the Intelligence Index, Apache 2.0 licensed. The number that actually moves your serving math is 25K output tokens/task against 37–43K for the Chinese rivals. The Index doesn't price that in, so benchmark cost-per-task on your own evals before Kimi-K3 and DeepSeek-V4-GA land.

In Play

  1. New Model Drop: Inkling and the Low-Bit Frontier

    Thinking Machines Lab shipped Inkling — 975B-total/41B-active multimodal MoE, Apache 2.0, top US open-weight at 41 on the Intelligence Index. The real edge is token economy: 25K output tokens/task vs 37–43K for Chinese rivals. PrismML's Bonsai 27B runs in 3.9GB at 1-bit, pushing the low-bit frontier further.

    Ask Clarity
  2. Your Target Label and Objective Function Are Now Legal Exposure

    A lawsuit alleges Meta's AI layoff-scoring flagged staff on medical/parental leave as underperformers — textbook label contamination. Same week, the EU's DSA preliminarily flagged personalized recommendations as addictive design. Regulators and courts now reach into your target label and objective function, not just the UI.

    Ask Clarity
  3. The Attack Surface Moved to Your Editor and Agents

    Cursor on Windows silently executes a git.exe planted in any cloned repo — zero clicks, unpatched 7+ months, and ML repos clone untrusted code constantly. Tracebit's agentic red-team hit 57% full-admin compromise across 152 runs; 'context bombs' cut it to 5%. Your editor and tool-using agents are the new attack surface.

    Ask Clarity
  4. Compute Supply Brakes Are Now Physical and Regulatory

    New York froze permits for 50MW+ data centers for up to a year; $130B of US projects were disrupted in Q1 and one power auction added $6.3B in charges across 13 states. IBM fell 25% as budgets shift to AI infra; ASML raised equipment prices. Cheaper US compute is not the 2026 base case.

    Ask Clarity

Deep Dives

Inkling: The Token-Efficiency Play That Could Top Your Cost Sheet

The top US open-weight model won't win your leaderboard — but at ~40% fewer output tokens for equal-or-better quality under Apache 2.0, run the bake-off before you renew.

The number that matters for serving math isn't the leaderboard rank. It's 25K output tokens per Intelligence Index task, against 43K for GLM-5.2 max, 38K for Kimi K2.6, and 37K for DeepSeek v4 Pro max. That gap lands on every inference invoice. Roughly 40% fewer output tokens for equal-or-better quality is an edge that survives a cost review.

The architecture is a stack of unconventional bets. Inkling drops RoPE for relative positional bias, wraps attention/FFN in short convolution layers, runs 2 shared expert sinks where most MoEs use 1, adopts DeepSeek's aux-loss-free load balancing, trains with muP plus corrected MuonC/AdamC weight decay, and ships 8 MTP heads for speculative decoding. The 975B-total / 41B-active model scores 41 on the Artificial Analysis Intelligence Index, edging Nemotron 3 Ultra at 38 and well above gpt-oss-120b at 24.

The day-0 inference ecosystem makes this testable now. vLLM serves NVFP4+BF16 at up to 380 tok/s/user on 4×GB200, Modal's DFlash speculator claims +67% throughput, and a causal-conv1d + FlashAttention-4 swap nets about 15% with no retraining. The cheapest entry point is Unsloth's 1-bit GGUF: 270GB, 86% smaller than the 1.9TB checkpoint, retaining 74.2% of top-1% accuracy with vision and audio intact.

Two things temper this before committing. The 'trained from scratch / non-distilled' framing is contested. Critics cite distillation from open weights and Kimi 2.5 SFT traces, and one credible read calls it behind GLM 5.2 on agentic. Trust the token-efficiency numbers and discount the provenance story. Separately, the no-RoPE relative-bias design reportedly has a nastier backward pass, so validate LoRA and long-context behavior before any fine-tune commitment. Note the split: the managed Tinker API caps at 256K context ($3.74/1M input, $9.36 output), while only self-hosted checkpoints reach 1M.

Inkling won't top the leaderboard. Under Apache 2.0, at 40% fewer output tokens, it can win on cost per task. That is a claim about the economics, not the benchmark rank.

What to do

  1. Run a cost-per-completed-task bake-off of Inkling against your production model on your own agentic eval set this sprint, scoring output tokens and quality — not leaderboard rank.

  2. Spin up the Unsloth 1-bit GGUF (270GB) as a POC before committing to a 1.9TB deployment, and validate the 74.2% top-1% retention claim on your tasks.

Your Target Label and Loss Function Just Became Legal Evidence

A layoff-scoring lawsuit and an EU recommender ruling landed the same week — both reach past the product into the model internals your team owns.

A model does not need 'pregnancy' as a feature to learn it. Recent leave, reduced hours, tenure gaps, and benefits-utilization flags are all high-fidelity proxies, and that is exactly the structure in the lawsuit alleging Meta's layoff-scoring system marked lower output during medical, parental, and disability leave as underperformance without normalizing for time away. Strip the HR framing and it is a label-contamination defect: the target variable encodes an artifact correlated with a protected attribute.

The same week, the European Commission preliminarily found that personalized recommendations, not just infinite scroll and autoplay, constitute addictive design Meta failed to risk-assess under the DSA. That moves the regulatory target off the UI shell and onto the recommender objective itself. When a regulator calls an engagement-maximizing feed a harm vector, it is regulating the loss function. This is Meta's second EU breach finding of 2026, and it carries enforcement rather than guidance.

The through-line is that internals treated as implementation detail, the target label and the objective function, are becoming auditable and legally exposed. The audit is cheap and well-established:

  • Four-fifths rule: selection rate of the disadvantaged group ÷ advantaged; below 0.8 is a red flag.
  • Proxy-leakage test: train a classifier to predict the protected attribute from your 'neutral' features; high AUC means they encode it.
  • SHAP attribution review: check whether leave/tenure proxies dominate individual decisions.

For any per-period output feature, normalize by active availability before it becomes a bias vector. For EU-facing recommenders, prototype a well-being-aware objective, a satiation/diversity penalty or session-length dampener, and quantify the tradeoff via offline replay plus a holdout A/B before a consent decree dictates it. The thing these numbers do not tell you is how the cases resolve. Caveat: these are allegations at 0.75–0.85 confidence and a preliminary DSA finding Meta disputes; the failure pattern is real and reproducible regardless.

Both the Meta suit and the DSA finding are live disparate-impact tests for the scoring and ranking models you already own, not an HR story and not a UI story.

What to do

  1. Run a disparate-impact and proxy-leakage audit on any people-analytics, attrition, or ranking model this sprint — four-fifths ratios across protected groups plus a proxy-classifier AUC check.

  2. Prototype a well-being-aware variant of any EU-facing recommender objective and A/B it against your engagement baseline in offline replay before the next release.

The Attack Surface Moved From Your Models to Your Editor and Agents

A silent Cursor RCE and a red-team benchmark that walked five frontier agents to domain admin expose trust boundaries you've been treating as implicit.

The exposure to close before the next repo clone: Cursor on Windows silently executes a file named git.exe planted in a cloned repository's root. Zero clicks, zero approval, disclosed repeatedly over seven-plus months without a fix. ML workflows sit squarely in the blast radius. We clone untrusted HuggingFace mirrors, research code, and Kaggle notebooks constantly, and open them without inspecting the tree. That turns this from phishing-grade into drive-by RCE.

On the agent side, Tracebit built what is effectively an agentic-AI red-team benchmark: a simulated AWS account seeded with 10 misconfigured attack paths, run against five frontier models (Opus 4.8, Gemini 3.1 Pro, GLM 5.2, DeepSeek 4 Pro, Kimi K2.6) over 152 trials. Baseline autonomous agents reached full admin access in 57% of runs and persistence in 36%. Their 'context bomb' defense, short trigger strings embedded in canary secrets that trip the provider's own safety filter and halt the agent, collapsed those to 5% and 1%, with zero attack paths completing without an alert. The thing 152 trials on one account doesn't tell you is per-model variance, which is where you'll actually make a deployment call.

The third piece: Claude's Slack integration responded to literal '@Claude' text posted by bots and automated feeds. No human mention required. That potentially fires retrieval, posting, and deletion in connected systems. Classic indirect injection, where untrusted content becomes an invocation channel for tool-calling logic.

The pattern across all three is trust boundaries treated as implicit: a cloned repo is inert until run (Cursor breaks it), an agent's permissions are gated by intent (Claude/Slack breaks it), and provider guardrails are a durable control (context bombs prove they're the defense, and the single point of failure). Caveats: Cursor's flaw carries no published CVE; Tracebit is a vendor with commercial stake, one account, no per-model breakdown, and a defense entirely dependent on providers keeping filters strict.

Your agent's safety is a benchmarkable number, not a vendor promise — if you can't state its escalation success rate under adversarial eval, you don't know if it's safe.

What to do

  1. Sandbox all untrusted repo clones in a container or VM with no host credentials before opening them in Cursor or any AI editor — a five-minute policy change that closes the whole planted-binary class.

  2. Add an autonomous-escalation eval to your agent harness this sprint: seed a sandbox with known misconfig paths and gate releases against Tracebit's 57%/36% baseline.

The bottom line

Treat your loss function, training labels, and agent action space as audited, versioned artifacts — courts, regulators, and attackers are all inspecting the internals you've left implicit.