Inkling: The Token-Efficiency Play That Could Top Your Cost Sheet
The top US open-weight model won't win your leaderboard — but at ~40% fewer output tokens for equal-or-better quality under Apache 2.0, run the bake-off before you renew.
The number that matters for serving math isn't the leaderboard rank. It's 25K output tokens per Intelligence Index task, against 43K for GLM-5.2 max, 38K for Kimi K2.6, and 37K for DeepSeek v4 Pro max. That gap lands on every inference invoice. Roughly 40% fewer output tokens for equal-or-better quality is an edge that survives a cost review.
The architecture is a stack of unconventional bets. Inkling drops RoPE for relative positional bias, wraps attention/FFN in short convolution layers, runs 2 shared expert sinks where most MoEs use 1, adopts DeepSeek's aux-loss-free load balancing, trains with muP plus corrected MuonC/AdamC weight decay, and ships 8 MTP heads for speculative decoding. The 975B-total / 41B-active model scores 41 on the Artificial Analysis Intelligence Index, edging Nemotron 3 Ultra at 38 and well above gpt-oss-120b at 24.
The day-0 inference ecosystem makes this testable now. vLLM serves NVFP4+BF16 at up to 380 tok/s/user on 4×GB200, Modal's DFlash speculator claims +67% throughput, and a causal-conv1d + FlashAttention-4 swap nets about 15% with no retraining. The cheapest entry point is Unsloth's 1-bit GGUF: 270GB, 86% smaller than the 1.9TB checkpoint, retaining 74.2% of top-1% accuracy with vision and audio intact.
Two things temper this before committing. The 'trained from scratch / non-distilled' framing is contested. Critics cite distillation from open weights and Kimi 2.5 SFT traces, and one credible read calls it behind GLM 5.2 on agentic. Trust the token-efficiency numbers and discount the provenance story. Separately, the no-RoPE relative-bias design reportedly has a nastier backward pass, so validate LoRA and long-context behavior before any fine-tune commitment. Note the split: the managed Tinker API caps at 256K context ($3.74/1M input, $9.36 output), while only self-hosted checkpoints reach 1M.
Inkling won't top the leaderboard. Under Apache 2.0, at 40% fewer output tokens, it can win on cost per task. That is a claim about the economics, not the benchmark rank.
What to do
Run a cost-per-completed-task bake-off of Inkling against your production model on your own agentic eval set this sprint, scoring output tokens and quality — not leaderboard rank.
Spin up the Unsloth 1-bit GGUF (270GB) as a POC before committing to a 1.9TB deployment, and validate the 74.2% top-1% retention claim on your tasks.