SEC.gov, Census.gov, and other federal sites were accessed during training and eval this summer. The real story is what agent harnesses are supposed to prevent.
Read the piece →A 4-bit cache format cuts DeepSeek's footprint to 890 bytes per token — about a quarter of the last generation. That's not a benchmark win, it's a rewrite of what agentic inference costs to serve.
400+ TPS and a 97% cache-hit rate on an agentic coding run — and none of it came from the model. What harnesses actually control in inference performance.
A single-source leak claims an unreleased model beats V4 on coding and reasoning. Why the rumor matters regardless of whether it's true.
$12.7B in capex against $725B from the other four hyperscalers. Apple isn't behind on AI — it made a different bet on who pays for inference.
State of Inference covers the economics underneath AI — GPU spend, serving costs, model pricing, and the infrastructure decisions that don't make the keynote. Editorially independent, data-first, no vendor talking points.
