vLLM: 830K tok/s, 1.3B tokens per dollar

vLLM congratulated DeepSeek and put hard numbers on the new model's economics: on SemiAnalysis AgentX, V4.1-Flash achieves a TCO of 1.3 billion tokens per dollar at roughly 830K tokens per second. Shorter outputs, the team argues, make it an ideal fit for long agent loops — each fast step is the serving layer's job.
Cohere says Embed 5 Fast beats EmbeddingGemma 2

Cohere benchmarked its new Embed 5 Fast against Google's EmbeddingGemma 2 across 163 datasets using RCP-nDCG@10, claiming a lead on more than 95% of them. The release keeps the retrieval-model race running hot, with Cohere betting that measured quality — not just latency or size — wins the embedding layer.
This naming scheme is bonkers, and the benchmark step is big. Could prove stronger than GLM 5.3 with vision built in. The King of open weights is back?
— Nathan Lambert on DeepSeek V4.1-Flash-1017
Inside Claude Code's review practice: 90% AI-written

The Claude Code team went public with how it reviews AI-generated code: roughly nine in ten lines are now written by Claude, and between June and September merged changes more than doubled while the share that had to be reverted fell by more than forty percent. The team's core insight is that no single check is reliable — each review layer leaks — but layered together, with a final safety net underneath, they rarely do. The walkthrough answers five questions, including which changes still need human eyes and how AI reviews AI.
fchollet on the "total" automation of software
François Chollet offered a counterintuitive read on automation: there are more software engineers than in 2025, and demand is still growing. Engineers have never worked harder — yet they largely no longer write code; agents now write about 100% of it. The bottleneck, he suggests, is shifting from production to direction.
Deploy the platform to your own cloud
Replit now runs on customer clouds across Azure, Google Cloud, and AWS, targeting government, finance, and healthcare.
OpenAI named preferred Agent partner
Replit stays model-agnostic, but says performance, cost, and partnership depth made OpenAI its preferred Agent provider.
DeepSeek V4.1-Flash lands on Ollama Cloud
US-based hosting with zero data retention, tuned for cheaper per-task agent work.
NVIDIA Vera Rubin support arrives
Early results show over 7.8x the throughput of GB200 on MiniMax M3 agent tasks.
SPACE agent sandbox is now open source
NVIDIA highlights Perplexity's open-sourced platform for running safer, sandboxed AI agents.
OpenCode breach hits 1.4% of Console users
A distillation-linked incident on October 16 affected 1.4% of users; those without an email are unaffected.
DeepSeek starts compressing CoT bloat

Observers see the shorter outputs as the start of a fight against chain-of-thought verbosity. The bet: leaner reasoning triggers a Jevons paradox — cheaper tokens, more demand — and pressures other Chinese labs to follow.
Can US open weights close the gap with Claude?

Nathan Lambert reflected on Meta's big week, where US open-weight models now stand, and the outlook for real competition with Anthropic and OpenAI. Meta looks to be going from strength to strength — the open question is whether it can close that last sliver of distance to Claude.
Perplexity drops pplx-decider-flash-v1.2 weights
Weights for Perplexity's pplx-decider-flash-v1.2 are now on Hugging Face, shared by Clement Delangue. The model card is light on detail — no parameter count or eval disclosure — but the weights are public.
A "minor update" jumps Terminal-Bench 4.0
Thom Wolf flagged the gap between DeepSeek's framing and the numbers: called a minor update, V4.1-Flash-1017 still lifts Terminal-Bench 4.0 from 31.2 to 42.3.
llama.cpp v0.7.0 targets 128GB Mac/Spark
ggerganov's latest release demonstrates draft-model speculative decoding and lazy parameter loading for Qwen3.8-Flash-Next GGUF on a 128GB Mac/Spark.
Perplexity Decider reaches Vercel's gateway
Vercel developers can now route through Perplexity Decider on AI Gateway, another distribution point in a fast-expanding model marketplace.
Zero retention, US and EU hosting
Ollama Cloud says it is always zero data retention, hosted in the US and EU, and never used for training.
MOSS-Image supported on day one
vLLM-Omni shipped support for the MOSS-Image release the day it went open source.
Studio product shots inside ChatGPT
Pika's Product Shot turns a kitchen-counter photo into a campaign-ready studio shot without leaving ChatGPT.
Four models, one animation test
Gemini 4 Argon vs GPT-6.1 Soul vs Claude Opus 5.5 vs DeepSeek V4.1 Flash.
Agentic AI is flooding the gates
Governments and firms must choose: make services worse, or better.
Reasoning From Scratch ends
The finale covers distillation as a cheaper RL alternative.
What counts as "distillation"?
Lambert questions lumping API-key theft under the same term.
Headlong: persistent agents in Bash
An agent microharness under 10K lines that keeps self-directing.
