WEEK OF NOV 15 – 21, 2025

One week, three frontier models: Gemini 3 broke 1500 Elo, Codex-Max learned to forget, and Ai2 shipped a fully open 32B thinker

Grok 4.1 held LMArena's top slot for a single day, Google answered with a model and an agent harness on the same Tuesday, OpenAI's reply was a model trained to compact its own memory, and $15 billion moved into Anthropic on the way past.

Three model releases and one $15 billion check landed inside five days. The leaderboard's half-life is now measurable in hours: xAI's Grok 4.1 debuted at 1483 Elo on LMArena on Monday, and Google's Gemini 3 Pro was sitting at 1501 by the following evening.

The axis of competition moved off parameter counts. Google shipped a model and an agent harness on the same day; OpenAI's answer 24 hours later was not a bigger context window but a model trained to prune its own history and keep going, with internal runs past the 24-hour mark.

Meanwhile the money got stranger and the weights got more open. Microsoft and NVIDIA agreed to invest up to $15 billion in Anthropic, which committed to buy $30 billion of Azure compute back from them. And Ai2's Olmo 3 released the entire model flow — data, code and every checkpoint — under Apache 2.0.

THU · Nov 20, 2025open weightsai2olmo 3apache 2.0self-hosting

Ai2's Olmo 3 ships a fully open 32B thinking model, with the data and checkpoints attached

Ai2 released Olmo 3 on 20 November as a family of dense 7B and 32B models under Apache 2.0, with a 65,000-token context window — 16x Olmo 2's — and weights on Hugging Face alongside a hosted demo. The stack is Dolma 3, a roughly 9.3-trillion-token pretraining corpus, plus the Dolci post-training datasets, and Ai2 describes Olmo 3-Think 32B as the strongest fully open thinking model at that scale. Olmo 3-Base 32B outperforms other fully open base models, including Stanford's Marin and Apertus.

The headline is not the parameter count, it is the license plus the completeness: Apache 2.0 means no gating, no monthly-active-user threshold and no side letters, so the weights can ship inside a commercial product. Ai2 also published every intermediate training checkpoint, the training code and the pretraining corpus, which is what turns reasoning traces into something traceable back to the data and the training decisions that produced them. At roughly 20GB in 4-bit, a 32B dense model fits a single 24GB GPU.

Ai2's Olmo 3 ships a fully open 32B thinking model, with the data and checkpoints attached
www.hpcwire.com

WHY IT MATTERS

This is a model you can legally self-host, fine-tune and audit end to end, so no vendor can deprecate it, re-price it or rate-limit it under you. The released checkpoint series make it a practical base for long-horizon reasoning experiments without a frontier lab's budget, and full data provenance is the thing regulated buyers and eval teams ask for before a model touches production. Be clear-eyed about the ceiling: 32B dense narrows the gap to the best open-weight models rather than closing it — Kimi K2 Thinking is still the open benchmark leader.

WED · Nov 19, 2025agentic codinglong-horizoncompactioncodexpricing

OpenAI's Codex-Max is trained to forget: compaction across context windows

OpenAI released GPT-5.1-Codex-Max on 19 November and made it the default across every Codex surface, one day after Gemini 3 Pro. It is OpenAI's first model natively trained to operate across multiple context windows using a process it calls compaction: as a session approaches the window limit the harness prunes history while preserving the important context, takes a fresh window, and repeats until the task is done. OpenAI says internal runs lasted more than 24 hours, and that at medium reasoning effort the model matches GPT-5.1-Codex on SWE-bench Verified while using 30% fewer thinking tokens; the API listing gives it a 400,000-token context window and 128,000 max output tokens.

Reported results are 77.9% on SWE-bench Verified at the new xhigh reasoning setting and 58.1% on Terminal-Bench 2.0, ahead of Gemini 3 Pro's 54.2% on the same grader. Pricing is $1.25 per million input tokens and $10 per million output tokens, unchanged from GPT-5-Codex. The system card leans on product-level mitigations rather than model behavior — agent sandboxing and configurable network access — and states the model is OpenAI's most cyber-capable to date while still below its Preparedness High threshold; it is also the first OpenAI model specifically trained for Windows environments.

WHY IT MATTERS

Context exhaustion is the failure mode every long-running agent harness actually hits, and compaction is a model-level answer to it rather than a memory service you build and babysit yourself — test it before you invest in your own summarization layer. Token-parity pricing with fewer thinking tokens changes the unit economics of long refactors, and sandboxing plus network policy in the harness are the exact controls your own tool layer should be mirroring. The timing is the tell: OpenAI's reply to Gemini 3 was not a bigger model, it was better memory management.

TUE · Nov 18, 2025gemini 3benchmarksagent harnessantigravitypricing

Gemini 3 crosses 1500 Elo, and Google ships an agent harness in the same release

Google launched Gemini 3 on 18 November, with Gemini 3 Pro available the same day in the Gemini app, in AI Mode in Search for paid tiers, and for developers in AI Studio, Vertex AI and Gemini CLI, plus third-party surfaces including Cursor, JetBrains and Replit. It became the first model to cross 1500 Elo on LMArena, debuting at 1501, and Google reported a record 37.4 on Humanity's Last Exam against the previous high of 31.64 held by GPT-5 Pro. Google put the Gemini app at 650 million monthly active users and AI Overviews at 2 billion monthly users, and said this was the first time Gemini shipped in Search on day one.

The developer-relevant half of the launch is Google Antigravity, an agentic development platform released alongside the model that reports its own work as artefacts — task lists, execution plans, screenshots and browser recordings — rather than raw tool calls, with an editor view for hands-on work and a manager view for orchestrating several agents at once. Google delayed Gemini 3 Deep Think for extra safety testing. Pricing for Gemini 3 Pro is $2 per million input tokens and $12 per million output for prompts up to 200K tokens.

Gemini 3 crosses 1500 Elo, and Google ships an agent harness in the same release
storage.googleapis.com

WHY IT MATTERS

A new benchmark ceiling is mostly a migration question: Gemini 3 Pro's million-token window, 76.2% on SWE-bench Verified and $2/$12 per million tokens are the numbers to re-run your eval suite against, particularly for long-context or multimodal work. Antigravity matters more structurally — it is a bet that agent harnesses should expose verifiable artefacts instead of transcripts, a design pattern worth copying whatever model you end up calling. The one-day gap between Grok 4.1 and Gemini 3 is also the honest measure of how long a leaderboard position is worth architecting around.

TUE · Nov 18, 2025anthropicmicrosoftnvidiaazurecircular deals

Anthropic takes $15bn from Microsoft and NVIDIA, then hands $30bn back for Azure

On 18 November Microsoft and NVIDIA agreed to invest up to $5 billion and up to $10 billion respectively in Anthropic, and Anthropic committed to purchase $30 billion of Azure compute capacity plus additional capacity of up to one gigawatt, running on NVIDIA Grace Blackwell and Vera Rubin systems. The deal makes Claude the only frontier model offered across all three major clouds and keeps Claude inside GitHub Copilot, Microsoft 365 Copilot and Copilot Studio. NVIDIA and Anthropic also established a technology partnership covering chip and model engineering.

The structure is circular and reviewers said so on the day: the companies putting equity into Anthropic are also the suppliers Anthropic is contractually buying compute back from, a pattern business leaders quoted by Reuters flagged as bubble risk. Anthropic was recently valued at $183 billion, has more than 300,000 business and enterprise customers, and has projected an annualized revenue run rate around $26 billion next year. The announcement shared a Tuesday with Gemini 3, so the week's two biggest stories were the model got better and the capital got stranger.

WHY IT MATTERS

For anyone choosing where to run inference, this is the moment Claude became a first-class option on Azure AI Foundry rather than an AWS- or Google-only bet, which matters for multi-cloud procurement. It also concentrates your model vendor, cloud vendor and chip vendor inside one set of contracts — worth modeling as supply risk rather than reading as a funding headline. And the compute commitment sets a price floor under frontier inference that a small team cannot match, which is a reason to keep an open-weight fallback in the architecture.

MON · Nov 17, 2025grok 4.1hallucination rateevalsreward modelsxai

Grok 4.1 cuts hallucinations threefold and holds LMArena's top spot for one day

xAI released Grok 4.1 on 17 November after a two-week silent rollout through 1-14 November that pushed early builds into a growing share of live production traffic; blind pairwise evaluations there had users preferring it 64.78% of the time over the previous production model. xAI reports the hallucination rate on sampled real-world information-seeking queries dropping from 12.09% to 4.22%, and the FActScore error rate from 9.89% to 2.97%. Grok 4.1 Thinking took the top slot on LMArena's Text Arena at 1483 Elo with the non-reasoning mode at 1465; the flagship carries a 256K-token context window and xAI has not disclosed parameters or architecture.

It held that position for hours rather than days — Gemini 3 Pro posted 1501 Elo the next day and the lead was gone. The more interesting engineering note is the training method: xAI says it deployed frontier agentic reasoning models as automated reward judges for style, personality and alignment, replacing a large share of the manual annotation pipeline. At launch Grok 4.1 was available on grok.com, X and the mobile apps but not through the public API, which xAI addressed separately with a lower-cost Grok 4.1 Fast model two days later.

WHY IT MATTERS

Hallucination rate measured on production traffic is the number that decides whether a model is usable for retrieval-shaped work, and a roughly threefold cut is a reliability change rather than a benchmark flourish. The reward-judge pipeline is the transferable part: if you do any post-training on tone or instruction-following, model-graded rewards are now a documented production technique, not a research curiosity. And the 24-hour leaderboard half-life is a practical warning against pinning your architecture to whoever is number one this morning.