back to top
HomeTechMiniMax M3 Shows What Happens When AI Stops Thinking in Turns

MiniMax M3 Shows What Happens When AI Stops Thinking in Turns

- Advertisement -

Most models quit around submission 30 because they stop finding improvement and exit on their own. That’s what happened when MiniMax ran a CUDA kernel optimization task against a field of frontier models. Every model except two called it done within the first 30 submissions.

M3’s best result came on submission 145. After 24 hours. After multiple plateaus where the numbers stopped moving and a reasonable model would have concluded there was nothing left to find.

That’s the thing MiniMax released yesterday. An AI model with a 1M token context window, native multimodality, and apparently a problem with knowing when to stop.

What M3 is

M3 is an open-weight model with a 1 million token context window, native multimodal support for images and video, and what MiniMax describes as frontier-level coding and agentic performance. The weights aren’t out yet. MiniMax says that’s coming in about 10 days but the API is live and MiniMax Code, their agent product built specifically around M3, is available now.

Closed models with these capabilities exist. What hasn’t existed until now is one you can actually run, inspect, and build on. MiniMax is explicit that M3 is the first open-weight model combining all three of these capabilities together: long context at this scale, native multimodality from step one of training, and agentic performance that competes with the frontier closed models.

The architecture behind the context window

A 1M token context window is only useful if the model can actually reason across it without the whole thing becoming unwieldy. Most long-context models struggle here, the attention mechanism that makes transformers work gets quadratically more expensive as context grows, and at 1M tokens that cost becomes either prohibitive or a hidden quality tradeoff.

MiniMax built a new attention architecture for M3 called MSA, Minimax Sparse Attention. The short version: instead of every token attending to every other token, MSA partitions the context into blocks and routes attention more precisely. At 1M tokens, per-token compute drops to 1/20th of what their previous model needed. Prefilling runs more than 9x faster, decoding more than 15x faster.

The reason this matters for the agentic story specifically is that long-horizon tasks generate dense, structured context fast. Every tool call, every result, every iteration adds to the pile. A model that degrades as that pile grows isn’t actually useful for 24-hour tasks regardless of what the benchmarks say. MSA is MiniMax’s answer to that specific problem, and the CUDA kernel run is arguably the best stress test they could have picked to demonstrate it.

The benchmarks

BenchmarkNano Banana M3Claude Opus 4.7GPT-5.5Gemini 3.1 ProTop Performer
SWE Bench Pro59.064.358.654.2Claude Opus 4.7
Terminal Bench 2.166.066.178.270.0GPT-5.5
VIBE V250.155.850.528.0Claude Opus 4.7
SVG-Bench63.762.358.259.2MiniMax M3
KernelBench Hard28.830.720.918.6Claude Opus 4.7
BrowseComp83.579.384.485.9Gemini 3.1 Pro
GDPval rubrics74.779.880.657.8GPT-5.5
BankerToolBench76.181.370.067.0Claude Opus 4.7
MCP Atlas74.277.075.369.2Claude Opus 4.7
OSWorld-verified70.082.878.776.2Claude Opus 4.7

All numbers below are self-reported by MiniMax.

On Claw-Eval, which tests end-to-end autonomous agent performance, M3 scores 74.5 against Claude Opus 4.7’s 71.6 and Gemini 3.1 Pro’s 57.8. On SVG-Bench it leads the entire comparison at 63.7, ahead of Opus 4.7 at 62.3 and GPT-5.5 at 58.2. KernelBench Hard, which tests the kind of low-level optimization work the CUDA task exemplifies, has M3 at 28.8 against GPT-5.5’s 20.9 and Gemini’s 18.6, a meaningful gap. SpreadsheetBench puts it at 89.35, competitive with every closed model in the comparison.

The pattern across these isn’t “M3 beats everything.” It’s more specific than that. The benchmarks where M3 leads tend to be the ones that reward persistence, structured output, and long-context coherence. The ones where it lacks are SWE-fficiency, Apex-Agents, OSWorld, tend to favor precise single-step execution or GUI interaction. That’s a consistent profile, not a scattered one, and it matches what the CUDA story already suggested.

Limitations

OSWorld, which tests a model’s ability to operate a real desktop GUI, has M3 at 70.06 against Opus 4.7’s 82.8 and GPT-5.5’s 78.7. That’s not close. SWE-fficiency, which measures how efficiently a model solves software engineering tasks rather than just whether it solves them, has M3 at 34.8 against Opus 4.7’s 42.2. Apex-Agents loses too at 27.7 against GPT-5.5’s 41.7.

M3 is strong when the task rewards persistence and long-context coherence. It’s weaker when the task demands accurate single-step execution, especially anything involving GUI interaction or strict instruction following across many steps. MiniMax doesn’t hide this, the model card flags the agentic gaps directly.

You May Like: Open source AI agentic models built for real autonomous work

How to try it

The API is live now at MiniMax’s platform. Pricing splits at 512K tokens, standard rate below that, higher rate above for long-document and full-repository work. Thinking mode can be toggled per request.

The weights aren’t available yet. MiniMax says that’s coming within 10 days along with the technical report. For now MiniMax Code, their agent product built specifically around M3, is available as a desktop app and runs on token-based subscription plans starting at $20 a month.

Submission 145

Every other model in that CUDA test stopped making progress and exited. M3 kept going and found its best result 115 submissions later. The paper reproduction task is the same story, 12 hours, 18 commits and no human in the loop.

After getting the weights launched on Huggingface, we may get more quantized versions of this model from the community to run on consumer hardware as well.

Don’t miss any Tech Story

Subscribe To Firethering NewsLetter

You Can Unsubscribe Anytime! Read more in our privacy policy

LEAVE A REPLY

Please enter your comment!
Please enter your name here

YOU MAY ALSO LIKE
apple-sues-openai-stolen-secrets

OpenAI Paid $6.5 Billion to Build an iPhone Rival. Apple Says It Was Built...

0
Last year, OpenAI acquired io, Jony Ive's hardware startup, for $6.5 billion. The deal was widely read as OpenAI's clearest signal yet that it was serious about building a physical device, something that could sit in your pocket the way an iPhone does, powered by AI agents instead of apps. A direct challenge to Apple's most important product. On Friday, Apple filed a lawsuit suggesting that challenge was built on a foundation of stolen confidential information through what Apple describes as a coordinated operation directed from the top of OpenAI's hardware division, the same division now tasked with building the device meant to compete with Apple. Apple isn't just alleging that some employees walked out with files they shouldn't have taken. It's alleging that the people now running OpenAI's hardware ambitions actively ran a system to extract Apple's most guarded technical knowledge, and that the $6.5 billion acquisition sits on top of that foundation.
Anthropic Secretly Tracked Claude Code Users. Then Called It an Experiment

Anthropic Secretly Tracked Claude Code Users. Then Called It an “Experiment.”

0
There's a version of this story where Anthropic was trying to protect itself from large-scale model theft. There's another where one of the AI industry's biggest privacy advocates quietly crossed a line its own users never expected. What makes this headline important isn't just that hidden tracking code existed. It's that the company behind it was Anthropic. Just months ago, Anthropic publicly refused to let the Trump administration use Claude to surveil American users. The company defended that position in court, arguing that AI companies shouldn't become tools for government surveillance. That stance became part of Anthropic's identity. Then came a very different decision. In March, Anthropic quietly added hidden tracking markers to Claude Code that flagged users' timezones, proxy connections, and potential ties to Chinese AI labs. The code remained unnoticed until security researcher Thereallo discovered it last week. After the discovery went public, an Anthropic engineer confirmed it on X, described it as an "experiment" intended to combat account abuse and model distillation, and said the company had already planned to remove it. The tracker was taken down shortly afterward. The bigger question isn't whether Anthropic had a reason. It's whether a company that built its reputation on privacy can afford to hide surveillance from the very developers it asks to trust its tools.
Leanstral AI

Leanstral 1.5: Mistral’s AI Built to Prove Math Ended Up Finding Real Software Bugs

0
Mistral built Leanstral to do something most AI models don't attempt, write formal mathematical proofs that a compiler can verify as correct. Not "pretty sure this is right" correct. Mechanically, provably, no-exceptions correct. That's a narrow use case, and the audience for it is small. What nobody expected was that a model trained on IMO-level math problems and abstract algebra benchmarks would end up running against open-source codebases and finding bugs that testing and fuzzing had both missed. Five of them previously unreported on GitHub.