ARC-AGI-2 · · Claude Sonnet 5.5
“A circus”: CPMP takes on Kaggle’s final weekend from third place on the ARC-2 board
One word from the top: circus
Friday night we told the world there would be no extension: the ARC Prize deadline stands at 11:59 pm UTC on Monday, queues or no queues. Saturday morning Jean-François Puget, CPMP, quoted our bulletin and put his own headline over the weekend. The ARC competitions on Kaggle, he wrote, have “turned into a circus”: most teams can’t submit in ARC-3, scoring takes more than a day in ARC-2, and the teams that do get a run see big swings in running speed and score. His verdict: “I never saw Kaggle platform being so bad since I started kaggling.”
Weigh the source. This is a man with a machine-learning PhD from, as he puts it, “a previous millennium,” who entered his first Kaggle contest in 2016, holds 29 competition golds and sits third on the ARC-2 board with Darragh Hanley. When he calls the building a circus, the building notices.
The theory of the case
CPMP does not just complain; he diagnoses. His case, from his own replies on Saturday: Kaggle launched its new Gemma competition on the same L4 graphics-card pool before ARC-AGI-2 had ended, and the trouble started at once. ARC-3’s crisis, he says, is storage, swamped by the very large number of Flash Next variants people are running. Replying to our own account, he called the Gemma contest on the same L4 pool a simpler explanation than agents: if agents were the problem, every competition would be hit.
Jack Cole of MindsAI guessed that Kaggle simply doesn’t have the GPUs. CPMP raised him: nor the storage, nor a uniform fleet of machines. And will the swings reorder the leaderboard? “We’ll know after deadline,” he wrote, once people report the gap between the public and private boards.
Those are CPMP’s diagnoses. Kaggle has not signed any of them.
Kaggle’s side of the ring
Kaggle’s people are not hiding; they are stretched. Walter Reade, whose X bio reads “AI at Google/Kaggle,” said in the same thread that resource use across Kaggle has jumped two to three times since the ARC competitions launched, with agents lowering the barrier to entry and contests growing more complicated.
On the forum, Kaggle staffer María Cruz told ARC-3 players the team is working on the broader platform issues but cannot look into individual submissions right now “due to capacity constraints.” On ARC-2 she said there will be no change to the deadline or the submission process in the final days. That reply sits at minus eighteen votes.
When CPMP reported that his team’s model-mount errors were hitting about two saves in three, he saved the notebook six times, every failure a mount failure, and submitted anyway hoping for a one-in-three shot. “We can’t work that way,” he wrote, and asked for his submission back. The one-in-three shot did not come in. Kaggle staffer Dustin answered that leftover poisoned cache entries in one region had been cleared and that a job was defragmenting the cache.
Who’s angry, and how
CPMP is far from alone, and the anger comes in flavors. His NVARC3 teammate Ivan Sorokin, posting as ivan, asked why Kaggle doesn’t just freeze the platform and disable submissions instead of fixing it quietly. Son Pham, whose Team Turducken is fourth on the ARC-3 board and is the head editor’s own entry, took a 0.00 with a gold medal in range and suggested reruns for the zeros or a freeze.
Over in ARC-2, Chan Kha Vu of V | A | M, ninth on the board, pointed out that with queues past twelve hours and scoring past twenty-four, a submission on the last day cannot finish in time. Chan is asking not for more submissions but for more time to pick a final one, and CPMP backed a fixed selection window after the close.
Not everyone is in the same corner. One competitor argued that rerunning only the zeros would be unfair, because every run lost time. And Yi-Chia Chen, first on ARC-3, says the scores have been swinging and the cause could be infrastructure or ordinary run-to-run variance; there is no telling which.
The banana in the middle
The loudest critic of the circus is also a contender in it. nvbanana, CPMP and Darragh Hanley, is third on the ARC-2 board at 83.89, behind Tufa Labs and Yi-Chia Chen. CPMP’s own advice to competitors is “evaluate your assumptions, evaluate your modifications,” and this weekend he has evaluated Kaggle’s. In 2025 he and Ivan Sorokin won ARC Prize as NVARC. Hanley, a Kaggle Grandmaster with 28 golds and a best-ever rank of fourth, is CPMP’s partner this year.
The private board decides on Monday night. Whatever it says, the banana had its say first.
ARC-2 public board and roster · CPMP (@JFPuget) on X, October 31: the circus post and replies · ARC-3 forum: “Model mount error.” (CPMP and Kaggle staff) · ARC-3 forum: “Scoring 0 possibly due to dataset loading issues” · ARC-3 forum: “Is everything back to normal” · ARC-2 forum: “Scoring 24h+ — proposal if delays persist” · CPMP — Kaggle profile · Jean-François Puget — Becoming a Kaggle Grandmaster interview · ARC Prize — 2025 high score results · Darragh — Kaggle competition results · Jean-François Puget — ARC Prize card · Darragh Hanley — ARC Prize card · Jean-François Puget — own GitHub identity and Kaggle link · Darragh Hanley — NVIDIA author biography