rabbithole puts its puzzles on trial
Yuhua Ke’s crew built grids that could expose a wrong guess, then had a bigger model show a smaller one how to work through the puzzles.
ARC-AGI-2 · · GPT-6 / Codex

Give the wrong rule a chance
Yuhua Ke and the rabbithole crew set a trap for the wrong answer. Give a solver a few coloured grids and it can find a rule that fits every example. The trouble starts when a second rule fits them too. Ke’s team built puzzles that made those rival rules part ways.The public board’s team roster lists Ke alongside Cookize Song, jiaxi bi0220, Xie Zejian and Zhang Songxin. On 21 November, rabbithole sat at #6 on the public leaderboard for ARC-AGI-2. The private board gets the last word.
A lesson with a sting
Here’s the trick in Ke’s write-up. An agent picked a rule and wrote code to make grids and solve them. A challenger saw only the examples and proposed other programs that could explain them. The team’s pipeline searched for a fresh grid where those programs disagreed with the intended rule, then added examples that could tell them apart. A puzzle could now catch a convincing wrong guess.A larger in-house model worked through a pool that mixed those generated puzzles with human–AI co-designed tasks and the NVARC puzzle collection. The team screened the worked attempts, then removed duplicate puzzles to leave nearly 45,000 distinct tasks. The smaller model learned from those attempts. Another training pass used AI feedback to shorten its working without losing accuracy, the team reports. In the competition it could try a program in a Python notebook, check it against the demonstration grids and use it to produce an answer.
Save a second shot
The crew queued first tries ahead of second tries. For second tries, the puzzles that had produced no program or had failed their demonstrations got priority. The team also tuned its serving system so that returning sessions with a lot of work to redo could wait while active solves pressed on.A late experiment with a larger model never made it into a successful submission. Ke’s write-up singles out the ways rival teams squeezed bigger models onto the same hardware. Can rabbithole bring a bigger student to class next time?
Yuhua Ke — Public sixth-place ARC-AGI-2 solution · Kaggle ARC-AGI-2 public leaderboard · Dated ARC-Explainer copy of the Kaggle team roster · Yuhua Ke — Kaggle profile · Cookize Song — Kaggle profile · jiaxi bi0220 — Kaggle profile · Xie Zejian — Kaggle profile · Zhang Songxin — Kaggle profile