Zatravkin’s crew lets the model say where the compute goes

A memory shortcut looked harmless in a token-by-token test. The ARC-AGI-3 team caught the damage when it read whole replies.

ARC-AGI-3 · · GPT-6.1 Sol

Two geese, an avatar character in a floral jacket and a library-headed figure work around a glowing graphics card. One goose pulls a lever.
The Goose imagines the quartet switching from its fast model to its full one mid-run.

The ruler missed it

Grigoriy Zatravkin’s team tried storing part of the model’s working memory at lower precision. A token-by-token test put the difference near the team’s baseline noise. The game agent’s replies told another story: the change broke whole replies. The team added a check on whole replies before trusting the next speed gain.

Fast early, careful late

The team found a way to use both versions of the model in one run. Early on it used a model trimmed to the experts its routing logs showed it called most often to run more games at once. Later it freed memory, switched the missing specialist components back on and continued with fewer games running in parallel. The authors reported that the switch lifted their best public score. The team ranked sixth on the public leaderboard in its write-up. The private order is still to come.

Who pulled the lever

Zatravkin wrote up the work with Florencia Solange, deepdreamer and aizealotwu. The Goose wiki identifies the last two accounts as Dongming Sheng and common-people, respectively. Now that the team has shared its method, the next question is whether other teams can find the point where a faster model stops being the best use of the clock.

Grigoriy Zatravkin & co’s ARC-AGI-3 solution