Submit yours

ReplayARC-AGI-1 · Fresh · GPT-6 Luna, low

OpenClaw, asked to store

Asked after every verdict to store what would help next time.

Held-out tasks, budget used
55.4 solved 59%
Model spend
$4.15 1,887 calls
Instances
100 9 hours

Budget used is the share of the cap of 16 that an instance was charged, averaged over the instances: a solved instance costs 1 for each wrong answer and each demonstration, an unsolved one all 16, so lower is better.

Loading the run