To grade the whole agent harness instead of the model, we gave it a simulated world state it could actually change.
A persistent REPL lets the agent hold 200 emails in memory and spend three lines of context on them.
A coding agent gets a forgiving environment and a grader for free. Our domain gives neither, so we built both.