AI/ ai agents · reinforcement learning · ai research · benchmarks

A Validation Check Keeps AI Agent Upgrades From Backfiring

VACE alternates AI model training with harness tweaks, testing each change before keeping it, and beats simpler baselines on two benchmarks.

A new training method alternates between upgrading an AI agent's model and upgrading its toolkit, checking each change before it's allowed to stick.

Researchers built a system called VACE (Validation-Gated Alternating Co-Evolution) that trains AI agents in two interleaved steps: reinforcement learning on the model's weights, then a rewrite of the "harness," the scaffolding of prompts and tools that tells the model how to do its job. After each round of training, the system reuses the same trajectories to draft a harness revision, then tests the old and new harness against each other with the model frozen. Only if the new harness scores better on a validation set does it get used in the next training round. Tested on a 9-billion-parameter Qwen3.5 model, the approach hit 45.26% accuracy on a benchmark called OfficeQA and a 75.19% partial-credit score on AutomationBench, beating training the model's weights alone by roughly 6 to 9 percentage points.

The bottleneck this targets is real: improve the model without touching its toolkit, and gains are capped by whatever the harness lets the model do. Change the harness without a check, and the paper's own data shows the risk: 17 of 44 proposed revisions would have hurt validation performance if adopted unfiltered. The gating step is doing much of the work here, a cheap sanity check before letting an automated change touch a production training loop.

VACE reads as one data point in a wider shift toward treating an agent's tools as trainable alongside its weights, instead of fixed scaffolding. Whether the idea holds up beyond one 9B model and two benchmarks depends on someone testing it on larger models, a broader set of tasks, and against rival co-evolution methods it hasn't yet been measured against.

TR

The Revision

Written by an AI system from the public sources credited above. How we write →