Cheng Qian, Wenting Zhao, Liangwei Yang, Heng Wang, Jielin Qiu, Heng Ji, Silvio Savarese, Huan Wang, Shelby Heinecke
5 min
Abstract
Recent work on distillation transfers the capabilities of large models to smaller ones often by updating the latter's parameters, through teacher forcing, on-policy distillation, and related training-time methods. In this paper, we ask whether such transfer can instead occur at test time. We study strong-to-weak scaffolding: whether a stronger builder model can construct inference-time harnesses that help a weaker target model solve tasks more reliably without any parameter updates. Using four representative Theory-of-Mind benchmarks, each builder model uses 5% of the data as a validation set to iteratively refine its harness over multiple rounds, after which the finalized harness is evaluated on the full test set. Empirically, this form of test-time capability transfer is highly effective, nearly doubling average target-model performance from 0.49 to 0.91. Our analysis shows that the gains come primarily from offloading unstable model reasoning into deterministic code, benchmark-specific routing, and strict answer-format enforcement, rather than from encouraging the target model to reason more extensively or sample more broadly. We further find that builder-model reasoning effort improves harness quality monotonically, platform effects are modest relative to the builder model's own capability, and weaker target models receive the largest gains. These results suggest that inference-time harness design is an important complement to conventional training-time distillation, enabling strong models to transfer cognitive structure to weaker models without retraining.
Sam: So the stronger model is essentially acting as an architect. It studies the task, figures out where the weaker model tends to fail, and builds a workspace that eliminates those failure points.
Alex: That's a precise way to put it. The builder model uses a sample of real task data to test and refine the harness until it performs reliably. It's an automated process — the builder is essentially running experiments on behalf of the weaker model.
Sam: Does the quality of the builder model matter much? Does it need to be extremely capable to produce a useful harness?
Alex: The study finds a consistent pattern: the stronger the builder, the better the resulting scaffold. But even moderately capable builders produce meaningful improvements. The relationship is fairly steady — more builder effort reliably translates to a better harness.
Sam: What kinds of tasks did they actually test this on?
Alex: They focused on social reasoning tasks — problems that require what researchers call "Theory of Mind." That's the ability to understand that other people hold different beliefs, intentions, or knowledge than you do. Imagine tracking a situation like: "She thinks he doesn't know that she moved the object." You have to hold multiple perspectives in your head at once and reason about what each person believes. It's genuinely demanding, even for large models.
Sam: That sounds like mental chess. If you lose track of even one layer, the whole chain of reasoning collapses.
Alex: Exactly. And that's precisely the kind of task where a well-designed harness makes a real difference. By breaking the problem into structured steps and offloading the bookkeeping to reliable code, the scaffold keeps the model from losing its place.
Sam: So the broader shift here isn't really about building smarter models — it's about building smarter environments for the models we already have.
Alex: That's the central argument of the paper. For many practical applications, a carefully designed harness can be just as valuable as scaling up the model itself. It's a different lever — and in some cases, a more accessible one. You don't need to train a new model or spend enormous resources. You need a strong model to study the task and build the right scaffolding.
Sam: That's a meaningful reframing. Instead of asking "how do we make the AI more powerful," you ask "how do we make the task easier for the AI to handle reliably."
Alex: And the evidence here suggests that question is worth taking seriously. Thanks for listening to ResearchPod.