Lang Mo, Xingxuan Zhang, Qi Wang, Mingchao Hao, Hao Yuan, Chunjing Gan, Wang Lu, Peng Cui
8 min
Modern agentic systems often struggle to distinguish between semantic comprehension (understanding a task) and empirical inference (learning which action effectively resolves a task based on past outcomes). Current architectures typically couple these processes within a single language model, which limits the ability to independently improve the reasoning mechanisms used to interpret feedback.
This paper introduces Decoupled Predictive Decision Making (DPDM), an architecture that separates these responsibilities. A pretrained language model (e.g., Qwen3.5) serves as a semantic encoder to represent the problem context, while a distinct, shared conditional predictor (LimiX-2) is tasked with estimating outcomes based on historical records. By isolating the inference step, DPDM can improve decisions as more historical data becomes available without ever updating the underlying neural parameters.
The DPDM framework treats agent decisions as history-conditioned prediction problems. It takes task specifications, a query context, and a history of previous (input, outcome) pairs. The semantic encoder maps these inputs into a shared interface. The conditional predictor then processes this evidence to output probabilities for available actions or candidates. The authors emphasize that this modularity enables specialized, reusable conditional predictors to enhance the performance of diverse semantic encoders, regardless of the specific domain, as long as the inputs can be mapped into the shared interface.
Across 50 benchmarks, DPDM significantly outperformed standard few-shot prompting. For instance, with Qwen3.5-27B, DPDM achieved a mean accuracy of 84.92%, compared to 78.80% for few-shot prompting. The system showed marked improvement in tool-use tasks and reasoning-step assessment, where it gained 34.26% and 28.87% in absolute accuracy respectively.
Crucially, the authors demonstrate that these improvements are not simply due to the model 'seeing' more examples. When comparing DPDM to few-shot prompting on identical history sets, DPDM consistently achieved higher accuracy, suggesting it makes more efficient use of the provided feedback. Furthermore, the architecture scales effectively: accuracy reliably improves as the historical record size increases. DPDM also provides significant gains in computational efficiency, reducing GPU time by approximately 80% compared to cached few-shot prompting.
Agent decisions depend on empirical relationships that deployment observations reveal and task descriptions alone may leave unresolved. We introduce Decoupled Predictive Decision Making (DPDM), an architecture that formulates heterogeneous agent decisions as conditional prediction with a shared pretrained learner. Language models provide semantic representations of current and historical records, while a general-purpose conditional predictor predicts task-defined targets from the represented evidence. Pretraining supplies reusable inference capability; deployment evidence instantiates problem-specific predictions without updating either model's neural parameters. Tool judgments, candidate preferences, and reasoning assessments share an evidence-and-query interface, with predictions mapped to choices by a decision rule. This architecture establishes complementary sources of agent capability: semantic knowledge acquired through language pretraining and empirical inference acquired through structured-data pretraining. A single frozen LimiX-2 predictor serves all five task categories. With Qwen3.5-27B as the semantic encoder, DPDM raises mean accuracy across 50 benchmarks from 78.80% with few-shot prompting to 84.92% under their respective evaluated history budgets, and reaches 82.33% with identical histories and queries. On ToolPRMBench's BFCL and ToolSandbox tasks, absolute accuracy gains are 34.26% and 28.87%, respectively, at the methods' respective evaluated history budgets. Accuracy improves as history grows. With identical imbalanced histories, mean balanced accuracy improves by an absolute 14.51% across five reasoning-step assessment tasks and four encoders. DPDM makes learning from experience an independently improvable foundation-model capability, creating a shared route for advances in conditional prediction to improve decisions across agent tasks.
Sam: So the historical record contains other requests, their function descriptions, and the observed answers. What happens to those records?
Alex: A frozen language model acts as a semantic encoder: it turns each record's meaning into numerical features. It represents the current case the same way. Historical answers stay outside that encoding and are supplied separately.
Sam: That keeps the answer distinct from the description of the problem. Where does the actual learning from examples happen?
Alex: In a conditional predictor, meaning a model that estimates an answer from the current case and the available history. Here it's LimiX-2, pretrained on structured data. It receives the represented examples, their answers, and the represented query, then returns answer probabilities.
Sam: And the decision itself is simply whichever answer gets the highest probability? There isn't another language model interpreting the prediction afterward?
Alex: For the main benchmarks, they select the highest-probability answer. The same predictor checkpoint serves different tasks and different language encoders. Each task supplies its own records and defines what an answer means.
Sam: You said the system learns without changing neural weights. What actually changes when new feedback arrives?
Alex: The history supplied to the predictor changes. Some feature transformations can also be refitted using historical inputs. So adaptation isn't computation-free, but neither neural model is retrained; the new evidence changes the prediction through the model's inputs.
Sam: That gives us the mechanism. How large was the advantage over letting the language model read the examples directly?
Alex: With the largest evaluated Qwen encoder, average accuracy rose from about seventy-nine percent with few-shot prompting to about eighty-five percent with the separated architecture. Few-shot prompting means putting answered examples into the prompt. Those headline results use each method's evaluated history budget.
Sam: That qualification matters. If the separate predictor gets more records, perhaps it wins because it sees more evidence, not because it uses evidence better.
Alex: The authors also hold the historical records and test queries identical. In that comparison, the separated architecture reaches about eighty-two percent accuracy. The prompting baseline stays at its previous level, so extra records don't explain the whole advantage.
Sam: A smaller gain, but a more informative comparison. Was that result confined to the largest language model?
Alex: No. The matched-history advantage appears with every evaluated encoder, including smaller Qwen models and a Llama model. The same frozen predictor works across categories ranging from agent tasks to evidence consistency and language understanding.
Sam: What happens as experience accumulates? A system that only works with a carefully chosen small history would be less useful.
Alex: On the subset with results at every tested history size, mean accuracy increased at each expansion for every encoder. The queries and neural weights stayed fixed. Encoding records individually also lets the architecture use histories beyond what fits into a single language-model prompt.
Sam: Historical feedback can also be badly skewed. If most reasoning steps are correct, a system could appear accurate by approving almost everything.
Alex: The authors test that using reasoning-step judgments with identical, imbalanced histories. They report balanced accuracy, which gives correct and incorrect steps equal weight. Averaged across the tasks and encoders, that rises from about sixty percent with prompting to about seventy-four percent with their method.
Sam: So it becomes better at distinguishing the classes, not merely following the common label. But how do we know the predictor uses meaningful relationships rather than some incidental property of the inputs?
Alex: They shuffle historical answers while keeping the input records and class counts unchanged. Performance drops sharply. They also compare repeating existing examples with adding distinct examples; distinct observations help substantially more.
Sam: And that still leaves the language model's contribution. Could ordinary text features do the work without its understanding of meaning?
Alex: Removing semantic features lowers performance while native and lexical features remain available. Taken together, these controls support complementary roles: useful representations, correct input-answer relationships, and genuinely additional observations. They don't establish that every architectural choice is optimal.
Sam: What's the biggest gap between these results and the claim that agents make better decisions in deployment?
Alex: These experiments predict reference answers from supplied histories and held-out queries. That supports better benchmark judgments. It doesn't establish better end-to-end outcomes for an agent acting, collecting feedback, and changing its own future experience.
Sam: So deciding which feedback to collect remains outside what these tests demonstrate. And beating prompting doesn't necessarily mean beating every specialized learner.
Alex: That's how I'd read it. The broad comparisons are primarily against direct language-model prompting, with an external decision-service reference. The evidence is persuasive for this separation against those baselines, not a universal ranking of ways to learn from experience.
Sam: Who should read the full document, and where should they start?
Alex: Researchers building agents, tool judges, or reasoning assessors should start with the identical-history comparison in Section Three Point Two. Then read the method and the evidence controls. Those show what is actually shared, what changes with history, and why the gains aren't just more examples or more common labels.
Sam: And what's the line everyone else should take away?
Alex: Understanding the problem and learning from its history can be separate jobs, with separate models to improve.
Sam: Keep that distinction in mind when you evaluate your next agent.