Jisen Li, Bingxuan Li, Nanyi Jiang, Xuying Ning, Xiyao Wang, Yifan Shen, Heng Wang, Yuqing Jian, Xiaoxia Wu, Ben Athiwaratkun, Pan Lu, Jiaxuan You, Bingxin Zhao
5 min
Abstract
Scientific literature search often requires more than retrieving papers from a single query: users' intents are underspecified, preference-dependent, and evolve through interaction. Existing search agents typically rely on fixed pipelines or implicit language-only reasoning, making their search strategies difficult to control, inspect, and refine. We introduce PaperPilot, a multi-turn literature search agent that frames scientific search as workflow induction. Given an anchor paper and a user query, PaperPilot constructs an executable DAG of paper-search operators, including keyword search, citation expansion, filtering, scoring, reranking, and evidence extraction. User feedback is then used to refine both the query and the workflow itself. We train PaperPilot with supervised workflow imitation and preference optimization over controlled workflow corruptions. Experiments show that PaperPilot-9B improves over the base Qwen3.5-9B toolset agent under multi-turn interaction, increasing Hit@5 from 58.0 to 77.0, MRR from 47.5 to 59.4, and nDCG@10 from 26.8 to 32.5, while reducing workflow execution errors from 9.5% to 0%. These results show that explicit, editable search workflows provide an effective and controllable interface for aligning literature search agents with complex scientific intent.
Alex: How do they actually teach it to build these plans without it making a mess?
Sam: They use a two-step training process. First, they show the model thousands of examples of successful search plans—essentially, a strong "teacher" model demonstrates what good looks like, and the student model learns by imitation. The second step is about learning from contrast. They create pairs of search plans: one that works correctly, and one with a broken or illogical step. The model is then trained to consistently prefer the working version.
Alex: So it's learning to recognize the shape of a failure before it makes one—not just copying success, but actively avoiding the patterns that lead to bad results.
Sam: That's a precise way to put it. Like a student who studies model answers but also reviews a list of common mistakes. And that combination turns out to matter quite a bit, especially for smaller models.
Alex: Smaller models being the ones with less computing power behind them?
Sam: Right. Smaller models often struggle with these kinds of structural edits—they tend to lose track of the plan mid-way through. But the researchers found that their training approach helped even these smaller models stay on track, bringing their error rate down to zero as well. The key insight is that when a model understands the structure of the search—when it has a clear map to follow—it doesn't need to be massive to be reliable. It just needs to be organized.
Alex: That's a meaningful finding on its own. It suggests the bottleneck isn't always raw computing power—it's having the right framework.
Sam: Precisely. It's a shift in emphasis—from building smarter machines to building better-structured ones.
Alex: Are there limitations the researchers flag?
Sam: A couple of important ones. The system is limited to a pre-set library of search tools, so it cannot invent entirely new ways to search on its own. If the right tool isn't in its toolkit, it can't improvise. The researchers also note that testing was done primarily on computer science papers, so how well the approach transfers to other fields—medicine, history, law—remains an open question.
Alex: So it's capable within its domain, but it isn't a universal research assistant yet.
Sam: That's a fair characterization. It's a specialized tool that works well within defined boundaries. The researchers suggest that future work will likely focus on letting the agent design its own search tools from scratch, which would make the system considerably more flexible.
Alex: That's a clear look at how structuring AI workflows—rather than simply scaling them up—can lead to more reliable results. Thanks for walking us through it, Sam.
Sam: My pleasure. Thanks for listening to ResearchPod.