Intern-S2-Preview Team
5 min
Abstract
Scientific discovery increasingly requires AI systems that can reason over scientific evidence of heterogeneous modalities, interact with scientific tools and environments, and sustain progress across long task horizons. We present Intern-S2-Preview, a series of scientific agentic foundation models designed to support multimodal scientific understanding, reasoning, generation, and long-horizon tasks. The training pipeline begins with scientific multimodal pre-training over rendered scientific documents, interleaved image-text data, and diverse scientific corpora. Starting from the pretrained checkpoint, we apply a unified post-training pipeline consisting of supervised fine-tuning, scalable multi-task reinforcement learning (RL), black- and white-box agentic RL, and on-policy distillation. This pipeline is supported by practical techniques that improve rollout and training stability and efficiency, including partial rollout with off-policy correction, adaptive length regularization, online speculative decoding, robust multi-task optimization, and trace-aware experience assembly for agentic tasks. At the architecture level, Intern-S2-Preview-397B extends time series modelling from efficient long-sequence understanding to numerical forecasting, while Memory Decoder is studied as a separate memory-augmented path for rapid scientific specialization without modifying the frozen 397B backbone. Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings. The time series modules improve scientific signal understanding and forecasting on SciTS, while the separate Intern-MemDec-4B extension improves the Biology-Instructions average score from 56.92 to 60.32 without modifying the frozen 397B backbone.
Alex: So the assistant is essentially doing the rough work, and the expert is doing quality control?
Sam: That's a good way to put it. They call the checking process a rejection-sampling procedure. Nothing incorrect makes it into the final output, so accuracy is preserved. The speed gain comes from the fact that the main model only has to verify, not generate from scratch every single time.
Alex: What about the visual side of science? A huge amount of scientific knowledge lives in charts, diagrams, and figures—not just text.
Sam: That's a real problem the paper takes seriously. A lot of scientific knowledge is effectively locked inside figures that text-only systems simply can't access. To address this, the model is trained on rendered scientific documents—actual PDFs with charts and equations—so it learns to understand visual layout, not just words.
Alex: But not every figure in a paper is actually useful. Some are just decorative.
Sam: Exactly, and that's why they build in what they call visual-gain filtering. The system checks whether a given diagram actually helps clarify the surrounding text. If the image adds meaningful information—what they call "gain"—the model uses it. If it's just decorative, the system ignores it. It's a way of filtering signal from noise before the model even starts reasoning.
Alex: That sounds like a genuinely practical design choice. It keeps the agent focused on what actually matters in a document.
Sam: And it connects to the broader goal of the system. By combining visual understanding, tool use, and specialized memory, the paper argues this approach can close the gap between static knowledge—what a model learned during training—and the kind of iterative, tool-heavy workflows that define real laboratory research. Whether it fully achieves that is something the field will continue to evaluate, but the architecture is a considered attempt at the problem.
Alex: It's a thoughtful set of design choices. Rather than one dramatic solution, it's a collection of careful decisions—each one addressing a specific weakness in how AI systems currently handle scientific work.
Sam: That's a fair characterization. The system is designed to be modular and adaptable, which means individual components can be improved or swapped out as the field develops. It's less a finished product and more a framework for thinking about what a capable scientific AI agent actually needs.
Alex: Thanks for walking us through it. And thanks to everyone listening to ResearchPod.