Touch supplies the physical grounding needed to perceive intrinsic material properties, such as friction and compliance, that vision alone often cannot resolve. Recent efforts for equipping multimodal LLMs with this tactile sense, however, expose a zero-sum trade-off: the limited parameter budget of compact models forces a choice between acquiring the new sensory modality and preserving the established vision-language reasoning. We present Splash, a mask-isolated tactile alignment learning framework for MLLMs. Splash quantifies the significance of each pretrained parameter, and partitions the parameter space into a dormant and critical subspace. While the frozen critical subspace acts as a stable anchor to safeguard general visual knowledge, Splash updates the isolated dormant subspace to internalize tactile alignment towards LLMs. This selective, non-destructive expansion effectively prevents catastrophic forgetting and ensures non-destructive modality expansion. Extensive experiments show that Splash effectively achieves tactile reasoning without additional inference overhead in the LLM part, demonstrating state-of-the-art performance on visuo-tactile benchmarks, including SSVTP, TVL, and TacQuad, while preserving its original general-purpose capabilities.
Alex: Welcome to another episode of ResearchPod.
Sam: Today we're looking at a framework called Splash — and the puzzle it's trying to solve is this: how do you teach a compact robot to understand tactile sensations — like whether an object is slippery or firm — without making it forget how to see?
Alex: So this is about expanding a robot's senses without breaking its existing knowledge?
Sam: Exactly. When you train a small AI model to learn a new skill, it often overwrites what it already knows. This is a well-documented problem in machine learning called "catastrophic forgetting." It's like trying to learn a new language by erasing your memory of your native one.
Alex: So what's the mechanism they use to keep that existing knowledge safe?
Sam: They use a technique called parameter isolation. Think of the AI's brain as a library. Instead of rewriting every book on the shelves, they identify which books are critical for general knowledge and lock them away. The remaining sections — the ones that are rarely used — are where they do the new work, filling them with tactile data.
Alex: So the critical parts stay frozen, and the quiet, underused parts get repurposed?
Sam: Precisely. They call this a "dormant subspace." By only updating these specific, less-essential connections, they sidestep catastrophic forgetting. It's a way to expand the model's range without needing a bigger, more expensive system.
Alex: How do they actually decide which parts are dormant and which are critical?
Sam: They run a sample of visual data through the model and measure how much each connection contributes to the robot's vision and language skills. If a connection is weak or rarely active during visual tasks, it gets marked as dormant. Think of it like a performance review for every single connection in the AI's brain — the ones that aren't pulling their weight are the ones they feel safe reassigning.
Alex: Are there guardrails to make sure they don't accidentally reassign something important?
Sam: Yes. They keep the very first and very last parts of the model completely frozen. Those layers handle the most fundamental understanding — recognising that something is an image at all, and producing a final answer — so they're off-limits. Everything in between is fair game, as long as it passes the dormancy test.
Alex: And does being that selective actually produce better results than just retraining the whole model?
Sam: The evidence suggests it does. By being surgical about which connections they update, they achieved stronger tactile reasoning while actually improving the robot's general-purpose vision skills at the same time. The key insight is that targeted updates outperform wholesale changes — because when you change everything at once, the old knowledge has nowhere to hide.
Alex: That's a satisfying logic. But I imagine it's not a complete solution yet?
Sam: That's a fair point. The dormant subspace is fixed once training begins. It doesn't adjust in real-time if the robot encounters something unexpected. So if it's never been trained on, say, a wet surface, it can't spontaneously reroute itself to handle that.
Alex: So it's not fully adaptive yet.
Sam: Not yet. The researchers point to what they call "dynamic masking" as a direction for future work — where the robot could re-evaluate which parts of its brain are dormant based on whatever object it's actually touching in the moment. That's a harder problem, but Splash lays the groundwork for it.
Alex: So for now, they've shown you can add a new sense to a compact robot without the usual trade-offs. A solid foundation, with room still to build on.
Sam: That's a good summary. The significance here isn't just the tactile capability itself — it's the principle that a well-targeted, minimal update can outperform a full retraining. That has implications well beyond touch sensing. Thanks for listening to ResearchPod.