BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation | Peiyan Li et al. | ResearchPod

Transcript: BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation

Alex: Welcome to another episode of ResearchPod. Today, we're looking at a new study on how robots learn to interact with the world around them.

Sam: We're discussing a framework called BridgeVLA++. It's designed to help robots perform complex physical tasks—like picking up objects—by giving them something they usually lack: a sense of memory.

Alex: So the paper is basically asking how we can stop robots from being "amnesiacs" that only react to what's right in front of them?

Sam: Exactly. Most robots today only look at the current frame of video to decide their next move. Scientists call this being "Markovian"—a technical term for a system that only uses the present moment, with no sense of history. If a robot blocks its own view of a target, or needs to remember a step from five seconds ago, it often fails.

Alex: That makes sense. If I'm trying to place a ring on a specific peg and my own hand hides the peg, I need to remember where it was a second ago. Is that the core problem?

Sam: That's the challenge. The researchers developed a system that uses two types of memory. First, there's temporal memory—think of it as a logbook. The robot keeps a record of the steps it's already completed, so it always knows which step comes next. Second, there's spatial memory, which lets the robot "re-render" the scene from a previous moment to see past any obstacles.

Alex: So it's like a chef who remembers the recipe steps, but also glances back at the original ingredient layout when the counter gets too cluttered?

Sam: That's a good way to put it. The system uses these two memory streams to fill in the gaps—handling tasks where things get hidden or where the sequence of actions really matters.

Alex: How does the spatial memory actually work? If the robot's arm is blocking the view, how does it "see through" its own hand?

Sam: Before the robot starts moving, it takes a snapshot of the entire workspace using something called a "point cloud"—essentially a 3D digital map of the room. This map captures where everything is—the table, the target peg, all of it—before the arm gets in the way. When the arm later blocks the camera, the system pulls up that original map and re-renders the scene from the robot's current angle. Because the map was made before the arm moved into frame, the target appears clearly. Scientists call the problem of objects being hidden "occlusion," and this spatial memory is specifically designed to defeat it.

Alex: Does it have to re-process that entire 3D map every single step? That sounds slow.

Sam: That's a valid concern. To keep it fast, the system doesn't store raw images. Instead, it saves "visual tokens"—compressed, pre-encoded summaries of the data. Think of them as shorthand notes rather than full paragraphs. The robot can pull these from its memory buffer instantly, without re-doing the heavy computation each time.

BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation

Peiyan Li, Yuze Zhu, Yixiang Chen, Qisen Ma, Yuan Xu, Jiabing Yang, He Guan, Yan Huang, Hongtao Wu, Xiao Ma, Tao Kong, Liang Wang, Tieniu Tan

Aug 5, 2026·7:11·arxiv·Original Paper

Vision-Language-Action (VLA) Models3D ManipulationSpatio-temporal MemoryInput-Output AlignmentBridgeVLA++Spatio-temporal memory

Listen

7 min

Briefing

Abstract

Leveraging pre-trained vision-language models (VLMs) to construct vision-language-action (VLA) models has emerged as a promising paradigm for 3D robot manipulation. However, existing 3D VLA methods remain data-hungry, exhibit limited generalization under distribution shifts, and lack explicit memory of past observations. These limitations hinder their application to data-scarce, open-world, and memory-dependent manipulation scenarios. Our previous work, BridgeVLA, improves data efficiency and generalization by preserving the input--output alignment of a pre-trained VLM during 3D action learning: raw point clouds are projected into multi-view images, and intermediate heatmaps are predicted before generating robot actions. In this work, we develop BridgeVLA++ by equipping BridgeVLA with a unified spatio-temporal memory architecture that models persistent spatial context and temporal interaction history. The resulting memory-augmented framework can reason over observation histories while preserving BridgeVLA's data efficiency and generalization capabilities. Extensive experiments show that our framework achieves strong performance on spatial manipulation tasks while exhibiting robust generalization. BridgeVLA++ further achieves state-of-the-art performance on two challenging memory-dependent manipulation benchmarks without sacrificing the data efficiency and generalization of the original BridgeVLA. In addition, BridgeVLA++ performs effectively in bimanual manipulation settings and is validated on an additional real-world robotic platform, demonstrating its scalability across tasks, environments, and robotic platforms. These results establish BridgeVLA++ as a unified 3D vision-language-action framework that simultaneously supports data-efficient learning, robust generalization, and effective memory-aware robot manipulation. Project website: https://bridgevla-plus.github.io/.

BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation: Research Paper Podcast

BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation

Listen