Accurate breast cancer classification from mammography requires effective integration of complementary information from craniocaudal (CC) and mediolateral oblique (MLO) views, which provide a more complete characterization of breast abnormalities. However, existing multi-view learning approaches typically rely on feature-level aggregation or single-stage cross-attention, which can entangle view-specific and shared representations and restrict interaction to limited network depths. To address these limitations, we propose a token-centric dual-view learning framework that unifies prompt-based adaptation and cross-view fusion within a frozen vision transformer backbone. The framework reformulates inter-view interaction as structured token-level communication, where dedicated fusion tokens explicitly encode bidirectional information exchange between CC and MLO views via cross-attention, serving as intermediate carriers of cross-view dependencies rather than relying on direct feature fusion. Unlike conventional methods that apply fusion at a single layer, fusion modules are inserted at multiple transformer depths, enabling progressive and repeated interaction across the encoder hierarchy. Fusion tokens are reintegrated into the token sequence and refined by subsequent transformer layers, facilitating hierarchical propagation of complementary information while preserving view-specific structure. Experiments on VinDr-Mammo and CMMD datasets demonstrate consistent improvements over linear probing, prompt-only adaptation, and conventional fusion baselines. On the VinDr-Mammo BI-RADS classification task, the framework achieves 50.40% F1-score and 0.8090 AUC, including a 0.10 AUC improvement over a dual-view fusion baseline in the binary setting. Ablation studies further validate the effectiveness of token-based fusion and multi-depth interaction design.
Alex: Welcome to another episode of ResearchPod. Today, we're looking at a new way to help AI interpret mammograms—the X-ray scans used to screen for breast cancer.
Sam: That's right. When a patient gets a mammogram, doctors don't just take one picture. They take two: one from above, looking straight down, and one from the side at an angle. Each view reveals different things about the same tissue. The paper asks a simple but important question—can we build an AI that actually uses both views together, the way a trained doctor would?
Alex: And current AI doesn't do that well?
Sam: Not really. Most AI models just dump both images into a blender, so to speak. The result is a single mixed-up signal where the model has lost track of which detail came from which angle. It's like trying to read two books by tearing out all the pages and shuffling them together—you have more paper, but less understanding.
Alex: So the problem isn't a lack of information. It's that the model can't keep the two sources straight while it's thinking.
Sam: Exactly. A radiologist doesn't merge the two views in their head—they flip back and forth, comparing them. They might notice something suspicious in the top-down image and then check the side-angle image to see if it shows up there too. If it does, that's a meaningful signal. If it doesn't, it might just be tissue overlapping by coincidence. The AI needs to do the same kind of cross-checking.
Alex: So how does this paper solve that?
Sam: The authors introduce what they call "fusion tokens." Think of it like two students working on the same puzzle from opposite sides of the table. Instead of grabbing each other's pieces, they each write their most important observations on sticky notes and slide them across. The other student reads the note, updates their thinking, and sends one back. These tokens are small packets of information that travel between the two image streams—carrying what one view has learned to the other—without ever mixing the original images together.
Alex: And because the sticky notes stay separate from the actual puzzle pieces, each student always knows what they figured out on their own versus what they learned from their partner.
Sam: That's the key insight. The model keeps the two views as distinct streams throughout the whole process. The fusion tokens are the only thing that crosses between them, so the source of every piece of information is never lost.
Alex: What's the AI actually built on top of?
Sam: It uses a type of AI architecture called a vision transformer. Without getting too technical, a vision transformer works by chopping an image into small patches—like cutting a photograph into a grid of tiles—and then figuring out how those tiles relate to each other. This particular system runs one vision transformer per view, and the fusion tokens pass between them at several points during processing.
Alex: You said "at several points." Is that important?
Sam: Very. Most systems that combine multiple views do it once, at the very end—after each model has already finished processing its image independently. This paper does it throughout, at multiple intermediate stages. Think of it like reading a complex book: instead of waiting until the final page to compare notes with a friend, you stop after every chapter, share what you've each understood, and carry that updated understanding into the next chapter. Each round of note-passing makes the next round more informed.
Alex: So the AI is building a shared understanding gradually, rather than just comparing final answers.
Sam: Correct. And there's another practical advantage worth mentioning. The underlying vision transformer—the core model that already knows how to read images—is kept completely unchanged. The researchers don't retrain it from scratch. They only train the fusion tokens themselves. It's like hiring an experienced doctor and teaching them a new filing system, rather than putting them through medical school again. That makes the whole approach far more efficient to develop.
Alex: And the results?
Sam: The study reports a meaningful improvement in breast cancer classification compared to standard methods that combine the two views more crudely. The paper suggests that the structured, back-and-forth dialogue between views—rather than a one-time merge—is what drives that gain.
Alex: So the contribution here isn't a bigger or more powerful model. It's a smarter way of organizing how the model thinks about information it already has.
Sam: That's a fair summary. The underlying insight is that in medical imaging, how you combine information matters as much as how much information you have. Keeping the sources distinct, letting them talk to each other gradually, and doing that at multiple stages—those design choices, taken together, appear to produce a more reliable result.
Alex: It's a good reminder that in AI for healthcare, careful architecture can matter just as much as raw computing power. Thanks for listening to ResearchPod.