Shijie Wang, Honglu Zhou, Ziyang Wang, Ran Xu, Caiming Xiong, Silvio Savarese, Chen Sun, Juan Carlos Niebles
5 min
Abstract
Current Video Large Language Models (Video LLMs) excel in question answering (QA) but largely operate as black boxes, providing textual answers without verifiable visual grounding. Existing explainability efforts rely on textual rationales or sparse bounding boxes, which struggle to capture complex video dynamics such as occlusions and non-rigid deformations. We propose Evidence-Backed Video Question Answering (E-VQA), a novel task requiring models to jointly output a semantic answer and precise spatio-temporal evidence: temporal segments and dense, tracked object segmentation masklets. To support this, we introduce ST-Evidence, the first human-verified benchmark for both discriminative and generative pixel-level grounding. Evaluations of state-of-the-art models reveal a critical decoupling between QA accuracy and true visual perception that scaling alone fails to bridge. To address this, we develop scalable, automated generation pipelines to create ST-Evidence-Instruct, a 160k-scale dataset bridging high-level reasoning with fine-grained grounding. Fine-tuning grounded Video LLMs on this data yields substantial gains over the corresponding size-matched UniPixel baselines (e.g., +27.2 t-mean and +13.8 J&F on a 7B model), establishing a robust baseline for explainable, evidence-backed video understanding. Code and data are available at https://github.com/SalesforceAIResearch/EVQA.
Alex: Exactly. In high-stakes settings — medical imaging, autonomous vehicles, security systems — you need a verifiable audit trail for every decision. You need to be able to ask: what, precisely, did the model look at?
Sam: So how did the researchers actually test whether models could do this?
Alex: They built a new benchmark called ST-Evidence — the first of its kind to use human-verified, pixel-level data to grade how well a model connects its reasoning to the visual evidence. And then they ran a revealing experiment: they "corrupted" the video by pixelating the specific objects the model had identified as its evidence, and watched what happened to accuracy.
Sam: And when they hid the evidence, the model couldn't answer correctly anymore.
Alex: Precisely. Conversely, when they pixelated random background objects that weren't relevant, accuracy barely moved. That's a meaningful confirmation that the model was genuinely using those pixels to reason — not just picking up on visual noise.
Sam: But is the model doing the reasoning itself, or is it leaning on a separate tool to find the objects?
Alex: That's a critical distinction, and the paper addresses it directly. They compared their approach against a proxy tool — essentially a separate system that handles the visual search — and found that the bottleneck isn't the tool's ability to see. It's the model's ability to reason about what it sees. Even when the visual data is correct, the model often fails to connect it to the right answer.
Sam: So the "brain" is the limiting factor, not the "eyes."
Alex: That's the core finding. And it's why the fine-tuned model — trained on their new dataset, which they call ST-Evidence-Instruct — shows meaningful improvement. It's learning that visual grounding isn't optional. It's a requirement for earning the answer.
Sam: It's a shift from "predict the next word" to "prove the next fact."
Alex: That's a clean way to put it. And the practical upshot is something like live debugging. If a model makes a mistake, you can examine the masklets and see exactly which pixels it was attending to — and where its reasoning went wrong.
Sam: That feels like a meaningful step toward AI we can actually audit. Though I imagine the quality of that training data matters a lot.
Alex: The paper is clear on that point. Performance is still bounded by the quality of the data used to train the model. If the annotations are flawed, the model inherits those flaws. It's more verifiable, but it isn't perfect.
Sam: So it's not a complete solution — but it's a more honest framework. You can see where the model is looking, which means you can see where it goes wrong.
Alex: That's a fair summary. The broader implication is that scaling these models up with more data alone isn't sufficient. What's needed are fundamental changes in how they're trained — specifically, training them to treat visual evidence and language as genuinely integrated, rather than treating the visual input as optional context.
Sam: It's a more demanding standard, but probably the right one for systems we're being asked to trust.
Alex: Thanks for listening to ResearchPod.