Whisper, a widely adopted ASR model, is known to suffer from hallucinations - coherent transcriptions generated for non-speech audio entirely disconnected from the input. We investigate whether hallucinations can be detected and mitigated through Whisper's internal representations. We extract audio encoder activations and evaluate two representation spaces: raw Whisper activations and Sparse AutoEncoder (SAE) latents. We show that both spaces encode linearly separable hallucination-related information, with discriminative power concentrated in a sparse feature subset and increasing toward deeper encoder layers. We propose two steering strategies: activation-space steering and SAE latent-space steering. SAE-based steering reduces hallucination rate from 72.63% to 14.11% for Whisper small and from 86.88% to 27.33% for Whisper large-v3 on the full non-speech test set, with small WER degradation on speech data, approaching the performance of fine-tuning-based methods.
Alex: Welcome to another episode of ResearchPod. Today, we're looking at a common frustration with AI voice-to-text tools: why do they sometimes "hear" voices in an empty room?
Sam: It's a phenomenon called hallucination. When you hand a voice-to-text AI a recording of pure silence or background noise, you'd expect it to output nothing. Instead, it sometimes generates fluent, confident text — words and sentences that were never spoken. This study examines how to detect and stop that without retraining the model from scratch.
Alex: So this paper is basically asking if we can find a "hallucination signal" hidden inside the AI's own brain?
Sam: Exactly. The researchers found these errors aren't random glitches. They're consistent patterns buried in the model's internal data. And here's the key insight: those patterns are cleanly separable from the signals produced by real speech. That means, in principle, you can surgically suppress them without touching anything else.
Alex: That sounds significant. But how do you actually *see* those patterns if the model is a complex black box?
Sam: That's the core challenge. Think about how a neural network stores information. It doesn't keep concepts in neat, labelled boxes. Instead, everything gets mixed together — a single internal unit might be involved in processing accents, background noise, and grammar all at once. Scientists call this *superposition*, and it makes it very hard to isolate any one idea. To cut through that, the researchers used a tool called a Sparse AutoEncoder.
Alex: Okay, what does that tool actually do?
Sam: Think of it as a translator for the model's internal language. It takes that messy, overlapping data and reorganises it into a new space where each concept gets its own dedicated channel — like sorting a pile of tangled cables into separate, labelled slots. Once things are organised that way, the features that tend to trigger hallucinations become easy to spot and isolate.
Alex: Oh, so it's like turning down the volume on just the "hallucination" microphone without muting the whole room?
Sam: That's a precise way to put it. Once they isolated those features, they applied a technique called *activation steering*. During the split second the model processes incoming audio, they subtract the hallucination signal from the model's internal pathway — before it ever has a chance to produce a word.
Alex: And this doesn't require retraining the model from scratch? It's just an intervention while the AI is already running?
Sam: Correct. That's what makes it practically useful. Retraining a large model is expensive and time-consuming. This approach works by intervening in real time, and the results were meaningful — in some cases, the hallucination error rate dropped by more than half, while the model's ability to transcribe actual speech remained intact.
Alex: But if we're surgically removing these features, don't we risk damaging the model's ability to handle quiet or muffled speech? The kind that might look a lot like silence?
Sam: That is the central trade-off, and the researchers took it seriously. They tracked what's called the Word Error Rate — essentially, how often the model gets real words wrong — across a range of different audio conditions. The goal was to confirm that the intervention only targets the hallucination behaviour, not the model's core ability to understand speech. The evidence suggests they achieved that balance, though the researchers are careful not to overstate it.
Alex: So the "surgery" is precise enough to remove the bad behaviour without causing collateral damage.
Sam: That's the finding. And what makes it particularly notable is how few features were involved. The researchers found that a relatively small number of internal features — on the order of 50 to 100 — were sufficient to control this behaviour in a model that contains millions of parameters. That points to something important about how these errors are structured.
Alex: Why would such a small number of features have that much influence?
Sam: It comes down to a property called *polysemanticity* — the idea that individual units inside a neural network often carry multiple meanings at once. One unit might be doing several jobs simultaneously, which is efficient but messy. When hallucination-prone behaviour is tangled up with other functions, it's hard to address. The Sparse AutoEncoder untangles that, and what you find is that the hallucination tendency is actually quite concentrated. It's not spread evenly across the whole model — it clusters in specific places. Find those places, and you have a precise target.
Alex: It's a bit like discovering that a persistent leak in a large building is actually coming from one cracked pipe, not the whole plumbing system.
Sam: That's a fair analogy. And the broader implication is this: we don't always need more data or a bigger model to fix a reliability problem. Sometimes, we need better visibility into how the system is actually thinking. This research is a step toward that kind of transparency — understanding not just *what* a model does wrong, but *where inside it* the mistake originates.
Alex: That's a useful place to leave it. Thanks for listening to ResearchPod.