Visualising mental representations: A primer on noise-based reverse correlation in social psychology | L. Brinkman et al. | ResearchPod

Transcript: Visualising mental representations: A primer on noise-based reverse correlation in social psychology

Alex: Welcome to another episode of ResearchPod. Today we're looking at a foundational paper from the European Review of Social Psychology on a deceptively simple question: how do you visualize what's happening in someone's mind's eye?

Sam: The paper makes a methodological argument. Standard explicit ratings — ask someone how trustworthy a face looks, get a number — are contaminated by introspection failure. People often can't articulate the features driving their judgments, or they confabulate post-hoc. The proposed alternative is a psychophysical technique called reverse correlation, which sidesteps verbal report entirely.

Alex: So instead of asking participants what they're responding to, you're trying to read it out of their behavior directly.

Sam: Right. The core insight is that social perception is generative — we don't passively record pixels, we match incoming data to internal templates. Reverse correlation treats the brain as a black box and tries to recover that template from the outside. Here's the basic setup: you present a participant with two versions of a base face, each overlaid with a different sample of random visual noise. The participant picks whichever version looks more trustworthy, or dominant, or whatever construct you're probing. You repeat this hundreds of times. The noise that consistently got selected gets averaged together, and the noise that got rejected gets averaged and subtracted. What's left — the classification image — is the residue of the participant's internal model.

Alex: So the random noise is doing the work of sampling the feature space, and the participant's choices are the filter.

Sam: Exactly. And the critical advantage over explicit rating paradigms is that you aren't pre-specifying the features. You're not asking about nose width or eye spacing. If the participant is spontaneously responding to something you didn't anticipate — say, a specific contrast pattern around the jawline — it will show up in the classification image, because you're observing the output of their generative model rather than their description of it.

Alex: That's a meaningful distinction. But I'd imagine there's a signal-to-noise problem lurking here. If a participant's template is inconsistent across trials, you're just averaging noise.

Sam: That's exactly the failure mode. The paper addresses this with a validation statistic — the infoVal — which tests whether the classification image contains more signal than you'd expect by chance. If it falls below threshold, you haven't recovered a reliable template, and you have to discard the image rather than interpret it. The point is you can't force a result out of noise. You need to demonstrate the template exists before you start reading pixel intensities.

Visualising mental representations: A primer on noise-based reverse correlation in social psychology

L. Brinkman, A. Todorov, R. Dotsch

Sep 3, 2026·5:12·user_upload

Reverse correlationSocial perceptionMental representationsClassification imagePredictive codingSignal detection theory

Listen

5 min

Briefing

Understanding Mental Representations

Social psychology has long sought to understand how people form rapid inferences about others based on faces. While researchers often assume these inferences rely on internal mental templates, these templates have historically remained invisible. This paper introduces noise-based reverse correlation as a powerful, data-driven tool to visualize these mental representations without requiring researchers to specify a priori hypotheses about which facial features matter.

The Reverse Correlation Approach

Unlike traditional paradigms that ask participants to rate faces on specific dimensions, reverse correlation reverses the process. Researchers present participants with a base image (e.g., an average face) overlaid with random noise patterns. Participants then select the image that best matches their internal concept of a target (e.g., 'trustworthy' or 'Moroccan'). By averaging the noise patterns of the selected images, researchers create a 'classification image' (CI) that highlights the specific visual features driving the participant's judgment. This method is particularly valuable because it allows for the discovery of unexpected features that researchers might not have thought to test.

Applications and Theoretical Framework

Reverse correlation has been successfully used to visualize diagnostic features for race, gender, age, and personality traits, as well as to uncover top-down biases. For instance, studies have shown that an individual's level of prejudice or their own group membership can systematically distort their mental representation of outgroup faces. The authors propose that these classification images should be interpreted through the lens of predictive coding: they are visual read-outs of the internal generative models that determine how we perceive the social world. Rather than just reflecting biases, these images represent the fundamental templates that guide our social inferences.

Key Terms and Definitions

Reverse Correlation — A psychophysical method that identifies the visual features driving a judgment by correlating participant responses with random variations in stimulus noise.
Classification Image (CI) — A visual proxy of a mental representation, created by averaging the noise patterns of stimuli selected by a participant as matching their internal template.
Base Image — The constant, underlying stimulus (e.g., an average face) upon which random noise is superimposed to create the variations judged by participants.
Predictive Coding — A theoretical framework suggesting that the brain constantly generates internal predictions about sensory input, updating these models based on prediction errors to perceive the world.
Generative Model — The collection of internal mental representations and concepts that a person uses to predict and interpret incoming sensory information.

Visualising mental representations: A primer on noise-based reverse correlation in social psychology: Research Paper Podcast