Louis Simon, Mohamed Chetouani
5 min
Personalizing wearable-based stress detection is difficult due to high inter-individual variability in physiological responses. Traditional methods often require costly self-supervised pre-training or labeled user data for fine-tuning. This paper investigates whether a lightweight, retrieval-augmented approach can achieve effective personalization by leveraging frozen, out-of-domain foundation models to capture individual patterns without needing task-specific labels.
The authors propose a framework where a lightweight transformer network extracts non-personalized features from wearable signals (EDA, BVP, temperature, and accelerometer). To personalize these features, the system retrieves similar past samples from the user's history using embeddings generated by frozen foundation models (such as MOMENT, Chronos, or HuBERT). These retrieved patterns are processed by a custom SetTransformer and used to modulate the main network's representations via Feature-wise Linear Modulation (FiLM) layers. The model is trained using a multi-task objective that balances base and personalized predictions.
The proposed method achieved a +3.92% improvement in accuracy and a +4.76% increase in macro F1-score compared to a non-personalized transformer baseline on the WESAD dataset. The approach performs comparably to supervised fine-tuning while remaining entirely label-free for the target user. Furthermore, the authors demonstrated that temporal retrieval—using only past data—is nearly as effective as full-history retrieval, indicating the model is robust to limited user data. The study also successfully explored cross-dataset retrieval, showing that embeddings from different datasets (K-Emocon) can still provide meaningful personalization for WESAD.
This work provides a practical path toward deploying personalized health-monitoring systems in real-world scenarios where labeled data is scarce or impossible to obtain. By utilizing frozen, general-purpose foundation models, the approach avoids the computational burden of training large-scale models from scratch while effectively addressing the significant physiological differences between individuals.
Personalization in wearable-based stress detection remains challenging due to substantial inter-individual variability in physiological and behavioral responses. While traditional approaches rely on user-specific fine-tuning or costly self-supervised pre-training on large datasets, we propose a lightweight alternative based on retrieval-augmented personalization. Our method leverages frozen, out-of-domain foundation models to retrieve similar patterns from a target user's history and encode them into a compact personalized embedding that modulates representations extracted by a lightweight transformer network. We evaluate our approach on the WESAD stress detection dataset with N=15 users, comprising wrist-worn physiological (EDA, BVP, temperature) and activity (accelerometer) signals, and report gains of +3.92\% in accuracy and +4.76\% in macro F1-score over a non-personalized transformer baseline, approaching supervised fine-tuning performance without requiring any labeled user data. We further show that temporal retrieval, where only prior user samples are available, achieves performance close to full intra-user retrieval, demonstrating robustness to limited user history. Finally, we explore personalization in a cross-dataset retrieval setting, leveraging embeddings from the K-Emocon dataset to personalize representations for stress detection on the WESAD dataset.
Alex: And it does all of this without needing any labeled data from the user?
Sam: It does. By using pre-trained models to do the heavy lifting, they avoid the need for manual labeling entirely. They also train the model to predict both a general baseline and your personal state at the same time—so it's always keeping one foot in the general and one foot in the personal. There's also an adaptive scaling factor built in: if the personalized side of the system starts making unreliable predictions early on, it automatically dials back its influence until it has enough evidence to be trusted.
Alex: So it's borrowing the intelligence of models trained on completely different things—and using that to make sense of our bodies?
Sam: Exactly. Those broader patterns help the model recognize structure in your heart rate that it might otherwise miss. It's an effective way to handle the fact that we simply don't have enough labeled stress data for every individual person.
Alex: But what if the data it retrieves is from a totally different group of people? Does that actually help, or does it just add noise?
Sam: That's a key question, and they tested it directly by pulling data from a separate study entirely. Using outside data is better than having nothing, but it doesn't work as well as using your own history. What's notable is that the model seems to recognize when the retrieved data isn't a good match—and it essentially ignores it to stay stable. They track something they call "personalization magnitude": if the model judges the retrieved data as irrelevant, it suppresses that information and falls back on its general knowledge. It's a safety valve to prevent bad data from skewing your results.
Alex: So the model is smart enough to know when its librarian is giving it bad advice. Like a student who checks their notes but ignores them when they realize the textbook is for the wrong class.
Sam: That's a precise way to put it. This mechanism ensures the system doesn't force a personalized interpretation when it lacks the evidence to back one up. The goal isn't just to be personal—it's to be reliably personal.
Alex: It's notable how much of the work here is about knowing what not to trust, as much as what to act on.
Sam: That's right. By balancing general knowledge with specific user history, the system evolves with you while maintaining a baseline of accuracy. And it does all of that without asking the user to do any of the heavy lifting themselves—no labeling, no manual setup. It's a measured approach to a genuinely difficult problem in personal health technology.
Alex: Thanks for walking me through the logic, Sam—and thanks to everyone listening to ResearchPod.