Why Are We Lonely? Leveraging LLMs to Measure and Understand Loneliness in Caregivers and Non-caregivers | Michelle Damin Kim et al. | ResearchPod

Transcript: Why Are We Lonely? Leveraging LLMs to Measure and Understand Loneliness in Caregivers and Non-caregivers

Alex: Welcome to another episode of ResearchPod. Today, we're diving into a study on loneliness—something that affects many people, but in different ways depending on their lives. Sam, what is this paper about?

Sam: The paper, titled "Why Are We Lonely? Leveraging LLMs to Measure and Understand Loneliness in Caregivers and Non-caregivers," comes from researchers at Emory University. It explores using Reddit posts—anonymous shares from online forums—to study loneliness in caregivers and non-caregivers. The central puzzle is whether AI tools can build reliable datasets from these posts to compare how loneliness differs between the groups.

Alex: So this asks if social media posts can quantify loneliness for caregivers, where traditional surveys might miss personal details?

Sam: Yes. Caregivers—people providing ongoing care to someone with a medical condition—face higher loneliness risk from their role. Standard surveys often miss specific feelings like loss of personal space or lack of recognition, which people share anonymously on Reddit. The study suggests AI can analyze these real, open-ended posts at scale to fill that gap.

Alex: Right, because caregivers might not open up the same way in formal surveys.

Sam: Caregivers' loneliness often ties to duties—like changed relationships or feeling abandoned—unlike non-caregivers' general social gaps. Prior work lacks tailored datasets, so this tests AI methods to spot those differences reliably.

Alex: How do they score loneliness from posts and separate groups cleanly?

Sam: They collected posts from eight caregiving subreddits—like dementia or cancer support—and seven general loneliness ones. They checked samples to confirm groups didn't mix, then cleaned by removing short or overly long posts. For caregivers, simple rules—like spotting survey links—filtered non-caregivers. AI models checked caregiver posts, catching over 93% accurately. Another spotted first-person loneliness talk.

Alex: And the scoring—how does that work?

Sam: Experts adapted a 20-item survey—flipping it to judge posts in third person, like "The writer lacks companionship" if text proves it directly. They dropped five hard-to-judge items, leaving 15. Yes adds 1 point, no subtracts 1, can't tell is 0. Posts at 7 or higher flag as highly lonely. Think of it like a referee needing video proof for a call—strict evidence only.

Alex: Got it. And how do they identify causes?

Sam: They made a guide for seven causes—like lacking friends, emotional distance, or lost personal space—flagging if tied to caregiving. Rules pick the best fit from separate text parts, reviewed by a nursing professor. This spots patterns, like caregivers feeling cut off by duties. Using GPT-5, it hit about 0.83 agreement for caregivers and 0.80 for non-caregivers on common causes, like support network gaps. Rarer ones scored lower, as expected with less data.

Why Are We Lonely? Leveraging LLMs to Measure and Understand Loneliness in Caregivers and Non-caregivers

Michelle Damin Kim, Ellie S. Paek, Yufen Lin, Emily Mroz, Jane Chung, Jinho D. Choi

Apr 9, 2026·5:07·arxiv·Original Paper

Loneliness in CaregiversLLM-driven Social Media AnalysisLoneliness Evaluation FrameworkCause Categorization TypologyReddit Dataset for Caregiver LonelinessLoneliness Detection in Social Media

Listen

5 min

Summary

Overview

This paper tackles a pressing public health issue: loneliness among caregivers, who number over 60 million in the US and face heightened risks due to their demanding roles. Unlike traditional surveys, it uses Reddit posts from caregiver (e.g., r/caregivers) and non-caregiver (e.g., r/loneliness) subreddits—over 70,000 in total—to build a rich, diverse dataset. Large Language Models (LLMs) like GPT-4o, GPT-5-nano, and GPT-5 power a human-validated pipeline to filter, annotate, and analyze this data. The goal? Answer if Reddit works for studying loneliness, if LLMs can apply expert frameworks accurately, and how loneliness differs between caregivers and others.

Why it matters: Caregivers experience unique loneliness tied to identity loss, abandonment, and role strain—insights surveys miss. This LLM approach scales analysis of real-world, unfiltered expressions, revealing population differences and enabling better interventions.

LLM-Driven Data Pipeline

Building quality datasets from social media is tough due to noise and scale. The authors create a pipeline prioritizing high recall:

Preprocessing: Filter posts by token count (150-1000), use regex to remove irrelevance.
LLM Annotation: GPT models judge loneliness relevance, then score adapted UCLA scale (yes/no/not judgeable) and categorize causes.
Human Validation: Experts (nursing professors) review samples, refine guidelines, achieving 76-80% accuracy.

This yields a 'high-quality Reddit corpus' with loneliness scores, causes, and demographics—proving Reddit's viability for diverse, population-specific mental health data.

Adapted UCLA Loneliness Scale

The classic UCLA scale (20 items on social isolation) isn't social-media ready. Experts adapt it:

Simplify to yes/no/not judgeable.
Remove inapplicable items (e.g., group activities).
Add coding guidelines from high-scoring samples.

LLMs apply this third-party, hitting 76.09% accuracy for caregivers, 79.78% for non-caregivers. This bridges psychology and NLP, making validated scales computable on messy text.

Cause Categorization Typology

An expert-informed typology classifies loneliness causes (e.g., loss of space/relationships for caregivers). LLMs categorize with micro-F1 of 0.825 (caregivers) and 0.80 (non-caregivers). Key insight: Caregivers' loneliness centers on caregiving roles (helplessness, lack of recognition), identity issues, and abandonment—vs. non-caregivers' more general social lacks. Demographics (age, gender) further highlight differences, like caregivers' older profiles.

Key Findings and Implications

Caregivers show distinct loneliness patterns, underscoring need for tailored frameworks.
LLMs excel at nuanced, expert-guided analysis, outperforming prior NLP for mental health.
Contributions: Pipeline, dataset, adapted scale, typology—tools for future studies.

This work shows LLMs democratize mental health research, turning social media into a lens on hidden epidemics like caregiver isolation.

Abstract

This paper presents an LLM-driven approach for constructing diverse social media datasets to measure and compare loneliness in the caregiver and non-caregiver populations. We introduce an expert-developed loneliness evaluation framework and an expert-informed typology for categorizing causes of loneliness for analyzing social media text. Using a human-validated data processing pipeline, we apply GPT-4o, GPT-5-nano, and GPT-5 to build a high-quality Reddit corpus and analyze loneliness across both populations. The loneliness evaluation framework achieved average accuracies of 76.09% and 79.78% for caregivers and non-caregivers, respectively. The cause categorization framework achieved micro-aggregate F1 scores of 0.825 and 0.80 for caregivers and non-caregivers, respectively. Across populations, we observe substantial differences in the distribution of types of causes of loneliness. Caregivers' loneliness were predominantly linked to caregiving roles, identity recognition, and feelings of abandonment, indicating distinct loneliness experiences between the two groups. Demographic extraction further demonstrates the viability of Reddit for building a diverse caregiver loneliness dataset. Overall, this work establishes an LLM-based pipeline for creating high quality social media datasets for studying loneliness and demonstrates its effectiveness in analyzing population-level differences in the manifestation of loneliness.

Why Are We Lonely? Leveraging LLMs to Measure and Understand Loneliness in Caregivers and Non-caregivers: Research Paper Podcast