ResearchPod Summary
Large Language Models (LLMs) are increasingly used to provide personalized guidance for physical activity, mental health, and stress management. While these models offer fluent, context-aware interaction, their behavior is typically shaped by implicit mechanisms like prompting and fine-tuning. The authors argue that this approach is problematic for wellbeing applications, where recommendations directly influence a user's health and long-term outcomes. Because the interaction style emerges from the model's generative process rather than explicit design, it is difficult to inspect, control, or ensure that the system is acting in the user's best interest.
To address these issues, the authors propose shifting from viewing recommendation as a prediction problem to viewing it as an interaction design problem. They introduce a modular architecture that separates the generative model from an explicit 'interaction policy layer.' This layer enforces configurable constraints that govern how the system communicates with the user. By structuring conversational behavior through these parameters, designers can move away from opaque, emergent behavior toward a system that is transparent and intentionally aligned with human wellbeing.
The paper identifies four primary constraints that should be explicitly managed in wellbeing-oriented LLM systems:
By treating these as configurable parameters, researchers can systematically evaluate how different design choices impact user-centered outcomes like self-efficacy, perceived agency, and appropriate reliance on the AI.
AI-generated third-party summary by ResearchPod. Not official content or an endorsement by the paper authors or affiliated organizations.