Wei Wang, Enlin Gu, Antonio Loquercio, Haimin Hu, Rahul Mangharam
5 min
AI copilots can substantially boost human performance through shared control, but excessive assistance can induce over-reliance and skill atrophy. This paper studies how an embodied AI agent can act as a coach that accelerates human motor-skill development. We argue that effective coaching requires strategic scaffolding and stepping back that are aligned with the learner's capability, allowing productive failures that drive learning. We formalize the interactive AI coaching process as a non-cooperative dynamic game in which the learner optimizes task performance while the coach targets the learner's independent competence. Building on this formalism, we develop a reinforcement learning framework combining adaptive shared control with probabilistic models of the coach's causal influence on skill evolution, enabling tractable training of coaching policies. A comprehensive user study (N=33) on first-person-view drone racing shows significant gains in human learning outcomes over state-of-the-art AI coaching baselines.
As embodied AI agents become more capable, they are increasingly used as copilots to assist humans in complex tasks. However, persistent AI assistance often leads to over-reliance and skill stagnation, preventing users from developing independent competence. This paper asks: can an AI agent act as a coach that strategically scaffolds and steps back to accelerate human motor-skill learning?
The authors formalize the coaching process as a non-cooperative dynamic game between a learner, who seeks to maximize task performance, and a coach, who seeks to maximize the learner's long-term independent competence. They introduce the Learning to Coach (L2C) framework, which uses reinforcement learning to train a policy that modulates shared control. The coach adaptively blends its actions with the learner's based on the learner's estimated skill level, using a probabilistic finite-state automaton to model how different coaching interventions influence skill progression. This allows the AI to decide when to provide assistance and when to allow productive failures.
In a user study involving 33 participants performing first-person-view (FPV) drone racing, the L2C coach demonstrated superior performance compared to state-of-the-art baselines. After 40 minutes of training, participants coached by the L2C agent achieved a 27.9% reduction in lap times, significantly outperforming alternative methods that rely on fixed assistance rules or lack adaptive, context-aware feedback. The results suggest that by explicitly modeling the learner's latent skill and the causal impact of coaching on that skill, AI agents can effectively transition from passive guardians to active mentors.
This research shifts the paradigm of human-AI collaboration from performance-oriented assistance to development-oriented mentorship. By addressing the "dilemma of coaching"—the trade-off between immediate task success and long-term skill acquisition—this work provides a scalable, algorithmic foundation for designing AI systems that empower rather than replace human capability.
Sam: So it's not a one-time judgment. It's a continuously updated picture. And based on that picture, the AI decides how much to scaffold—how much temporary support to provide—versus how much to step back and let the learner work through the difficulty.
Alex: Exactly. And the mechanism for that is what they call a "blending rule." Imagine you're learning to fly a drone and the AI coach has access to a second set of controls—like a driving instructor with a dual-control car. At any moment, the coach can nudge your inputs. But how much it nudges depends on where it thinks you are on that skill map. A beginner gets a firm hand. Someone who's improving gets a lighter touch. And someone who's ready to fly solo gets nothing at all.
Sam: So it's a sliding scale of intervention. But here's what I'm wondering—what if I just have a bad day? What if I'm normally competent but I make a string of errors because I'm tired or distracted? Does the AI misread that as genuine incompetence and start over-helping?
Alex: That's a real limitation the paper acknowledges. The probabilistic model is designed to be gradual—it doesn't flip from "expert" to "beginner" after one bad run. But it's still an inference, not a certainty. The AI is always working with incomplete information, which means it will sometimes get the read wrong. The researchers treat this as an inherent trade-off rather than a solved problem.
Sam: So the system is genuinely useful, but it's not infallible. It's a principled approach to a hard problem, not a perfect solution.
Alex: That's a fair summary. What makes this work notable is less about any single result and more about the framing. By treating coaching as a non-cooperative game—where the AI and the learner have genuinely different objectives—the researchers give the AI a reason to sometimes withhold help. That's a meaningful shift from the standard design assumption, which is that more assistance is always better.
Sam: It does make you think about how we design AI tools more broadly. If the default is always "be as helpful as possible," we might be building systems that are optimized for short-term task completion at the cost of long-term human capability.
Alex: And that's the deeper question this paper is raising. It's not just about drone racing or any specific application. It's about what we actually want from AI assistance—a tool that does things for us, or one that helps us become capable of doing them ourselves. Those are different design goals, and they lead to very different systems. Thanks for listening to ResearchPod.