Woojung Han, Seil Kang, Youngjun Jun, Min-Hung Chen, Fu-En Yang, Seong Jae Hwang
4 min
Abstract
Image-to-Video diffusion models leverage input images to generate visually stunning content, yet frequently produce motion that violates physical laws. We reveal a surprising finding: a 2-step generation often exhibits better physical consistency than a 50-step output from the same model. Through spectral analysis, we trace this to phase erosion during denoising; the phase degrades significantly (dropping by $\approx 18\%$ from step 2 to step 50), whereas the magnitude remains relatively stable. Building on this insight, we propose PhaseLock, a training-free framework that preserves the valid motion priors from few-step inference throughout the denoising trajectory. Rather than relying on full-step inference for physical consistency, PhaseLock extracts a motion prior from just 2 steps and enforces it onto high-fidelity generation via Latent Delta Guidance. Our approach effectively mitigates phase degradation, improving physical consistency by an average of 6.2 points across diverse models while largely maintaining visual fidelity, with negligible overhead ($1.06\times$ time, $1.02\times$ memory) and reduced reliance on expensive external guidance methods ($\sim5\times$ time).
Alex: So they've diagnosed the problem. What's the fix?
Sam: They built a method called PhaseLock. The idea is straightforward: run the first two steps of the generation process, extract the motion blueprint from the phase at that point, and then use that blueprint to guide the remaining forty-eight steps. You can think of the guiding mechanism as a fence. As the model refines the visual details, the fence keeps nudging it back toward the motion plan it established at the start.
Alex: Like keeping a rough sketch pinned to the wall while you paint, so you don't lose track of where everything was supposed to go.
Sam: That's a good way to put it. And importantly, this is what researchers call a training-free approach—they don't have to rebuild or retrain the AI model from scratch. PhaseLock works on top of existing models, which makes it practical to apply broadly. It also adds minimal extra computation time, so it avoids the heavy cost of bolting on a separate physics simulation engine.
Alex: So in a sense, this is about keeping the AI honest. It already understood the physics—the fix just stops it from talking itself out of that understanding.
Sam: That's the core of it. The physics knowledge was always there. The model just needed a mechanism to preserve it through the refinement process, rather than letting it get smoothed away in the pursuit of visual polish.
Alex: It's a meaningful reminder that more processing doesn't always mean better reasoning—sometimes the clearest thinking happens early, and the challenge is holding onto it. Thanks for listening to ResearchPod.