Byeongjun Park, Byung-Hoon Kim, Hyungjin Chung
4 min
Abstract
We present FlashRender, a few-step generative rendering framework that retakes a source video along a target camera trajectory in seconds. We identify sampling-step-dependent camera control as a prominent manifestation of discretization error in existing multi-step generative rendering models and show that resolving this inconsistency substantially lowers denoising trajectory curvature, facilitating subsequent step distillation. To this end, we introduce Representation Transformation and Alignment (RETA), which aligns hidden source-video representations with target-video features from a frozen visual geometry model. This directly encodes the geometric transformation within the source-video stream, enabling sampling-step-consistent camera control. We then fine-tune the model with the MeanFlow objective on the lower-curvature denoising trajectory induced by RETA, allowing the model to more effectively address discretization error. Finally, we apply on-policy flow map distillation to correct self-rollout errors under fixed few-step sampling. Extensive experiments show that RETA, MeanFlow, and on-policy flow map distillation play complementary roles in few-step generative rendering. Together, they enable our approach to match multi-step baselines in video quality and geometric consistency at 25x lower sampling cost while achieving superior camera controllability, even under out-of-distribution target camera trajectories.
Sam: So you have three interlocking pieces — RETA pre-aligns the geometry, MeanFlow straightens the trajectory, and on-policy distillation keeps the few-step outputs honest. How well does the whole system hold together?
Alex: The ablations support each component independently. Remove RETA and geometric consistency degrades even when the trajectory objectives are intact — which tells you the pre-alignment is doing real work, not just providing a redundant signal. The MeanFlow and distillation components then operate on a problem that's already been made tractable.
Sam: Where does a careful referee push back?
Alex: The clearest vulnerability is the frozen geometry encoder. RETA's pre-alignment is only as good as the geometric features it's aligning to. If the encoder hasn't seen scene types like the one you're rendering — unusual lighting, non-Lambertian surfaces, heavy occlusion — the alignment can propagate those errors forward rather than correcting them. The model internalizes whatever the encoder gives it, good or bad.
Sam: So the system trades flexibility for efficiency. You get reliable few-step rendering, but you're tethered to the coverage of your geometric priors.
Alex: That's the right framing. It's a meaningful architectural contribution — the RETA pre-alignment idea is genuinely useful and the trajectory analysis is rigorous — but the practical ceiling is set by the geometry encoder's generalization. For scenes well within its training distribution, the approach is compelling. For edge cases, that frozen encoder is where you'd look first if something breaks.
Sam: So the open question is whether you can make that encoder adaptive without sacrificing the trajectory stability that makes the whole thing work.
Alex: Exactly. That's the natural next step the paper doesn't address, and it's where the interesting follow-on work probably lives. For now, FlashRender makes a strong case that pre-aligning geometry before diffusion — rather than asking diffusion to infer it — is the right way to think about efficient novel-view video rendering. Thanks for listening to ResearchPod.