Sami Leon Noel Aziz Hanna, Nicolas Hoischen, Sandra Hirche, Armin Lederer
5 min
This paper tackles a core challenge in data-driven control of nonlinear systems: how to design stabilizing controllers for high-dimensional approximations learned via the Koopman operator. Traditional first-principles modeling fails for complex systems like neuroprosthetics or biological dynamics, so researchers turn to Koopman methods to 'lift' nonlinear dynamics into a higher-dimensional linear or bilinear form using data alone. But these lifted models are often huge—hundreds or thousands of dimensions—making control design tricky. The paper focuses on quadratic control Lyapunov functions (CLFs), the simplest and most popular tool for proving stabilizability and synthesizing controllers.
The Koopman operator is a clever mathematical trick: instead of evolving states nonlinearly, it evolves observables (functions of the state) linearly in an infinite-dimensional space. For control-affine nonlinear systems (\dot{x} = f(x) + g(x)u), mild conditions allow lifting to bilinear form (\dot{z} = A z + \sum B_i z u_i) in lifted coordinates (z = \mathcal{G}(x)), where (z) lives in (\mathbb{R}^n) with (n \gg \dim(x)). Data-driven methods like Extended Dynamic Mode Decomposition (EDMD) approximate (A, B_i) by regressing on trajectories: pick a dictionary of observables (e.g., monomials, radial basis functions), then solve a least-squares problem on data snapshots. This bilinear structure simplifies control design compared to general nonlinear MPC, but high (n) demands simple CLFs.
A quadratic CLF is (V_Q(z) = \frac{1}{2} z^T Q z) with (Q \succ 0), satisfying (V_Q(z) \geq 0) (obvious) and (\inf_u \dot{V}_Q(z,u) \leq 0) everywhere except the origin. For bilinear systems, the Lie derivative is (\dot{V}_Q = z^T Q (A z + \sum B_i z u_i)), so the infimum condition becomes: there exists (u) such that (z^T Q A z + \sum (z^T Q B_i z) u_i \leq 0) for all (z \neq 0). This is equivalent to solving a pointwise QP at every (z), but for existence, we need a global (Q). CLFs enable robust QP-based controllers (u = \arg\min \dot{V}_Q + |u|^2), handling model uncertainty crucial for learned models.
The key insight: quadratic CLF existence is exactly characterized by a nonconvex quadratically constrained quadratic program (QCQP). Normalize over the unit sphere (\Vert z \Vert =1): maximize (z^T Q A z) subject to (z^T Q B_i z = 0) for all (i=1,\dots,m) (the control authority constraints). A CLF exists iff the optimal value (J^* \leq 0). Why? If (J^* > 0), there's a (z) where no (u) can make (\dot{V}_Q < 0). This is NP-hard, but reveals structure: existence implies stabilizability by constant control (u^\star)—a fixed input that drives all trajectories to zero. Proof sketch: if a quadratic CLF exists, the optimal constant (u^\star = - (B^T Q B)^{-1} B^T Q A z / \Vert z \Vert) (approximately) stabilizes.
To make it tractable, relax to semidefinite programming (SDP): lift to (Z = z z^T), yielding (\max \tr(A Q Z)) s.t. (\tr(B_i Q Z)=0), (Z \succeq 0), (\tr(Z)=1). If SDP optimal (J^*_{SDP} \leq 0), a rank-1 (Z) gives a CLF (sufficient). For single-input (m=1), Pataki's lemma guarantees rank-1 exactness, making it necessary and sufficient. Empirically holds for many multi-input Koopman models. Constant control stabilizability is nearly necessary: just pick (Q = I), check if some fixed (u) works via spectral radius (\rho(A + \sum u_i B_i) <1).
Quadratic CLFs are highly restrictive in high dimensions—requiring 'easy' dynamics stabilizable by constants, like biased equilibria. This explains why prior SDP/LMI methods [10-12] succeed only sometimes. For Koopman control, check SDP first; if feasible, great—use the (Q) for robust QP control. If not, fall back to richer CLF classes or certify non-existence. Bridges theory (stabilizability) with practice (data-driven bilinear control), warning against blindly assuming quadratic CLFs in learned high-D models.
Koopman operator-based methods enable data-driven bilinear representations of unknown nonlinear control systems. Accurate representations often demand significantly higher dimensions than the original system, making control design challenging. Control Lyapunov Functions (CLFs) are widely used for controller synthesis, with quadratic CLF candidates being the most common due to their simplicity. Yet, we show that this class is highly restrictive, especially when the state dimension is large: under mild conditions, their existence implies stabilizability of the bilinear system by a constant input -- that is, the control remains fixed over time. We establish this result by formulating a quadratically constrained quadratic program (QCQP) that exactly characterizes valid CLFs. Since QCQPs are NP-hard, we propose a convex semidefinite relaxation that offers a sufficient validity condition. For single-input systems, we prove that a quadratic CLF requires constant control stabilizability, and empirically demonstrate that this extends to high-dimensional multi-input systems in many cases.
Alex: So the SDP proves the bowl can't exist unless constant control stabilizes.
Sam: Precisely. They use Farkas' lemma on infeasible SDPs to show no fixed input makes the closed-loop stable—all growth rates pulling states to zero. This reveals quadratic tools are limited for complex learned dynamics, like those from prosthetic data, where fixed stimulation fails but varying ones are needed.
Alex: For real neuroprosthetics, where you adjust pulses as the limb moves, these simple quadratic tools won't certify stability from data.
Sam: Exactly. The work highlights the need for richer Lyapunov functions in practical data-driven control—a meaningful limit on quadratic simplicity in high dimensions.
Alex: In practice, with multiple controls like a prosthetic arm, does the math still hold up reliably?
Sam: The paper backs this with simulations on random systems up to state dimension 100 and 8 inputs. The solution rank dropped to 1 when dimensions topped 80, matching the hard problem perfectly. This confirms reliability in high-dimensional data-driven robot models.
Alex: So even with several inputs, big data spaces force the exact match—tying back to needing a steady control signal.
Sam: Yes. The main theorem states quadratic bowls exist precisely when a fixed control stabilizes the system—derived using Farkas' lemma. Nonlinear behaviors like muscle responses rarely stabilize with unchanging pulses; they demand adjustments. Constant control checks are generally computationally tough.
Alex: So the evidence points to redesigning how we learn these models from data.
Sam: Precisely. Future work must build in structures ensuring constant-control compatibility for scalable stability checks. This pinpoints why simple quadratic functions falter in complex data-driven control—a notable step toward better tools for neuroprosthetics.
Alex: That's a clear takeaway—the logic exposes exactly where quadratic simplicity breaks down. Thanks for breaking it down, Sam.
Sam: My pleasure, Alex. This paper offers a solid foundation for advancing the field. Thanks for listening to ResearchPod.