Lyapunov Exponent Pre-training Objective

Auto-generated stub. Edit this file to add more details.

A pre-training objective that minimizes the Lyapunov exponent of the learned latent dynamics to promote locally stable and structured representations.

Why It Matters

This objective directly constrains the learned latent space dynamics to be stable, which is a novel and specific method for improving generalization in dynamics modeling.

Evidence

we pre-train any Pre-trained Language Model (PLM) by minimizing the Lyapunov exponent objective, which constrains the chaotic behavior of governing dynamics learned in the latent space.

Related Papers

• openalex-2603.22655-generalizing-dynamics-modeling-more-easily-from-representati