Truncated Svd

Sven’s pseudoinverse trick: A natural gradient with less hype

Sven’s authors claim their pseudoinverse-based optimizer cuts natural gradient costs to *k*× stochastic overhead—without defining *k* for real-world models.