Improved Hypergradient optimizers for ML, providing better generalization and faster convergence.
-
Updated
Oct 25, 2026 - Jupyter Notebook
Improved Hypergradient optimizers for ML, providing better generalization and faster convergence.
Code for ICCV'25 paper: Learn2Synth: Learning Optimal Data Synthesis using Hypergradients for Brain Image Segmentation
Code for the paper Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates by Riccardo Grazzi, Massimiliano Pontil and Saverio Salzo (ICML 2024).
Learning-rate research: can the optimizer learn its own LR? Literature review of 28 papers, math notes, small PyTorch experiments, and an HD-WSD (hypergradient + warmup-stable-decay) prototype.
To associate your repository with the hypergradient topic, visit your repo's landing page and select "manage topics."