Tag
preconditioning
- Sep 5, 2026 Adaptive Step Sizes: AdaGrad, RMSProp, and Adam How per-coordinate accumulators of squared gradients rescale the update, why the resulting methods needed repair to keep their convergence guarantees, and what the state costs. machine learning
- Feb 26, 2024 Incomplete LU Preconditioning and Dropped Fill How a factorization restricted to the original sparsity pattern still clusters the spectrum, what the level-of-fill and threshold variants trade, and why the triangular solves limit parallelism. scientific computing