Tag
newton-method
- Apr 30, 2025 Newton Iterations for Implicit Spatial Operators How an implicit step on a nonlinear PDE becomes a Newton solve on a sparse system, what convergence the iteration has, and why the Jacobian is assembled from the stencil. scientific computing
- Apr 28, 2024 Newton and IRLS Fitting for Logistic Regression Why logistic regression is fitted by repeated weighted least squares, how the Hessian decides the step, and what happens when the weights collapse under separation. machine learning
- Feb 14, 2024 Second-Order Boosting and the Regularized Split Gain A quadratic expansion of the loss gives closed-form leaf weights from gradient and curvature sums, turning each split into a comparison of two ratios and making regularization part of the objective. machine learning