Tag
linear-models
- Aug 22, 2025 Least Squares as Orthogonal Projection onto a Design Matrix Why the normal equations are a geometric condition rather than an algebraic trick, what rank deficiency does to the answer, and why forming the Gram matrix costs half the digits. machine learning
- Jul 21, 2025 Feature Hashing and the Collision Bound That Sets Its Width Why signed hashing leaves inner products unbiased, how many collisions a fixed width produces, and the error term that appears in place of a vocabulary lookup. machine learning
- Apr 10, 2023 Ridge Shrinkage in Ill-Conditioned Design Matrices How adding a multiple of the identity to the Gram matrix reweights singular directions, what the bias-variance trade actually buys, and why the penalty must not include the intercept. machine learning