Tag
split-criteria
- Jun 6, 2026 Histogram Split Finding and the Weighted Quantile Sketch Binning a feature into a few hundred buckets turns repeated per-node sorts into linear passes, and choosing the boundaries by weighted quantiles keeps the buckets where the data actually is. machine learning
- Jan 6, 2026 How CART Scans Sorted Feature Values for the Best Split Threshold The greedy split search reduces to a single sorted pass per feature, with incremental class counts turning an apparent quadratic problem into a linear scan. machine learning
- Jul 10, 2024 Gini, Entropy, and Why Misclassification Error Cannot Grow a Tree Three impurity functions look interchangeable, but only the strictly concave ones produce a useful ranking of splits. A worked partition shows where the third fails. machine learning
- Feb 14, 2024 Second-Order Boosting and the Regularized Split Gain A quadratic expansion of the loss gives closed-form leaf weights from gradient and curvature sums, turning each split into a comparison of two ratios and making regularization part of the objective. machine learning