Tag
expectation-maximization
- Dec 8, 2025 Expectation-Maximization as Inference with Latent Variables Why the log outside a sum over hidden variables blocks direct maximization, how an exact E step makes a lower bound tight enough to guarantee progress, and where the fixed points end up. machine learning
- Oct 15, 2024 Gaussian Mixture Models and the EM Lower Bound Soft cluster membership follows from a latent-variable model whose log-likelihood has no closed-form maximizer; the EM iteration maximizes a lower bound that is tight at the posterior, and it can also drive components to degenerate solutions. machine learning