Tag
mpi
- Aug 1, 2026 Ranks, Communicators, and the SPMD Execution Model Why a cluster program is a fixed set of processes with private address spaces, and what the communicator abstraction adds beyond a process index. scientific computing
- Jun 5, 2026 What an Allreduce Actually Moves: Trees, Rings, and the Cost Model Why the obvious gather-reduce-scatter is the wrong shape, how ring and recursive-doubling algorithms trade latency for bandwidth, and where the two cross over. scientific computing
- Oct 17, 2025 Non-Blocking Sends, Eager Limits, and the Progress Problem Why separating initiation from completion does not automatically overlap communication with computation, and what the library must do while the application is not inside it. scientific computing
- Feb 12, 2025 Message Matching: Tags, Ordering, and the Deadlock in Naive Exchange How a receive identifies its message, what the non-overtaking rule does and does not guarantee, and why a ring exchange deadlocks only above a size threshold. scientific computing