Tag
distributed-memory
- Aug 1, 2026 Ranks, Communicators, and the SPMD Execution Model Why a cluster program is a fixed set of processes with private address spaces, and what the communicator abstraction adds beyond a process index. scientific computing
- Mar 24, 2023 Supersteps and Message Bounds: Why Distributed Parallelism Costs More How the BSP model charges for latency and bandwidth per round, what the h-relation says about all-to-all traffic, and why matrix multiplication needs more memory per processor to avoid moving data. algorithms