Topic domain
Scientific Computing
Numerical methods where floating point is the medium.
- Articles
- 80
- Clusters
- 8
- Foundational
- 24
- Intermediate
- 32
- Advanced
- 24
Representation, rounding, and error.
- IEEE 754 Binary Formats: Sign, Exponent, and Fraction Layouts
- Round-to-Nearest-Even and the Mechanics of Correct Rounding
- Subnormals, Signed Zero, and the Cost of Gradual Underflow
- Catastrophic Cancellation and the Cases Where Subtraction Is Exact
- Compensated Summation and How Summation Order Bounds Error
- Fused Multiply-Add, Single Rounding, and the Cost of Contraction
Factorizations and sparse methods.
- LU Factorization with Partial Pivoting and Element Growth
- Cholesky Factorization as a Positive-Definiteness Test
- Householder QR and Orthogonality Loss in Gram-Schmidt
- Condition Number, Residual, and Backward Error
- Compressed Sparse Row Storage and the Cost of Insertion
- Fill-In, Elimination Ordering, and Symbolic Factorization
Discretization and stability.
- Local Truncation Error in the Explicit Euler Method
- Global Error Accumulation and the CFL Condition
- Stiffness: When Explicit Steps Collapse
- Butcher Tableaux and the Order Conditions of Runge-Kutta Methods
- A-Stability and the Dahlquist Barrier
- Adaptive Step Size Control with Embedded Runge-Kutta Pairs
Simulation
10Monte Carlo and discrete event models.
- Inverse-Transform Sampling and the Generalized Inverse of the CDF
- Hyperplane Structure in Linear Congruential Generators
- Rejection Sampling and the Price of the Envelope
- Why Monte Carlo Error Falls as the Square Root of the Sample Count
- Weight Variance and Effective Sample Size in Importance Sampling
- Antithetic Variates and the Synchronization of Paired Runs
Clusters, MPI, and scaling limits.
- Ranks, Communicators, and the SPMD Execution Model
- Message Matching: Tags, Ordering, and the Deadlock in Naive Exchange
- What an Allreduce Actually Moves: Trees, Rings, and the Cost Model
- Non-Blocking Sends, Eager Limits, and the Progress Problem
- Halo Exchange and the Surface-to-Volume Tax on Domain Decomposition
- Strong and Weak Scaling: What Amdahl and Gustafson Actually Bound
Transforms, filters, and sampling.
- Sampling Rate, Aliasing, and the Folding of the Spectrum
- What the Discrete Fourier Transform Computes
- Quantization Step Size, the Six-Decibel Rule, and Dither
- FIR Design by Windowing and the Gibbs Ripple
- The Bilinear Transform and Frequency Warping
- Zero-Phase Filtering by Forward-Backward Passes
Encoding data into perceivable form.
- Perceptually Uniform Colormaps and the Failure of Rainbow Ramps
- Sample Positions, Trilinear Interpolation, and the Half-Cell Offset
- Marching Cubes and the Case Table That Cannot Be Interpolated
- Scattered Data Interpolation and the Conditioning of Radial Basis Functions
- Streamline Integration in Vector Fields and Where the Error Accumulates
- Direct Volume Rendering and the Opacity Correction Nobody Applies
Notebooks, environments, and provenance.
- Execution Counts and the Hidden State of a Notebook Kernel
- What a Notebook File Stores and What It Omits
- Reproducibility, Replicability, and the Boundaries Between Them
- Lockfiles, Hash Pinning, and Reconstructed Environments
- Container Images as Frozen Environments and Their Limits
- Seeds, Generator State, and Reproducible Random Streams
All Scientific Computing articles
- Oct 24, 2026 Conditioning, Tolerances, and the Digits a Reproduction Can Demand How the condition number sets the width of the interval a computed result actually occupies, and how that interval determines which differences between two runs are meaningful.
- Oct 18, 2026 The Bilinear Transform and Frequency Warping How mapping the analog frequency axis onto the unit circle produces a stable digital filter, why the cutoff moves, and how prewarping compensates for it.
- Oct 16, 2026 Lanczos Iteration and Shift-Invert for Extreme Eigenvalues How a three-term recurrence reduces a large symmetric matrix to a tridiagonal one, which eigenvalues that reduction can resolve, and why shift-invert changes the question being asked.
- Oct 12, 2026 Condition Number, Residual, and Backward Error Why a small residual does not imply a small error, how the condition number splits the blame between problem and algorithm, and how to estimate it without forming an inverse.
- Oct 7, 2026 Fill-In, Elimination Ordering, and Symbolic Factorization Why eliminating a sparse matrix creates new nonzeros, how ordering heuristics bound the damage, and how the pattern of the factor is predicted before any arithmetic runs.
- Aug 27, 2026 Execution Counts and the Hidden State of a Notebook Kernel Why the cells stored in a notebook file were not necessarily executed in the order the file shows, what the execution counter measures, and which parts of the state never reach the document.
- Aug 24, 2026 LU Factorization with Partial Pivoting and Element Growth How the pivot search bounds every multiplier by one, why that bound still does not bound the factors, and what the growth factor costs in practice.
- Aug 24, 2026 Symplectic Integrators and the Shape of Energy Drift Why a symplectic method does not conserve energy exactly but keeps it bounded, how the modified Hamiltonian explains the bound, and when a non-symplectic method can be better.
- Aug 20, 2026 Adaptive Step Size Control with Embedded Runge-Kutta Pairs How an embedded pair produces an error estimate from the same stages, why the controller takes the square root of the tolerance ratio, and how rejected steps and saturation are handled.
- Aug 12, 2026 Round-to-Nearest-Even and the Mechanics of Correct Rounding How an adder decides where to cut a result, what guard, round, and sticky bits encode, and why the tie case resolves toward an even last bit.
- Aug 1, 2026 Ranks, Communicators, and the SPMD Execution Model Why a cluster program is a fixed set of processes with private address spaces, and what the communicator abstraction adds beyond a process index.
- Jul 21, 2026 Compensated Summation and How Summation Order Bounds Error The worst-case error of a naive sum grows with the number of terms, pairwise reduction turns that into a logarithm, and compensation removes the growth at the cost of a serial dependency.
- Jul 10, 2026 Rejection Sampling and the Price of the Envelope The acceptance rate of a rejection sampler is exactly the reciprocal of its envelope constant, which is why a proposal that looks cheap can make the loop run thousands of trials per variate.
- Jul 6, 2026 Krylov Subspace Iteration and Why GMRES Restarts How a solver builds a subspace from repeated matrix-vector products, why the symmetric case needs three vectors of memory and the general case needs many, and when restarting destroys convergence.
- Jun 27, 2026 Forward Error, Backward Error, and Condition Numbers Separating what the algorithm got wrong from what the problem amplifies, why the rounding model hands over a backward error for free, and how a small residual can still mean a wrong answer.
- Jun 22, 2026 Halo Exchange and the Surface-to-Volume Tax on Domain Decomposition How ghost layers turn a stencil update into communication, why block decompositions beat slabs at scale, and where the ratio stops paying.
- Jun 5, 2026 What an Allreduce Actually Moves: Trees, Rings, and the Cost Model Why the obvious gather-reduce-scatter is the wrong shape, how ring and recursive-doubling algorithms trade latency for bandwidth, and where the two cross over.
- Jun 4, 2026 Seeds, Generator State, and Reproducible Random Streams Why a seed is not enough to reproduce a stochastic result, how generator state advances, and how parallel workers avoid splitting one stream into correlated pieces.
- May 20, 2026 A-Stability and the Dahlquist Barrier Why the second Dahlquist barrier limits linear multistep methods to order two when they must damp every decaying mode, and how the equivalent restrictions apply to Runge-Kutta schemes.
- May 12, 2026 Butcher Tableaux and the Order Conditions of Runge-Kutta Methods How a Runge-Kutta scheme is encoded in a tableau, which algebraic relations among its coefficients produce each order of accuracy, and why the condition count grows so fast.
- Apr 26, 2026 Content-Addressed Provenance Graphs for Derived Outputs Recording each step as a node keyed by the hash of its inputs, code, parameters, and environment, so that any output can be traced back to the exact bytes and commands that produced it.
- Apr 7, 2026 Why Monte Carlo Error Falls as the Square Root of the Sample Count The convergence rate follows from the variance of a sum, and the practical consequences are a fixed digit budget per factor of a hundred in work and an error bar that is itself estimated.
- Mar 13, 2026 Compressed Sparse Row Storage and the Cost of Insertion How three flat arrays encode a sparse matrix, why the matrix-vector product is limited by memory rather than arithmetic, and why assembly happens in a different format.
- Feb 24, 2026 Sort-Last Compositing and the Depth Order Across Ranks How independently rendered partial images are merged into one correct image, why binary-tree compositing beats direct all-to-all, and where blending order and depth precision break the result.
- Feb 12, 2026 Scattered Data Interpolation and the Conditioning of Radial Basis Functions Why meshless reconstruction solves a dense linear system, how the kernel choice decides between smoothness and conditioning, and what local stencils recover at a fraction of the cost.
- Jan 19, 2026 Subnormals, Signed Zero, and the Cost of Gradual Underflow Why the exponent field needed two reserved encodings, what a subnormal costs in precision, and how signed zero and NaN payloads change the meaning of equality.
- Jan 2, 2026 Weight Variance and Effective Sample Size in Importance Sampling Reweighting a proposal sample is exact only in the limit, and the estimator variance is governed by the second moment of the weights, which the effective sample size summarizes.
- Dec 31, 2025 Next-Event Time Advance and the Simplicity of the Priority Queue A discrete-event simulator advances time by jumping to the next scheduled event, and the correctness of that jump rests on a heap whose ordering and tie-breaking are both specified.
- Dec 27, 2025 Fat Trees, Toruses, and the Bisection Bandwidth Ceiling How the worst-case cut through a network bounds global traffic, why a torus gives up bisection bandwidth for constant degree, and where each topology fits.
- Dec 5, 2025 Marching Cubes and the Case Table That Cannot Be Interpolated How a 256-entry table turns a cube of eight samples into triangles, why edge interpolation places the vertices, and where the classic ambiguity creates holes or spurious connections.
- Oct 25, 2025 Tensor Fields and the Ambiguity of Eigenvector Glyphs How a symmetric rank-two field is decomposed into three directions, why those directions have no sign, and what happens to the picture at isotropic and planar degeneracies.
- Oct 17, 2025 Non-Blocking Sends, Eager Limits, and the Progress Problem Why separating initiation from completion does not automatically overlap communication with computation, and what the library must do while the application is not inside it.
- Sep 29, 2025 Birth-Death Processes and the Queue Length Equilibrium The transition diagram of a single-server queue is a birth-death chain whose stationary probabilities satisfy a flow-balance equation that yields the M/M/1 geometric distribution.
- Sep 28, 2025 Multifrontal Factorization and the Dense Front Matrix How a sparse factorization becomes a tree of small dense problems, why that conversion is what makes it fast, and how pivoting survives in a static data structure.
- Sep 14, 2025 Polyphase Decimation and the Cost of Changing Sample Rate Why a naive resampler computes samples it discards, how the polyphase decomposition removes that work, and what the filter length must satisfy before downsampling.
- Sep 5, 2025 What a Notebook File Stores and What It Omits The version 4 notebook schema keeps source, rendered output, and a little kernel metadata in one JSON document, and drops the environment, the inputs, and the process that produced it.
- Sep 4, 2025 Sparse Sampling and the Limits of Recovery Why a sub-Nyquist sample count can still determine a sparse signal, what the restricted isometry property guarantees, and where the guarantee stops being useful.
- Aug 29, 2025 Direct Volume Rendering and the Opacity Correction Nobody Applies How ray casting accumulates colour and opacity along a ray, why a transfer function tuned at one step size breaks at another, and where pre-integrated classification changes the answer.
- Aug 27, 2025 NUMA First-Touch and the Memory Bandwidth Ceiling per Node Why a multi-socket node delivers less than its nominal bandwidth to an unaware program, and how page placement, binding, and the roofline interact.
- Aug 1, 2025 Spectral Leakage, Scalloping, and Segment Averaging Why a finite record smears tones across DFT bins, how scalloping loss depends on the window, and what averaging overlapping segments does to variance and bias.
- Jul 19, 2025 Hyperplane Structure in Linear Congruential Generators Why successive outputs of a congruential generator lie on a small number of lattice planes, how the spectral test scores that defect, and what state size buys in a modern generator.
- Jul 2, 2025 Collective Buffering and Two-Phase I/O for Parallel Checkpoints Why many ranks writing separate files is the wrong shape, how two-phase I/O regroups data into stripe-aligned chunks, and what the file system consistency rules allow.
- Jun 12, 2025 Fused Multiply-Add, Single Rounding, and the Cost of Contraction What a fused multiply-add computes internally, why one rounding instead of two halves the error bound, and how compiler contraction makes identical source produce different bits.
- Apr 30, 2025 Newton Iterations for Implicit Spatial Operators How an implicit step on a nonlinear PDE becomes a Newton solve on a sparse system, what convergence the iteration has, and why the Jacobian is assembled from the stencil.
- Apr 26, 2025 Container Images as Frozen Environments and Their Limits Layer digesting, reproducibility of the build itself, kernel sharing, and the hardware facts a container cannot pin down.
- Apr 18, 2025 Catastrophic Cancellation and the Cases Where Subtraction Is Exact Why subtracting two nearly equal numbers amplifies existing error rather than creating it, when the difference is exact by Sterbenz, and how formulas are rewritten to avoid the loss.
- Mar 21, 2025 Householder QR and Orthogonality Loss in Gram-Schmidt Why the reflector-based factorization keeps its computed factors orthogonal when classical Gram-Schmidt does not, and what that costs in flops.
- Feb 19, 2025 Global Error Accumulation and the CFL Condition How local truncation errors combine across steps, why the von Neumann analysis of explicit advection produces the Courant number bound, and what propagation velocity has to do with it.
- Feb 15, 2025 Multi-Dimensional Transfer Functions and the Gradient-Magnitude Histogram Why a value-only transfer function cannot separate two materials with the same density, how the joint histogram of value and gradient magnitude classifies boundaries, and what the extra dimensions cost.
- Feb 12, 2025 Message Matching: Tags, Ordering, and the Deadlock in Naive Exchange How a receive identifies its message, what the non-overtaking rule does and does not guarantee, and why a ring exchange deadlocks only above a size threshold.
- Feb 4, 2025 Detailed Balance and the Stationary Distribution of a Markov Chain A single equation on the transition kernel guarantees that a distribution is stationary, which is what turns a chain of biased moves into a sampler for an arbitrary target.
- Jan 27, 2025 Executing Provenance Records to Certify That a Result Still Reconstructs Turning a recorded dependency graph into a re-runnable pipeline that hashes outputs and compares them to stored digests, so a result carries continuous evidence that it is still reproducible.
- Jan 4, 2025 What the Discrete Fourier Transform Computes The DFT as a projection onto a fixed set of complex exponentials, why the transform matrix is orthogonal, and where the n log n cost of the fast algorithm comes from.
- Dec 17, 2024 Local Truncation Error in the Explicit Euler Method Where the O(h^2) per-step error in forward Euler comes from, why the global error drops to O(h), and how roundoff limits the step size from below.
- Dec 12, 2024 Rare-Event Estimation with Splitting and the Cross-Entropy Shift When the event of interest has probability a million to one, plain sampling sees nothing, and the standard tools bias the proposal or multiply the paths to reach the tail in bounded steps.
- Nov 14, 2024 Lockfiles, Hash Pinning, and Reconstructed Environments How a resolved dependency graph is recorded with content hashes, what the installer guarantees on a rebuild, and where the reconstruction stops being faithful.
- Nov 8, 2024 Cholesky Factorization as a Positive-Definiteness Test Why the symmetric factorization needs no pivot search, where the factor-of-two saving comes from, and how a failed square root becomes a definiteness verdict.
- Oct 27, 2024 Sample Positions, Trilinear Interpolation, and the Half-Cell Offset Why a scalar grid carries two coordinate conventions, what trilinear interpolation costs and how it errs, and how resampling a field to a second grid trades resolution against aliasing.
- Oct 7, 2024 Limiters, the TVD Condition, and Shock Capture Why a second-order scheme oscillates at a discontinuity, how the total variation diminishing condition forbids new extrema, and what a slope limiter must satisfy to preserve both properties.
- Sep 3, 2024 Zero-Phase Filtering by Forward-Backward Passes Running a filter twice in opposite directions cancels its phase at the cost of squaring its magnitude, and the initial-condition choice decides how much edge transient survives.
- Jul 11, 2024 Reassociation, Excess Precision, and the Limits of Bitwise Reproducibility Why identical source can produce different bits on two machines, which compiler transformations are responsible, and how ordering or exactness restores a stable result.
- Jun 3, 2024 Streamline Integration in Vector Fields and Where the Error Accumulates How a vector field becomes a curve through numerical integration, why cell-crossing interpolation dominates the error, and what separates a valid line from a decorative one.
- May 13, 2024 Bit Rot, Link Rot, and Replaying an Analysis Years Later What degrades in a stored computation over time, which failures are recoverable, and what has to be captured at creation time to make a late replay possible at all.
- May 6, 2024 Quantization Step Size, the Six-Decibel Rule, and Dither Why each added bit buys roughly six decibels of signal-to-noise ratio, when the uniform-error model stops holding, and what dither trades away to fix it.
- May 1, 2024 Error-Free Transformations and Double-Double Arithmetic How TwoSum and TwoProduct recover the exact rounding error of an operation, what a double-double pair really represents, and where the transformations stop being exact.
- Apr 8, 2024 IEEE 754 Binary Formats: Sign, Exponent, and Fraction Layouts How binary16, binary32, binary64, and binary128 divide a fixed-width word into three fields, why the exponent is biased, and what the implicit leading bit buys.
- Feb 26, 2024 Incomplete LU Preconditioning and Dropped Fill How a factorization restricted to the original sparsity pattern still clusters the spectrum, what the level-of-fill and threshold variants trade, and why the triangular solves limit parallelism.
- Feb 25, 2024 The Parabolic Step Limit in Explicit Diffusion Schemes Why an explicit update of the heat equation requires a step proportional to the square of the mesh spacing, what the amplification analysis shows, and how implicit treatment removes the restriction.
- Feb 5, 2024 Strong and Weak Scaling: What Amdahl and Gustafson Actually Bound The two scaling questions, the arithmetic behind their ceilings, and how to read a measured curve without attributing every bend to the algorithm.
- Dec 28, 2023 In-Situ Analysis and the Bandwidth That Is Not There Why moving simulation output to a separate visualization process stops working at scale, how coupling the analysis into the solver changes the algorithm, and what the shared-memory boundary costs.
- Dec 21, 2023 Perceptually Uniform Colormaps and the Failure of Rainbow Ramps How a scalar field becomes color through a lookup table, why monotonic lightness and equal perceptual steps are the two constraints that matter, and where banding and false contours come from.
- Jun 7, 2023 Antithetic Variates and the Synchronization of Paired Runs Pairing each draw with its mirror cancels the leading fluctuation of an estimator when the integrand is monotone, and the price is a stream whose consumption must stay aligned.
- Apr 6, 2023 Stiffness: When Explicit Steps Collapse What makes an initial value problem stiff, why an explicit method is forced to steps far below what accuracy requires, and how the Jacobian eigenvalues set the forced step.
- Jan 25, 2023 Communication-Avoiding Algorithms and the Latency Floor How restructuring the arithmetic to block inner products and use fewer global synchronization steps changes the scaling exponent, and what it costs in numerical stability.
- Jan 9, 2023 Correctly Rounded Decimal Conversion and Shortest Round-Trip Printing Why parsing a decimal string to the nearest double needs exact arithmetic in the hard cases, and how the shortest string that maps back is found without searching.
- Dec 29, 2022 Sampling Rate, Aliasing, and the Folding of the Spectrum Why the Nyquist criterion constrains the signal rather than the converter, how aliasing folds frequencies arithmetically, and what reconstruction actually requires.
- Aug 30, 2022 Inverse-Transform Sampling and the Generalized Inverse of the CDF Why mapping a uniform variate through the quantile function produces the right distribution, what the discrete case changes, and where floating-point resolution destroys the tails.
- Jul 17, 2022 The Analytic Signal and Instantaneous Frequency How a Hilbert transform turns a real signal into a complex one with one-sided spectrum, why the derived phase derivative is not always a frequency, and where it fails.
- Apr 7, 2022 Reproducibility, Replicability, and the Boundaries Between Them The distinct claims implied by re-running an analysis, rebuilding it from raw data on new instruments, and getting the same conclusion from an independent study, and which evidence each one requires.
- Dec 24, 2021 FIR Design by Windowing and the Gibbs Ripple Why truncating an ideal impulse response produces passband ripple, how window shape trades transition width against stopband rejection, and what the design formulas predict.