undefined min read
GPU Systems 14 - Why Softmax Is Such a Good Kernel Exercise
How softmax combines reductions, memory traffic, and numerical stability in one kernel
Posts tagged "numerical-stability"
undefined min read
PyTorch Internals 14 - AMP, Autocast, and Numerical Stability
A production-quality custom operator has to behave correctly under mixed precision, not just benchmark well in isolation