undefined min read
GPU Systems 03 - Memory Hierarchy and Bandwidth
How to think about the GPU memory hierarchy and bandwidth bottlenecks
Lectures
All posts in the Lectures
undefined min read
GPU Systems 04 - Writing CUDA Kernels and Choosing Launch Configuration
How to think about indexing and launch configuration when writing CUDA kernels
undefined min read
GPU Systems 05 - Coalescing, Shared Memory, and Reduction Patterns
The optimization patterns that keep showing up in CUDA kernels
undefined min read
GPU Systems 06 - Triton and the Practical Shape of Kernel Optimization
How Triton fits into real kernel optimization work, especially for LLM-style workloads
undefined min read
GPU Systems 07 - Occupancy and Latency Hiding
Understanding occupancy as a latency-hiding concept instead of just a percentage
undefined min read
GPU Systems 08 - Profiling and the Roofline View
A practical way to use profiling and roofline thinking to understand kernel bottlenecks
undefined min read
GPU Systems 09 - Why Naive Matrix Multiplication Is Slow
Using naive matrix multiplication to see memory reuse and traffic problems clearly
undefined min read
GPU Systems 10 - Tiled Matrix Multiplication and Shared Memory
Why tiled matrix multiplication and shared memory create such a big performance difference
undefined min read
GPU Systems 11 - Shared Memory Bank Conflicts
Why shared memory is not automatically fast and how bank conflicts appear