undefined min read
GPU Systems 04 - Writing CUDA Kernels and Choosing Launch Configuration
How to think about indexing and launch configuration when writing CUDA kernels
Posts tagged "kernel"
undefined min read
GPU Systems 15 - LayerNorm and RMSNorm Kernel Structure
Why normalization kernels are often memory-bound and structurally important
undefined min read
Linux Internals 01 - Operating System Overview
What an operating system does and the role of the Linux kernel
undefined min read
Linux Internals 06 - System Calls and the Kernel
How a system call transitions from user space to kernel space, and how kernel modules work
undefined min read
PyTorch Internals 10 - Connecting a Custom CUDA Kernel Through an Extension
A CUDA kernel becomes a real PyTorch operator only when tensor contracts, runtime semantics, and integration details are handled correctly
undefined min read
PyTorch Internals 13 - When a Fused Operator Is Actually Worth It
Fusion is valuable when it reduces memory traffic and intermediate materialization, not just when it reduces the number of visible ops
undefined min read
PyTorch Internals 17 - What Role Triton Plays Inside the PyTorch Ecosystem
Triton is not just a convenient kernel language; it is part of the modern PyTorch kernel and compilation story