Posts tagged "backward"

PyTorch Internals 05 - How the Autograd Graph and Engine Work

Autograd is not just automatic differentiation; it is a graph-construction and backward-execution runtime

PyTorch Internals 06 - When and How to Use a Custom Autograd Function

Custom autograd functions are a practical place to define forward-backward contracts before dropping to lower-level extensions

PyTorch Internals 12 - Backward Implementation Patterns and Saved-State Strategy

Backward design is really a question about what to save, what to recompute, and how to preserve correct semantics