Welcome to the PyTorch developer's wiki!

Please read our best practices if you're interested in adding a page or making edits

• Code of Conduct
• PyTorch Governance

• The Ultimate Guide to PyTorch Contributions

• Release notes
• PyTorch Versions
• Public API definition and documentation
• Frontend Backward and Forward Compatibility Policy
• Docstring Guidelines
• Troubleshooting Documentation Build

New to PyTorch? Don't know where to start?

• Core Onboarding

• Developer FAQ
• Where should I add documentation?
• PyTorch Data Flow and Interface Diagram
• Multiprocessing Technical Notes
• Software Architecture for c10
• PyTorch JIT IR format (slightly out of date now)
• TH to ATen porting guide
• Writing Python in C++ (a manifesto)
• Introducing Quantized Tensor
• Life of a Tensor
• How to use TensorIterator
• Running and writing tests
• Writing memory format aware operators
• Guide for adding type annotations to PyTorch
• The torch.fft module in PyTorch 1.7
• PyTorch-ONNX exporter

• Automatic Mixed Precision package
• Automatic Mixed Precision examples
• Autograd mechanics
• Broadcasting semantics
• CPU threading and TorchScript inference
• CUDA semantics
• Frequently Asked Questions
• Extending PyTorch
• Features for large-scale deployments
• Multiprocessing best practices
• Reproducibility
• Serialization semantics
• Windows FAQ
• Python Language Reference Coverage
• Complex Numbers
• Android
• iOS
• How-to: Writing PyTorch & Caffe2 Operators
• CUDA IPC Refcounting implementation explained
• Autograd
• Code Coverage Tool for Pytorch
• How to write tests using FileCheck
• PyTorch Release Scripts
• Serialized operator test framework
• Observers
• Snapdragon NPE Support
• Using TensorBoard in ifbpy

• Named Tensors
• Named Tensors operator coverage

• Introduction to Quantization
• Quantization Operation coverage
• Implementing native quantized ops
• Extend PyTorch Quantization to Custom Backends

• JIT Technical Overview
• Static Runtime
• TorchScript serialization
• PyTorch Fuser
• Implementation reference for the CUDA PyTorch JIT Fuser
• TorchScript
• TorchScript Language Reference
• TorchScript Unsupported Pytorch Constructs

• Distributed RPC Framework
• Distributed Autograd Design
• Remote Reference Protocol
• Distributed Data Parallel
• Distributed communication package
• Contributing to PyTorch Distributed

• PyTorch with C++
• The C++ Frontend
• PyTorch C++ API
• Tensor basics
• Tensor Creation API
• Tensor Indexing API
• MaybeOwned<Tensor>
• Installing C++ Distributions of PyTorch
• Torch Library API
• libtorch
• C++ / Python API parity tracker
• TensorExpr C++ Tests
• JIT C++ Tests
• C++ Frontend Tests
• FAQ
• Best Practices to Edit and Compile Pytorch Source Code On Window

• Distributed Data Parallel Benchmark
• Fast RNN benchmarks
• PyTorch/Caffe2 Operator Micro-benchmarks
• torch_function micro-benchmarks
• Benchmarking tool for the autograd AP
• Modular Benchmarking Components

• DataPipe
• DataPipe test requirements

• Continuous Integration
• PyTorchBot commands
• PyTorch AutoLabel Bot
• Code review values
• Linting
• Pull request review etiquette
• Debugging with SSH on Github Actions
• Using hud.pytorch.org