Popular repositories Loading

1. ps_pytorch ps_pytorch Public

   implement distributed machine learning with Pytorch + OpenMPI

   Python 53 15

2. Cuttlefish Cuttlefish Public

   The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"

   Python 44 4

3. PyTorch-parameter-server PyTorch-parameter-server Public

   Implementation of Parameter Server using PyTorch communication lib

   Python 41 12

4. ATOMO ATOMO Public

   Atomo: Communication-efficient Learning via Atomic Sparsification

   Python 29 6

5. Draco Draco Public

   DRACO: Byzantine-resilient Distributed Training via Redundant Gradients

   Python 23 13

6. DETOX DETOX Public

   DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation

   Python 16 2