Pinned Loading

1. lws lws Public

   Forked from kubernetes-sigs/lws

   LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

   Go 1

2. llm-d-inference-scheduler llm-d-inference-scheduler Public

   Forked from llm-d/llm-d-router

   Inference scheduler for llm-d

   Go

3. ray ray Public

   Forked from ray-project/ray

   Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

   Python

4. llm-d-inference-sim llm-d-inference-sim Public

   Forked from llm-d/llm-d-inference-sim

   A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

   Go

5. llm-d/llm-d-autoscaling llm-d/llm-d-autoscaling Public

   Variant optimization autoscaler for distributed inference workloads

   Go 61 99