Pinned Loading

1. kubernetes-sigs/lws kubernetes-sigs/lws Public

   LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

   Go 808 183

2. kubeflow/trainer kubeflow/trainer Public

   Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

   Go 2.2k 1k

3. InftyAI/llmaz InftyAI/llmaz Public

   ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

   Go 313 48

4. llm-d/llm-d-inference-sim llm-d/llm-d-inference-sim Public

   A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

   Go 195 139

5. kubernetes-sigs/inference-perf kubernetes-sigs/inference-perf Public

   GenAI inference performance benchmarking tool

   Python 238 123

6. volcano-sh/volcano volcano-sh/volcano Public

   A Cloud Native Batch System (Project under CNCF)

   Go 5.9k 1.5k