Pinned Loading

1. Jiffy Jiffy Public

   C++ 46 4

2. caffeine caffeine Public

   Forked from ben-manes/caffeine

   A high performance caching library for Java 8

   Java

3. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 4.5k 766

4. llm-d/llm-d-router llm-d/llm-d-router Public

   llm-d Router: The intelligent entry point for inference requests

   Go 336 367

5. llm-d/llm-d-autoscaling llm-d/llm-d-autoscaling Public

   Variant optimization autoscaler for distributed inference workloads

   Go 57 94

6. llm-d-incubation/llm-d-skills llm-d-incubation/llm-d-skills Public

   Python 6 11