Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 1 2

2. kernels kernels Public

   Forked from huggingface/kernels

   Build compute kernels and load them from the Hub.

   Python 1

3. neural-compressor neural-compressor Public

   Forked from intel/neural-compressor

   Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, spar…

   Python

4. accelerate accelerate Public

   Forked from huggingface/accelerate

   🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

   Python

5. tau tau Public

   Forked from pytorch/PiPPy

   Pipeline Parallelism for PyTorch

   Python

6. optimum-intel optimum-intel Public

   Forked from huggingface/optimum-intel

   Accelerate inference of 🤗 Transformers with Intel optimization tools

   Jupyter Notebook 1