Pinned Loading

1. lite.ai.toolkit lite.ai.toolkit Public

   🛠 A lite C++ AI toolkit: 100+🎉 models (Stable-Diffusion, FaceFusion, YOLO series, Det, Seg, Matting) with MNN, ORT and TensorRT.

   C++ 4.1k 743

2. LeetCUDA LeetCUDA Public

   📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA/Tensor Cores Kernels, HGEMM, FA-2 MMA etc.🔥

   Cuda 4.7k 491

3. Awesome-LLM-Inference Awesome-LLM-Inference Public

   📚A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, Parallelism, MLA, etc.

   Python 4.1k 282

4. Awesome-DiT-Inference Awesome-DiT-Inference Public

   📚A curated list of Awesome Diffusion Inference Papers with codes: Sampling, Caching, Multi-GPUs, etc. 🎉🎉

   255 15

5. ffpa-attn ffpa-attn Public

   📚FFPA(Split-D): Extend FlashAttention with Split-D for large headdim, O(1) GPU SRAM complexity, 1.8x~3x↑🎉 faster than SDPA EA.

   Cuda 184 8

6. lihang-notes lihang-notes Public

   📚《统计学习方法-李航: 笔记-从原理到实现》 这是一份非常详细的学习笔记，200页PDF，各种手推公式细节讲解以及R语言实现. 🎉

   Shell 463 57