Skip to content
@neuralmagic

Neural Magic

Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM

Pinned Loading

  1. nm-vllm-certs nm-vllm-certs Public

    General Information, model certifications, and benchmarks for nm-vllm enterprise distributions

    11 2

  2. deepsparse deepsparse Public

    Sparsity-aware deep learning inference runtime for CPUs

    Python 3.1k 184

  3. sparseml sparseml Public

    Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

    Python 2.1k 152

  4. docs docs Public

    Top-level directory for documentation and general content

    MDX 121 7

  5. sparsezoo sparsezoo Public

    Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

    Python 383 26

  6. guidellm guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    Python 287 34

Repositories

Showing 10 of 70 repositories
  • vllm Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    neuralmagic/vllm’s past year of commit activity
    Python 12 Apache-2.0 7,348 0 6 Updated May 6, 2025
  • compressed-tensors Public

    A safetensors extension to efficiently store sparse quantized tensors on disk

    neuralmagic/compressed-tensors’s past year of commit activity
    Python 104 Apache-2.0 11 6 12 Updated May 6, 2025
  • docs Public

    Top-level directory for documentation and general content

    neuralmagic/docs’s past year of commit activity
    MDX 121 7 0 4 Updated May 6, 2025
  • gateway-api-inference-extension Public Forked from kubernetes-sigs/gateway-api-inference-extension

    Gateway API Inference Extension

    neuralmagic/gateway-api-inference-extension’s past year of commit activity
    Jupyter Notebook 1 Apache-2.0 74 22 5 Updated May 6, 2025
  • axolotl Public Forked from axolotl-ai-cloud/axolotl

    Go ahead and axolotl questions

    neuralmagic/axolotl’s past year of commit activity
    Python 0 Apache-2.0 1,025 0 3 Updated May 6, 2025
  • research Public

    Repository to enable research flows

    neuralmagic/research’s past year of commit activity
    Python 0 0 0 1 Updated May 6, 2025
  • LMCache Public Forked from LMCache/LMCache

    Redis for LLMs

    neuralmagic/LMCache’s past year of commit activity
    Python 0 Apache-2.0 127 0 1 Updated May 6, 2025
  • AutoFP8 Public
    neuralmagic/AutoFP8’s past year of commit activity
    Python 187 Apache-2.0 25 12 3 Updated May 5, 2025
  • sparsezoo Public

    Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

    neuralmagic/sparsezoo’s past year of commit activity
    Python 383 Apache-2.0 26 2 6 Updated May 5, 2025
  • sparsify Public

    ML model optimization product to accelerate inference.

    neuralmagic/sparsify’s past year of commit activity
    Python 327 Apache-2.0 30 1 8 Updated May 5, 2025