Search results

Missing pyproject.toml

Status: Open.

#49 In neuralmagic/AutoFP8;

· dakinggg opened on May 2, 2025

用这个量化的时候报了这个错，求解决

Status: Open.

#48 In neuralmagic/AutoFP8;

· zhipengChen opened on Feb 17, 2025

[Qusetion] How can i see the net structure after i use autofp8

Status: Open.

#46 In neuralmagic/AutoFP8;

· willnju opened on Oct 17, 2024

How to Quantize KV Cache for the deepseek-v2 Model

Status: Open.

#44 In neuralmagic/AutoFP8;

· fengyang95 opened on Sep 12, 2024

Quantize DeepSeek-Coder-V2-Instruct to W8A8(INT8)?

Status: Open.

#42 In neuralmagic/AutoFP8;

· halexan opened on Aug 21, 2024

Differences in Dynamic Quantization Speedup for Varying SFT Tasks on Qwen2-72b-Instruct Models

Status: Open.

#40 In neuralmagic/AutoFP8;

· IPostYellow opened on Aug 15, 2024

CUDA out of memory when quantizing llama3.1-405b on 80GiBx8 H100 instance

Status: Open.

#36 In neuralmagic/AutoFP8;

· sfc-gh-zhwang opened on Aug 7, 2024

Support for Vision models

Status: Open.

#34 In neuralmagic/AutoFP8;

· Syst3m1cAn0maly opened on Jul 19, 2024

Runtime Error:The weights trying to be saved contained shared tensors.

Status: Open.

#31 In neuralmagic/AutoFP8;

· IEI-mjx opened on Jul 15, 2024

Integration with Hugging Face transformers library

Status: Open.

#30 In neuralmagic/AutoFP8;

· SunMarc opened on Jul 11, 2024

error: RuntimeError: The weights trying to be saved contained shared tensors

Status: Open.

#28 In neuralmagic/AutoFP8;

· AlphaINF opened on Jul 9, 2024

Bitblas supports FP8 Inference as well

Status: Open.

#2 In neuralmagic/AutoFP8;

· LeiWang1999 opened on May 6, 2024