Search results

Batteries included

Status: Open.

#229 In pytorch-labs/gpt-fast;

· vadimkantorov opened on Jun 30, 2025

Error in TP: RuntimeError: get_group_info: no group info associated with the group name

Status: Open.

#228 In pytorch-labs/gpt-fast;

· telegraph-pole-head opened on Jun 9, 2025

Rotary Embeddings Implementation

Status: Open.

#226 In pytorch-labs/gpt-fast;

· hello-fri-end opened on Apr 9, 2025

Dynamo error when trying to run eval.py <code>'Tensor' object has no attribute 'mask_mod'</code>

Status: Open.

#223 In pytorch-labs/gpt-fast;

· bobrenjc93 opened on Mar 8, 2025

对于源码没有给出的模型（如DeepSeek-R1-Distill-Qwen-1.5B）该如何使用这个方法？

Status: Open.

#220 In pytorch-labs/gpt-fast;

· yabuke opened on Feb 11, 2025

AttributeError: 'Tensor' object has no attribute 'mask_mod'

Status: Open.

#219 In pytorch-labs/gpt-fast;

· jiapingW opened on Jan 15, 2025

Issue: Performance degradation with int8 quantization in multi-batch scenarios

Status: Open.

#218 In pytorch-labs/gpt-fast;

· kakarotzzz opened on Jan 14, 2025

int4 quant broken right now?

Status: Open.

#217 In pytorch-labs/gpt-fast;

· jerryzh168 opened on Dec 20, 2024

Llama 3.1 70B size mismatch for tok_embeddings.weight

Status: Open.

#215 In pytorch-labs/gpt-fast;

· albertbn opened on Dec 4, 2024

Has anyone run this code with bs&gt;1 and speculatively?

Status: Open.

#214 In pytorch-labs/gpt-fast;

· deafTim opened on Oct 25, 2024

Mistake in 191 line if is_speculative=True generate.py ?

Status: Open.

#213 In pytorch-labs/gpt-fast;

· deafTim opened on Oct 23, 2024

Error with meta-llama/Llama-3.2-1B

Status: Open.

#211 In pytorch-labs/gpt-fast;

· deafTim opened on Oct 18, 2024