ggml-org ggml · Discussions · GitHub

Discussions

You must be logged in to vote

How to apply a PyTorch Linear layer to a 2D tensor with GGML

sevagh asked Jun 25, 2023 in Q&A · Answered

1
You must be logged in to vote

Is there a Discord group or a Slack chanell for this project?

metaxenology started Jun 9, 2023 in General

2
You must be logged in to vote

Any way to improve memory bandwidth for better ms per token for intel silicon?

t1maccapp asked Jun 8, 2023 in Q&A · Closed · Unanswered

1
You must be logged in to vote

BART base models

guinmoon asked Jun 7, 2023 in Q&A · Unanswered

0
You must be logged in to vote

Does ggml supports Model splitting to gpu and cpu ??

forrackun asked Jun 7, 2023 in Q&A · Closed · Unanswered

0
You must be logged in to vote

ggml VS ncnn

khengari77 started May 11, 2023 in General

1
You must be logged in to vote

It is possible compile gpt-neox with cuda ???

ArturK-85 asked May 25, 2023 in Q&A · Answered

2
You must be logged in to vote

Examples

mverrilli started May 20, 2023 in Ideas

1
You must be logged in to vote

Custom kernels, ternary functions?

cztomsik started May 3, 2023 in Ideas

4
You must be logged in to vote

How to cache partial results in graph

iacore started May 15, 2023 in General

1
You must be logged in to vote

Any plans to support StarCoder?

sfallah started May 9, 2023 in General

2
You must be logged in to vote

Python bindings with Hugging Face Hub and LangChain support

marella started May 15, 2023 in Show and tell

0
You must be logged in to vote

Is it possible to convert pytorch to ggml?

Dampish0 asked Apr 4, 2023 in Q&A · Answered

3
You must be logged in to vote

Sparsity support

MannyKayy started Apr 2, 2023 in Ideas

0
You must be logged in to vote

rinna's Japanese GPT model support

katsu560 started Mar 4, 2023 in General

1
You must be logged in to vote

Could someone explain a bit about how this is different from post-training quantization supported by typical frameworks like torch and TF?

ghost asked Mar 19, 2023 in Q&A · Answered

4
You must be logged in to vote

[GPT-J] How to get token embeddings ?

ocordeiro asked Mar 7, 2023 in Q&A · Unanswered

6