Search results

When to support the llama model?

deespeed chatDeepSpeed ChatDeepSpeed Chat

llamaQuestions related to llama modelQuestions related to llama model

Status: Open.

#540 In deepspeedai/DeepSpeedExamples;

· SunQiDong1999 opened on May 21, 2023

Much more memory used in step 3 when using multi gpus compared to using single gpu

deespeed chatDeepSpeed ChatDeepSpeed Chat

llamaQuestions related to llama modelQuestions related to llama model

systemAn issue with a environment/system setup.An issue with a environment/system setup.

Status: Open.

#529 In deepspeedai/DeepSpeedExamples;

· cokuehuang opened on May 16, 2023

OOM problem when fine-tune reward model with LLaMA in step 2

deespeed chatDeepSpeed ChatDeepSpeed Chat

llamaQuestions related to llama modelQuestions related to llama model

Status: Open.

#521 In deepspeedai/DeepSpeedExamples;

· kiseliu opened on May 11, 2023

In Step3, RuntimeError:RewardModel:size mismatch for rwtranrsformer.decoder.embed_tokens.weight

deespeed chatDeepSpeed ChatDeepSpeed Chat

llamaQuestions related to llama modelQuestions related to llama model

Status: Open.

#512 In deepspeedai/DeepSpeedExamples;

· KyrieXu11 opened on May 10, 2023

how to save model, i cant load saved llama7b model

deespeed chatDeepSpeed ChatDeepSpeed Chat

llamaQuestions related to llama modelQuestions related to llama model

Status: Open.

#365 In deepspeedai/DeepSpeedExamples;

· Pattaro opened on Apr 20, 2023

About release date for Llama system support

deespeed chatDeepSpeed ChatDeepSpeed Chat

llamaQuestions related to llama modelQuestions related to llama model

Status: Open.

#350 In deepspeedai/DeepSpeedExamples;

· rockstone533 opened on Apr 19, 2023

Using LLaMA in reward model training

deespeed chatDeepSpeed ChatDeepSpeed Chat

llamaQuestions related to llama modelQuestions related to llama model

Status: Open.

#349 In deepspeedai/DeepSpeedExamples;

· YingHH1 opened on Apr 19, 2023

Job hang at model forward for rank 0 after saving immediate ckpt, multi nodes, ZeRO3

deespeed chatDeepSpeed ChatDeepSpeed Chat

llamaQuestions related to llama modelQuestions related to llama model

Status: Open.

#344 In deepspeedai/DeepSpeedExamples;

· xiaolhu1224 opened on Apr 18, 2023