Skip to content

InternVL3-38B-AWQ 模型加载卡住 #5193

@Hello-Worldd

Description

@Hello-Worldd

transformers 4.52.2
ms-swift 3.7.0.dev0

infer_main(InferArguments(
infer_backend='pt',
val_dataset='/',
model='InternVL3-38B-AWQ',
)
执行上述代码卡主,训练测试都卡主,目前我感觉是卡在下面的代码的位置

model = automodel_class.from_pretrained(

infer_backend 用 lmdeploy 可以运行,但是训练不能用lmdeploy 吧,请问怎么解决呢,我希望lora微调InternVL3-38B-AWQ

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions