[Bug]: undefined symbol: __nvJitLinkComplete_12_4, version libnvJitLink.so.12

[yananchen1989]

Your current environment

i cannot execute collect_env.py because of this error.

in my another environment: torch is 2.4.0 and the version of vllm is 0.6.3.post1 which works fine.

Model Input Dumps

No response

🐛 Describe the bug

following installation guide: https://docs.vllm.ai/en/stable/getting_started/installation.html#install-the-latest-code

vllm version: 0.6.3.post2.dev386+g0b8bb86b

however, it forces the installation of torch to be 2.5.1

which causes the error :

Traceback (most recent call last):
File "/home/ubuntu/vllm/collect_env.py", line 15, in
from vllm.envs import environment_variables
File "/home/ubuntu/vllm/vllm/init.py", line 3, in
from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
File "/home/ubuntu/vllm/vllm/engine/arg_utils.py", line 8, in
import torch
File "/opt/conda/envs/vllmsource/lib/python3.11/site-packages/torch/init.py", line 367, in
from torch._C import * # noqa: F403
^^^^^^^^^^^^^^^^^^^^^^
ImportError: /opt/conda/envs/vllmsource/lib/python3.11/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12: undefined symbol: __nvJitLinkComplete_12_4, version libnvJitLink.so.12

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[yananchen1989]

related issue: pytorch/pytorch#111469

[yananchen1989]

python -c "import torch"

error:

Traceback (most recent call last):
File "", line 1, in
File "/opt/conda/envs/vllmsource/lib/python3.11/site-packages/torch/init.py", line 367, in
from torch._C import * # noqa: F403
^^^^^^^^^^^^^^^^^^^^^^
ImportError: /opt/conda/envs/vllmsource/lib/python3.11/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12: undefined symbol: __nvJitLinkComplete_12_4, version libnvJitLink.so.12