Skip to content

Commit 907f935

Browse files
authored
[V1] Fix general plugins not loaded in engine for multiproc (vllm-project#18326)
Signed-off-by: Yong Hoon Shin <[email protected]>
1 parent 5d7f545 commit 907f935

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

vllm/v1/engine/core.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,6 +57,10 @@ def __init__(self,
5757
executor_fail_callback: Optional[Callable] = None):
5858
assert vllm_config.model_config.runner_type != "pooling"
5959

60+
# plugins need to be loaded at the engine/scheduler level too
61+
from vllm.plugins import load_general_plugins
62+
load_general_plugins()
63+
6064
self.vllm_config = vllm_config
6165
logger.info("Initializing a V1 LLM engine (v%s) with config: %s",
6266
VLLM_VERSION, vllm_config)

0 commit comments

Comments
 (0)