🔥 OpenVINO Node for ComfyUI 🔥

Optimize model inference in ComfyUI with Intel OpenVINO toolkits

---

Supported Hardware • Install • Instruction • Q&A

💻 Supported Hardware

This node can support running model on Intel CPU, GPU and NPU device. You can find more detailed informantion in OpenVINO System Requirements.

🚗 Install

Prererquisites — Install comfy-cli

The recommended installation method is to use the Comfy Registry.

Comfy Registry

These nodes can be installed via the Comfy Registry.

comfy node registry-install comfyui-openvino

ComfyUI-Manager

This node can be installed via ComfyUI-Manager in the UI or via the CLI:

comfy node install comfyui-openvino

Manual

This node can also be installed manually by copying them into your custom_nodes folder and then installing dependencies:

cd ComfyUI/custom_nodes
git clone https://github.com/openvino-dev-samples/comfyui_openvino
cd comfyui_openvino
pip install -r requirements.txt

🚀 Instruction

To trigger OpenVINO Node for ComfyUI, you can follow the example as reference:

1. Start a ComfyUI server.

• lanuch from source:

  cd ComfyUI
  python3 main.py --cpu --use-pytorch-cross-attention

• lanuch from comfy-cli:

  comfy launch -- --cpu --use-pytorch-cross-attention

2. Prepare a standard workflow in ComfyUI.

3. Add OpenVINO Node.

4. Connect TorchCompileDiffusionOpenVINO with Diffusion model and TorchCompileVAEOpenVINO with VAE model

5. Run workflow. Please notice it may need an additional warm-up inference after switching new model.

🤔 Q&A

1. Does it support LoRA loader ?

Yes, and you can refer the following picture to add it into a workflow of OpenVINO node.

---

2. How to install ComfyUI-OpenVINO via ComfyUI-Manager in the Portable version of ComfyUI?

ComfyUI-Manager is not enabled by default in the Portable version. Follow the official guide to enable it first.

Portable ComfyUI builds may not include Git, which is required for ComfyUI-Manager to work. It is recommended to download Portable Git and explicitly set its path in your .bat launcher before starting ComfyUI:

set GIT_PYTHON_GIT_EXECUTABLE=C:\path\to\portable-git\bin\git.exe

After installing the extension via the Manager, make sure that the installed dependencies match the versions specified in ComfyUI\custom_nodes\comfyui-openvino\requirements.txt.

It is always considered good practice, after installing (or updating) the ComfyUI-OpenVINO extension, to run

.\python_embeded\python.exe -m pip install -r ComfyUI\custom_nodes\comfyui-openvino\requirements.txt

to ensure that all required dependencies are installed.

---

3. RuntimeError: Compiler: 'cl' is not found at higher resolutions — how to fix?

At low resolutions (e.g. 512x512) the extension works fine. At higher resolutions, PyTorch's inductor triggers a JIT C++ compilation step that requires MSVC (cl.exe).

Fix: Install Visual Studio (Community edition is sufficient) or the standalone MSVC Build Tools. During installation, make sure to select the "Desktop development with C++" workload — this is what actually installs cl.exe and the required C++ components. Then activate the MSVC environment in your .bat launcher before starting ComfyUI:

call "C:\Program Files\Microsoft Visual Studio\18\Community\VC\Auxiliary\Build\vcvars64.bat"

Adjust the path to match your Visual Studio version and edition.

---

4. C++ compile error due to a space in the torchinductor cache folder name — how to fix?

If your Windows display name (Full Name) contains a space (e.g. John Doe), PyTorch will create a temp folder like:

C:\Users\John\AppData\Local\Temp\torchinductor_John Doe

The space in the path breaks the MSVC compiler.

Fix: Override USERNAME in your .bat launcher before starting ComfyUI:

set USERNAME=User

This only affects the current session and does not change your Windows account. After this, PyTorch will create the temp folder as:

C:\Users\John\AppData\Local\Temp\torchinductor_User

If your Windows account folder name (e.g. C:\Users\John Doe\) also contains a space, overriding USERNAME alone is not enough — the temp path will still be broken. In that case, redirect the temp directory to a path without spaces:

set TEMP=C:\tmp
set TMP=C:\tmp

Make sure the folder C:\tmp exists before launching ComfyUI.

---

5. python_embeded is missing Python headers/libraries for C++ compilation — how to fix?

Portable ComfyUI uses a stripped-down embedded Python that is missing the include and libs directories required for C++ compilation.

Fix:

1. Download the full Python installer for the same version as your python_embeded.
2. Copy the include and libs folders from the full Python installation into your ComfyUI_windows_portable\python_embeded\ directory.

After this, cl.exe will be able to compile successfully.

📄 Example run_cpu.bat with all fixes applied

call "C:\Program Files\Microsoft Visual Studio\18\Community\VC\Auxiliary\Build\vcvars64.bat"
set USERNAME=User
set GIT_PYTHON_GIT_EXECUTABLE=C:\Users\John\ComfyUI_windows_portable\git\bin\git.exe
.\python_embeded\python.exe -s ComfyUI\main.py --cpu --windows-standalone-build --enable-manager --use-pytorch-cross-attention
pause