How to get coopmat2 working in Vulkan, (Nvidia RTX, Ubuntu) ? #12548
-
|
So I was trying out the benchmark on the Vulkan release version and I got matrix cores: KHR_coopmat, thinking my driver and vulkan version might be the issue I updated to the latest versions available on Ubuntu 24.04.2, namely nvidia-driver-570-server (proprietary) and Vulkan Instance Version: 1.4.309 nvidia-smi shows Driver Version: 570.86.15 CUDA Version: 12.8 ./llama-bench -m models/llama2 -ngl 100 -fa 1 Do I have to compile llama.cpp with some flag to enable coopmat2 ? Do I have to manually install the "Latest Production Branch Version:[ 570.133.07]" of Nvidia's driver? (https://www.nvidia.com/en-us/drivers/details/242273/) |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
|
At this point you still need an Nvidia Vulkan Developer Beta Driver (https://developer.nvidia.com/vulkan-driver). You also need to compile with glslc and headers that are new enough to have the extension, which should be the case with the latest SDK release if I remember correctly. |
Beta Was this translation helpful? Give feedback.
-
|
thanks, I think I'll wait for the 575 release, lest I break something |
Beta Was this translation helpful? Give feedback.
At this point you still need an Nvidia Vulkan Developer Beta Driver (https://developer.nvidia.com/vulkan-driver). You also need to compile with glslc and headers that are new enough to have the extension, which should be the case with the latest SDK release if I remember correctly.