This repository was archived by the owner on Nov 20, 2024. It is now read-only.
This repository was archived by the owner on Nov 20, 2024. It is now read-only.
Pod keeps restarting when two containers share GPU #29
Description
I am trying to run Nvidia-triton containers for model inferencing, however when more than 1 container is allocated to the same node, one of the container 1) Either fails to load the model onto the GPU. 2) Keep on restarting.
Any suggestions on how this can be solved?