-
Notifications
You must be signed in to change notification settings - Fork 2.4k
Add --gpu (or similar) flag to nemoclaw onboard #1751
Copy link
Copy link
Open
Labels
NemoClaw CLIUse this label to identify issues with the NemoClaw command-line interface (CLI).Use this label to identify issues with the NemoClaw command-line interface (CLI).OpenShellSupport for OpenShell, a safe, private runtime for autonomous AI agentsSupport for OpenShell, a safe, private runtime for autonomous AI agentsPlatform: DGX SparkSupport for DGX SparkSupport for DGX SparkbugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or request
Metadata
Metadata
Assignees
Labels
NemoClaw CLIUse this label to identify issues with the NemoClaw command-line interface (CLI).Use this label to identify issues with the NemoClaw command-line interface (CLI).OpenShellSupport for OpenShell, a safe, private runtime for autonomous AI agentsSupport for OpenShell, a safe, private runtime for autonomous AI agentsPlatform: DGX SparkSupport for DGX SparkSupport for DGX SparkbugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or request
Problem Statement
Problem
nemoclaw onboardomits--gpuon bothopenshell gateway startandopenshell sandbox create. The source comments inbin/lib/onboard.jsexplain the reasoning:This is correct for the typical use case. However, there are use cases where the agent's task (not its inference) requires GPU access inside the sandbox — for example, running GPU-accelerated numerical computations, scientific simulations, or matrix operations as part of an autonomous workflow.
In these cases, the agent needs both:
onboardonboardProposed Design
Request
CLI change — accept
--gpuinbin/nemoclaw.js. As far as I know, the existing--gpuhandling inopenshell gateway startandopenshell sandbox createdoes the heavy lifting (NVIDIA device plugin, k8s resource requests). No changes needed to the Dockerfile, blueprint, or policies.Usage
Behaves identically to
nemoclaw onboardexcept the gateway and sandbox are created with GPU passthrough enabled. Requires NVIDIA drivers and the NVIDIA Container Toolkit on the host (same prereqs asopenshell gateway start --gpu).Alternatives Considered
Current workaround
After a successful
nemoclaw onboard, I managed to find a workaround at the expenses of having to tear down and rebuild whatonboardjust created:openshell gateway stop --gateway nemoclawopenshell gateway start --gateway nemoclaw --gpu --recreateopenshell sandbox delete <name>openshell sandbox create --from <Dockerfile> --gpu --policy <base-policy>openshell provider create(provider config lost with gateway recreate)openshell inference set(inference route lost with gateway recreate)This requires knowledge of nemoclaw internals and is fragile across versions. It is also surely not the best solution since I'm not an openshell expert.
Category
enhancement: feature
Checklist