Title: Add documentation website for Llama Stack Kubernetes operator #56

zanetworker · 2025-06-11T14:54:35Z

Description:
This PR introduces a documentation website for the Llama Stack Kubernetes operator. The documentation includes the operator functionality, API references, distro docs, etc.

github-advanced-security · 2025-06-11T14:57:18Z

This pull request sets up GitHub code scanning for this repository. Once the scans have completed and the checks have passed, the analysis results for this pull request branch will appear on this overview. Once you merge this pull request, the 'Security' tab will show more code scanning analysis results (for example, for the default branch). Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results. For more information about GitHub code scanning, check out the documentation.

mergify · 2025-06-12T15:31:25Z

This pull request has merge conflicts that must be resolved before it can be merged. @zanetworker please rebase it. https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

VaishnaviHire · 2025-09-03T15:08:48Z

This looks like a good base. We can open follow-up PRs for updates.

/lgtm

VaishnaviHire · 2025-09-03T15:12:20Z

docs/content/contributing/development.md

+
+### Prerequisites
+
+- Go 1.21+


We have updated the version to 1.24

VaishnaviHire · 2025-10-28T15:29:28Z

@mergify rebase

mergify · 2025-10-28T15:29:38Z

rebase

☑️ Nothing to do, the required conditions are not met

-conflict [📌 rebase requirement]
-closed [📌 rebase requirement]
queue-position = -1 [📌 rebase requirement]
any of:
- #commits > 1 [📌 rebase requirement]
- #commits-behind > 0 [📌 rebase requirement]
- -linear-history [📌 rebase requirement]

VaishnaviHire · 2025-10-28T15:32:52Z

@zanetworker Can you update the conflict , and we can merge this

Signed-off-by: Adel Zaalouk <[email protected]>

- Created detailed vLLM distribution guide with GPU/CPU variants, configuration examples, and best practices - Created comprehensive Ollama distribution guide with model management, API usage, and troubleshooting - Added new 'Distributions' section to navigation with dedicated pages for each distribution type - Includes production and development examples, resource planning, and scaling strategies - Clearly distinguishes supported distributions from BYO (bring-your-own) custom image approaches Signed-off-by: Adel Zaalouk <[email protected]>

zanetworker · 2025-11-01T18:02:50Z

@VaishnaviHire updated the docs. It looks like this now: https://llama-stack-k8s-operator.pages.dev/ Also after merging we probably need to setup cloudflare tokens on the repo to automated the publish of the doc (that is currently setup on my fork)

derekhiggins

Thanks but there is a lot of docs in this PR, all of which would need to be verified and tested before approving, maybe we should start smaller and build more manageable chunks in separate PR's ?

derekhiggins · 2025-11-03T09:17:40Z

docs/content/examples/basic-deployment.md

+      env:
+      - name: LOG_LEVEL
+        value: "info"
+      - name: LLAMASTACK_PORT


Is this a thing? I can see it mentioned in the watsonx provider but I'm not sure it used anywhere

derekhiggins · 2025-11-03T09:32:15Z

docs/content/getting-started/installation.md

+The fastest way to install the operator is using the pre-built manifests:
+
+```bash
+kubectl apply -f https://github.com/llamastack/llama-stack-k8s-operator/releases/latest/download/operator.yaml


(base) derekh@laptop:~/workarea/llama-stack-k8s-operator$ kubectl apply -f https://github.com/llamastack/llama-stack-k8s-operator/releases/latest/download/operator.yaml error: unable to read URL "https://github.com/llamastack/llama-stack-k8s-operator/releases/latest/download/operator.yaml", server reported 404 Not Found, status code=404

derekhiggins · 2025-11-03T09:33:20Z

docs/content/getting-started/installation.md

+
+```bash
+# Add the Helm repository
+helm repo add llamastack https://llamastack.github.io/helm-charts


(base) derekh@laptop:~/workarea/llama-stack-k8s-operator$ helm repo add llamastack https://llamastack.github.io/helm-charts Error: looks like "https://llamastack.github.io/helm-charts" is not a valid chart repository or cannot be reached: failed to fetch https://llamastack.github.io/helm-charts/index.yaml : 404 Not Found

derekhiggins · 2025-11-03T09:36:04Z

docs/content/getting-started/installation.md

+
+```bash
+# Check operator deployment
+kubectl get deployment -n llamastack-operator-system


(base) derekh@laptop:~/workarea/llama-stack-k8s-operator$ kubectl get deployment -n llamastack-operator-system No resources found in llamastack-operator-system namespace.

should be

(base) derekh@laptop:~/workarea/llama-stack-k8s-operator$ kubectl get -n llama-stack-k8s-operator-system deployment/llama-stack-k8s-operator-controller-manager NAME READY UP-TO-DATE AVAILABLE AGE llama-stack-k8s-operator-controller-manager 1/1 1 1 87s

derekhiggins · 2025-11-03T09:37:57Z

docs/content/getting-started/installation.md

+cd llama-stack-k8s-operator
+
+# Install using Kustomize
+kubectl apply -k config/default


this worked for me, the comments below are based on this having been run

derekhiggins · 2025-11-03T09:46:16Z

docs/content/distributions/bedrock.md

+  replicas: 1
+  server:
+    distribution:
+      name: "bedrock"


This and a bunch of other distributions arn't built any longer, we shouldn't be documenting them and should probably remove them from distributions.json

derekhiggins · 2025-11-03T09:48:32Z

docs/content/examples/basic-deployment.md

+
+2. **Apply the configuration**:
+   ```bash
+   kubectl apply -f basic-deployment.yaml


distro doesn't start

(base) derekh@laptop:~/workarea/llama-stack-k8s-operator$ oc get pod/basic-llamastack-5867bd5865-z8v77 NAME READY STATUS RESTARTS AGE basic-llamastack-5867bd5865-z8v77 0/1 Error 5 (87s ago) 5m1s (base) derekh@laptop:~/workarea/llama-stack-k8s-operator$ oc logs pod/basic-llamastack-5867bd5865-z8v77 Traceback (most recent call last): File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/server.py", line 597, in <module> main() File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/server/server.py", line 422, in main config = replace_env_vars(config_contents) File "/usr/local/lib/python3.10/site-packages/llama_stack/distribution/stack.py", line 131, in replace_env_vars raise EnvVarError(e.var_name, e.path) from None llama_stack.distribution.stack.EnvVarError: Environment variable 'INFERENCE_MODEL' not set or empty at models[0].model_id

zanetworker force-pushed the main branch from 34b30de to de03e64 Compare June 11, 2025 14:56

mergify bot added the needs-rebase label Jun 12, 2025

zanetworker force-pushed the main branch from de03e64 to 505c006 Compare June 19, 2025 13:08

mergify bot removed the needs-rebase label Jun 19, 2025

zanetworker marked this pull request as ready for review June 20, 2025 10:09

zanetworker force-pushed the main branch from 505c006 to b32da6f Compare July 2, 2025 08:12

zanetworker force-pushed the main branch from 07859b5 to 97fc27b Compare September 3, 2025 14:57

VaishnaviHire approved these changes Sep 3, 2025

View reviewed changes

VaishnaviHire reviewed Sep 3, 2025

View reviewed changes

docs/content/contributing/development.md Outdated

### Prerequisites

- Go 1.21+

Copy link

Collaborator

VaishnaviHire Sep 3, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We have updated the version to 1.24

zanetworker added 2 commits November 1, 2025 16:40

add docs

b1a64e7

Signed-off-by: Adel Zaalouk <[email protected]>

docs: add supported distribution types and fix workflow issues

fdafb84

Signed-off-by: Adel Zaalouk <[email protected]>

zanetworker force-pushed the main branch from 97fc27b to b367c77 Compare November 1, 2025 15:46

zanetworker requested review from cdoern, derekhiggins, leseb, mfleader, nathan-weinberg, rhdedgar and rhuss as code owners November 1, 2025 15:46

zanetworker force-pushed the main branch 2 times, most recently from 3ac20d3 to 55f22ae Compare November 1, 2025 15:54

zanetworker force-pushed the main branch from 55f22ae to c072894 Compare November 1, 2025 17:59

derekhiggins requested changes Nov 3, 2025

View reviewed changes

Title: Add documentation website for Llama Stack Kubernetes operator #56

Are you sure you want to change the base?

Title: Add documentation website for Llama Stack Kubernetes operator #56

Uh oh!

Conversation

zanetworker commented Jun 11, 2025

Uh oh!

github-advanced-security bot commented Jun 11, 2025

Uh oh!

mergify bot commented Jun 12, 2025

Uh oh!

VaishnaviHire commented Sep 3, 2025

Uh oh!

Choose a reason for hiding this comment

Uh oh!

VaishnaviHire commented Oct 28, 2025

Uh oh!

mergify bot commented Oct 28, 2025

☑️ Nothing to do, the required conditions are not met

Uh oh!

VaishnaviHire commented Oct 28, 2025

Uh oh!

zanetworker commented Nov 1, 2025

Uh oh!

derekhiggins left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants