Skip to content

feat: add deepspeed template#370

Merged
Marvin-Cypher merged 1 commit into
Phala-Network:mainfrom
phala-agent:feat/template-deepspeed
May 27, 2026
Merged

feat: add deepspeed template#370
Marvin-Cypher merged 1 commit into
Phala-Network:mainfrom
phala-agent:feat/template-deepspeed

Conversation

@phala-agent
Copy link
Copy Markdown
Contributor

Summary

  • Add a deepspeed prebuilt template for deepspeedai/DeepSpeed.
  • Provide a CPU-safe HTTP source/runtime verifier on port 8080 with /healthz, /demo, and /v1/models.
  • Add a local DeepSpeed icon sourced from upstream docs/assets/images/DeepSpeed_light.svg.

Upstream

Template files

  • templates/prebuilt/deepspeed/docker-compose.yml
  • templates/prebuilt/deepspeed/README.md
  • templates/icons/deepspeed.svg
  • templates/config.json

Environment variables

  • DEEPSPEED_SOURCE_REF (optional, default v0.19.1): public DeepSpeed Git tag, branch, or commit used for source verification.

No credentials are required by the default template. It does not import DeepSpeed/Torch, download model weights, run training/inference, require CUDA/GPU, use host bind mounts, use env_file, or use privileged/host networking features.

Validation

  • python3 templates/validate.py
  • git diff --check origin/main...HEAD
  • docker compose -f templates/prebuilt/deepspeed/docker-compose.yml config >/dev/null
  • Static audit ✅
    • README deploy/use/verification coverage present
    • deepspeed config id unique
    • local icon file exists and is referenced
    • config repo routes to https://github.com/Phala-Network/phala-cloud/tree/main/templates/prebuilt/deepspeed
    • compose has no host bind mounts, env_file, external build context, real secrets, privileged mode, host networking, or Docker socket

Deployment smoke

  • Profile/workspace: hermes-admin-cvm-check / h4x's projects
  • Deploy command shape: phala deploy --profile hermes-admin-cvm-check --name auto-template-test-deepspeed-0527-165859 --compose sdks/templates/prebuilt/deepspeed/docker-compose.yml --instance-type tdx.small --wait --no-public-logs --no-public-sysinfo --json
  • CVM UUID: de0aaa18-d5c3-4133-b9ef-f57e163c285d
  • App ID: a8ec91688bfde3532c5669e0a20cbc66106619f9
  • phala ps: one expected container running and healthy (Up 30 seconds (healthy)) ✅
  • HTTP endpoint: https://a8ec91688bfde3532c5669e0a20cbc66106619f9-8080.dstack-pha-prod7.phala.network
    • /healthz: HTTP 200, service=deepspeed-source-verifier, ok=true, status=ready
    • /demo: HTTP 200, 7 files checked, 4 Python files compiled ✅
    • /v1/models: HTTP 200, OpenAI-compatible list shape with empty data

Cleanup

  • Temporary smoke CVM deletion requested with phala cvms delete --force
  • Post-delete lookup returned The requested CVM was not found, treated as cleanup verified ✅

cc @Marvin-Cypher for review.

@phala-agent
Copy link
Copy Markdown
Contributor Author

cc @Marvin-Cypher for review.

Formal reviewer request failed in the scheduled template factory run; please review this template PR when available.

@Marvin-Cypher Marvin-Cypher force-pushed the feat/template-deepspeed branch from 373e724 to ab75cd5 Compare May 27, 2026 17:34
Copy link
Copy Markdown
Contributor

@Marvin-Cypher Marvin-Cypher left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed template files, normalized tags, compose config, config validation, stale path cleanup, and compose safety scan. Checks are passing.

@Marvin-Cypher Marvin-Cypher merged commit 5bde511 into Phala-Network:main May 27, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants