Skip to content

feat: add crawl4ai template#362

Merged
Marvin-Cypher merged 1 commit into
Phala-Network:mainfrom
phala-agent:feat/template-crawl4ai
May 27, 2026
Merged

feat: add crawl4ai template#362
Marvin-Cypher merged 1 commit into
Phala-Network:mainfrom
phala-agent:feat/template-crawl4ai

Conversation

@phala-agent
Copy link
Copy Markdown
Contributor

Summary

  • Add a Phala Cloud prebuilt template for unclecode/crawl4ai.
  • Use a CPU-safe HTTP smoke demo that installs/imports the real Crawl4AI==0.8.6 Python package and converts bundled HTML to Markdown without browser launches, model downloads, hosted-provider calls, or GPU.
  • Add upstream favicon icon at templates/icons/crawl4ai.png.

Upstream

Template files

  • templates/prebuilt/crawl4ai/docker-compose.yml
  • templates/prebuilt/crawl4ai/README.md
  • templates/icons/crawl4ai.png
  • templates/config.json

Config/env

Validation

  • python3 sdks/templates/validate.py
  • git -C sdks diff --check origin/main...HEAD
  • docker compose -f sdks/templates/prebuilt/crawl4ai/docker-compose.yml config >/dev/null
  • Static audit for README coverage, config ID uniqueness, icon presence, no host bind mounts, no env_file, no external build context, and no literal secrets ✅

Phala Cloud smoke

  • Deploy command used profile hermes-admin-cvm-check, tdx.small, --wait, --no-public-logs, and --no-public-sysinfo.
  • Deployment: auto-template-test-crawl4ai-0527-081053
  • CVM: cvm_YKRanXea
  • VM UUID: 726d4fb8-82fa-4c78-ab88-c181547b02a5
  • App ID: 07b2e2680ea87163bb6d138378b541e256442721
  • phala ps showed /dstack-app-1 running and healthy.
  • HTTP smoke passed:
    • GET /healthz -> 200, import_ok=true, demo_ok=true, version 0.8.6
    • GET /demo -> 200, reports no browser/network/provider/model use
    • GET /v1/models -> 200, includes crawl4ai/local-markdown-demo

Cleanup

  • Temporary smoke CVM deletion was requested with phala cvms delete --force.
  • Follow-up lookup returned The requested CVM was not found, so cleanup is verified.

cc @Marvin-Cypher for review.

@phala-agent
Copy link
Copy Markdown
Contributor Author

cc @Marvin-Cypher for review.

@Marvin-Cypher Marvin-Cypher force-pushed the feat/template-crawl4ai branch from 246a34e to 471c622 Compare May 27, 2026 17:33
Copy link
Copy Markdown
Contributor

@Marvin-Cypher Marvin-Cypher left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed template files, normalized tags, compose config, config validation, stale path cleanup, and compose safety scan. Checks are passing.

@Marvin-Cypher Marvin-Cypher merged commit 3d19a66 into Phala-Network:main May 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants