Skip to content

feat(modelartifacts): bound Hugging Face file downloads - #11298

Open
localai-org-maint-bot wants to merge 1 commit into
masterfrom
cron/issue-11114-bounded-hf-downloads
Open

feat(modelartifacts): bound Hugging Face file downloads#11298
localai-org-maint-bot wants to merge 1 commit into
masterfrom
cron/issue-11114-bounded-hf-downloads

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Summary

  • add opt-in bounded concurrency for independent artifact file downloads while keeping the default at 1
  • cancel sibling transfers on the first download or verification failure and synchronize aggregate progress bookkeeping
  • preserve deterministic manifest ordering, resumable partials, and SHA verification
  • expose --artifact-download-concurrency / LOCALAI_ARTIFACT_DOWNLOAD_CONCURRENCY in server and models-install flows
  • document conservative tuning guidance

Verification

  • go test ./pkg/downloader -ginkgo.focus="DownloadFilesWithContext"
  • go test ./pkg/modelartifacts
  • go test -race ./pkg/downloader -ginkgo.focus="DownloadFilesWithContext"
  • go test -race ./pkg/modelartifacts
  • independent task review: PASS

Full pkg/downloader has three pre-existing tests that require blocked raw.githubusercontent.com access in this environment. core/cli compilation is also environment-blocked by unavailable Go proxy inputs and a missing generated React embed; the CLI changes are limited to Kong flag fields and manager-option wiring.

Closes #11114

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat(modelartifacts): support bounded parallel Hugging Face file downloads

1 participant