Skip to content

feat(asr): support Parakeet Unified RNN-T - #3821

Open
Zbig9000 wants to merge 3 commits into
tetherto:mainfrom
Zbig9000:feat-asr-parakeet-unified
Open

feat(asr): support Parakeet Unified RNN-T#3821
Zbig9000 wants to merge 3 commits into
tetherto:mainfrom
Zbig9000:feat-asr-parakeet-unified

Conversation

@Zbig9000

@Zbig9000 Zbig9000 commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add Parakeet Unified model tooling, registry metadata, examples, and package documentation
  • recognize native rnnt GGUF metadata and route it through the normal ASR path
  • require speech-cpp 2026-08-13 and mirror existing Parakeet CPU, GPU, mobile performance, and benchmark coverage
  • pin F16, Q8_0, and Q4_0 model integrity metadata

Dependencies:

Test plan

  • Convert the NVIDIA checkpoint to F16, Q8_0, and Q4_0 with embedded tokenizer metadata
  • Verify exact CPU/Vulkan transcript parity for every quantization
  • Run ASR model tooling tests after merging current main (26/26)
  • Run Parakeet manifest validation (175 assertions)
  • Run ASR performance aggregation tests (29/29)
  • Validate production registry JSON (779 models)
  • Run focused addon C++ model-type tests
  • Publish all three GGUFs to the pinned model registry paths
  • Run model-backed desktop and mobile CI

Blockers

  • Local AWS tooling and MODEL_S3_BUCKET are unavailable, so the GGUFs are converted and hashed but not uploaded.
  • Registry license verification requires HF_TOKEN, which is unavailable locally.

Expose the Unified checkpoint through model tooling and registry metadata while preserving the existing Parakeet CPU, GPU, mobile, and benchmark coverage contract.
Keep workflow policy expectations synchronized, preserve distinct benchmark configurations, and refresh converter provenance.
…nified

# Conflicts:
#	.github/workflows/benchmark-asr-ggml.yml
#	packages/asr-ggml/benchmarks/client/README.md
#	packages/asr-ggml/benchmarks/server/src/validation/index.js
#	packages/asr-ggml/scripts/trigger-benchmark.sh
@github-actions

Copy link
Copy Markdown
Contributor

Review Status

Current Status: ❌ PENDING
Approvals so far: none

Pending reviews: Needs 1 Management or Team Lead, and 1 more from Management, Team Lead, or Member.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant