-
Notifications
You must be signed in to change notification settings - Fork 57
Add lemonade-sdk as pip dependency #213
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Root cause: DEFAULT_MODEL_NAME was Qwen2.5-0.5B-Instruct-CPU (ONNX model) which requires onnxruntime-genai package. We don't want to add more dependencies, so switch to Qwen3-0.6B-GGUF which uses llamacpp backend (built into lemonade-sdk, no extra deps needed). This fixes the 422 errors where server tried to auto-load the ONNX model when tests requested DEFAULT_MODEL_NAME, but onnxruntime-genai wasn't installed. Co-Authored-By: Claude Sonnet 4.5 (1M context) <noreply@anthropic.com>
- Update all workflows to use Qwen3-4B-Instruct-2507-GGUF as default model - Fix summarizer tests by running in same step as Lemonade server - Switch test_gaia_cli_windows.yml to PowerShell for better process handling - Improve start-lemonade.bat error handling and server health checks - Simplify workflow structure and debug output
|
@claude review this PR. |
|
Claude finished @kovtcharov's task —— View job PR Review: Add lemonade-sdk as pip dependency
SummaryThis PR makes significant improvements to how Lemonade Server is installed and managed across GAIA. The shift from a custom GitHub Action to a pip-based installation is a solid architectural decision that improves maintainability. Review Findings🟢 Strengths1. Clean Version Management (
2. Well-Documented Scripts (
3. Simplified CI Workflows
4. Comprehensive Documentation (
🟡 Suggestions (Non-blocking)1. Test File Placement (
2. Model Consistency
3. Script Hardcoded Paths
🔴 Potential Issues1. Root Cause of CI Failures
Recommendation: Verify that "lemonade": [
f"lemonade-sdk>={lemonade_version}",
# Add if needed:
# "onnxruntime-directml", # Windows DirectML
# "vulkan-sdk", # Vulkan backend
],2. Missing Cleanup in Start Scripts Overall AssessmentApproved with suggestions. The architectural changes are solid, documentation is comprehensive, and the code quality is good. The CI failures should be investigated separately as they appear to be related to runtime dependencies on the self-hosted runners rather than issues with this PR's code. |
…into kalin/lemonade-package
All 3 startup scripts now retry the health check up to 10 times (2-second intervals) after model pull to handle server restarts. Fixes race condition where server appears dead during restart.
Add encoding="utf-8" and errors="replace" to all subprocess.run() calls to prevent UnicodeDecodeError on Windows with cp1252 codec.
|
@claude review the documentation updates for any discrepancies. |
|
Claude finished @kovtcharov's task —— View job Documentation Review: lemonade-sdk pip dependency
SummaryThe documentation updates are well-structured and consistent with the code changes. Found 1 discrepancy and several minor suggestions. 🔴 Discrepancy Found
The dev guide shows: uv pip install -e ".[dev]"
# Or with all extras:
uv pip install -e ".[dev,talk,rag]"But it should include uv pip install -e ".[dev,lemonade]"
# Or with all extras:
uv pip install -e ".[dev,lemonade,talk,rag]"The 🟢 Verified Consistency
🟡 Suggestions (Non-blocking)
|
Set CtxSize/CTX_SIZE to 32768 in all lemonade startup scripts and CI workflows to meet Agent base class min_context_size requirement. The health endpoint may not always return context_size, causing it to default to 0 in the client.
- Add inline health check in lemonade server smoke test workflow - Add standalone test_lemonade_health.py for context_size validation - Will help identify if lemonade-sdk pip package differs from installer
Summary
lemonade-sdkas an optional pip dependency (pip install "amd-gaia[lemonade]")install-lemonadeGitHub Action in favor of pip installationLEMONADE_VERSIONinsrc/gaia/version.pysjlab-stx-2Changes
lemonadeextra with dynamic version fromversion.py[lemonade]extra instead of custom action.github/actions/install-lemonade/directoryTest plan
pip install "amd-gaia[lemonade]"installs lemonade-sdklemonade-servercommand is available after installationRelated Issues