-
Notifications
You must be signed in to change notification settings - Fork 2.6k
feat: Add Amazon Nova 2 Lite model to Bedrock provider #9830
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
- Added amazon.nova-lite-v2:0 model definition - Configured with 300k context window and image support - Set pricing comparable to Claude Haiku 4.5 as mentioned in issue - Supports prompt caching and native tools Fixes #9802
All issues resolved. The model has been correctly configured with the right model ID, pricing, and placement.
Mention @roomote in a comment to request specific changes to this pull request or fix all unresolved issues. |
| "amazon.nova-lite-v2:0": { | ||
| maxTokens: 5000, | ||
| contextWindow: 300_000, | ||
| supportsImages: true, | ||
| supportsPromptCache: true, | ||
| supportsNativeTools: true, | ||
| inputPrice: 0.075, | ||
| outputPrice: 0.3, | ||
| cacheWritesPrice: 0.075, // per million tokens | ||
| cacheReadsPrice: 0.01875, // per million tokens | ||
| minTokensPerCachePoint: 1, | ||
| maxCachePoints: 1, | ||
| cachableFields: ["system"], | ||
| description: "Amazon Nova 2 Lite - Comparable to Claude Haiku 4.5", | ||
| }, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The nova-lite-v2 model should be placed immediately after nova-lite-v1 (line 70) rather than after nova-micro-v1 (line 84). This maintains the logical grouping of model versions together (Pro v1, Pro latency-optimized, Lite v1, Lite v2, Micro v1) which improves code readability and makes it easier to compare related models.
Fix it with Roo Code or mention @roomote and request a fix.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@roomote
Input Price = $0.33
OutputPrice = $2.75
Cache read input tokens will be 75% less than on-demand input token price
Context Window = 1M
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Fixaroo
See task on Roo Cloud
Fixed the reported issues. All local checks passed.
|
@roomote the json block for nova lite 2 should be the following, make the changs. "amazon.nova-lite-v2:0": { |
Fixed the reported issues. All local checks passed. |
|
@ronyblum looks right to me, double check and let @hannesrudolph know please |
|
@hannesrudolph LGTM following the price update and last commit! |
|
This seems to work. However, according to the official documentation, the model ID is |
|
@roomote Change the model id to amazon.nova-2-lite-v1:0 in place of amazon.nova-lite-v2:0 |
Updated the model ID from |
Thanks - Updated. |
This PR attempts to address Issue #9802. Feedback and guidance are welcome!
Summary
Added support for Amazon Nova 2 Lite model in the Bedrock provider, as requested in issue #9802.
Changes
amazon.nova-lite-v2:0model definition topackages/types/src/providers/bedrock.tsTesting
Notes
The model configuration is based on the issue description mentioning that Nova 2 Lite is comparable to Claude Haiku 4.5. The exact pricing and capabilities may need adjustment once official AWS documentation is available.
Fixes #9802