Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expose LiteLLM model ID #3632

Open
MadsRC opened this issue Mar 25, 2025 · 1 comment
Open

Expose LiteLLM model ID #3632

MadsRC opened this issue Mar 25, 2025 · 1 comment
Labels
question Further information is requested

Comments

@MadsRC
Copy link

MadsRC commented Mar 25, 2025

Issue

When trying to configureAider to use Bedrock, I would like to be able to instruct LiteLLM to use an Application Inference Profile for the specified model. According to the docs this is done by specifying the model_id when creating a completion.

Looking at the Aider documentation, I would expect to find something about setting this value for a specific model here but I haven't been able to track it down there or anywhere else in the documentation.

Version and model info

No response

@paul-gauthier
Copy link
Collaborator

Thanks for trying aider and filing this issue.

I have updated these docs to be a bit more clear that you can pass any params you want to litellm.completions using the extra_params setting.

https://aider.chat/docs/config/adv-model-settings.html#passing-extra-params-to-litellmcompletion

@github-actions github-actions bot added the question Further information is requested label Mar 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants