Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please add settings for RPM, RPD and TPM, TPD #3646

Open
Emasoft opened this issue Mar 26, 2025 · 1 comment
Open

Please add settings for RPM, RPD and TPM, TPD #3646

Emasoft opened this issue Mar 26, 2025 · 1 comment

Comments

@Emasoft
Copy link

Emasoft commented Mar 26, 2025

Many models and llm services require to limit the requests per minutes or per day.
Aider should slow down and await to send requests if the rate limit has been already reached.
Slowing down Aider requests rate is a good compromise, especially for those free services like Gemini 2.5 Pro, or the many free tier services from openrouter.
Currently I'm getting banned because of some service limiting the RPM to 2, while it could have been avoided if aider accepted RPM, RPD and TPM, TPD as parameters and automatically slow down accordingly.

@Maivand
Copy link

Maivand commented Mar 27, 2025

I agree, some parameters for that would be very useable, especially for testing new models that are limited.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants