perf(server): reuse provider catalog responses within instance lifecycle - #47758
perf(server): reuse provider catalog responses within instance lifecycle#47758pirate wants to merge 1 commit into
Conversation
|
Hey! Your PR title Please update it to start with one of:
Where See CONTRIBUTING.md for details. |
|
This PR doesn't fully meet our contributing guidelines and PR template. What needs to be fixed:
Please edit this PR description to address the above within 2 hours, or it will be automatically closed. If you believe this was flagged incorrectly, please let a maintainer know. |
|
The following comment was made by an LLM, it may be inaccurate: Based on the search results, I found one potentially related PR: Related PR:
The other results (#46789, #45822) are about provider/catalog management but address different concerns (workspace release and registry changes) rather than response caching. |
|
This pull request has been automatically closed because it was not updated to meet our contributing guidelines within the 2-hour window. Feel free to open a new pull request that follows our guidelines. |
What does this PR do?
Avoid rebuilding and re-encoding the full provider catalog on every GET /provider. Reuse the encoded response inside the existing instance lifecycle, keyed by the ModelsDev catalog identity and connected credential IDs. Configuration disposal, catalog refresh, and provider connections invalidate it naturally. No timers or new cache service.
How did you verify your code works?
AI-assisted implementation and testing.
Checklist