Skip to content

Restrict the priority of ShardSnapshotTask to the same snapshot only #89976

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

pxsalehi
Copy link
Member

@pxsalehi pxsalehi commented Sep 9, 2022

Give shard snapshot metadata work priority over file snapshot work ONLY within the same snapshot. After some discussion with Armin and some benchmarks, this seems to prevent many overlapping snapshots prolonging each other due to constant prioritization of snapshot metadata work.

@pxsalehi pxsalehi added >enhancement :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs labels Sep 9, 2022
@elasticsearchmachine elasticsearchmachine added Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v8.5.0 labels Sep 9, 2022
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@elasticsearchmachine
Copy link
Collaborator

Hi @pxsalehi, I've created a changelog YAML for you.

Copy link
Member

@original-brownbear original-brownbear left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM this benchmarks far superior to the previous order of operations. Lets remove the changelog entry and make it a non-issue though since its on top of unreleased work.

@pxsalehi
Copy link
Member Author

CI failure was due to #89776 and unrelated.

@pxsalehi
Copy link
Member Author

@elasticmachine update branch

@elasticmachine
Copy link
Collaborator

merge conflict between base and head

…com:pxsalehi/elasticsearch into ps-220909-alternative-compare-shardSnapshot
@pxsalehi
Copy link
Member Author

@elasticmachine run elasticsearch-ci/bwc
(#89994)

@pxsalehi pxsalehi merged commit 2c39201 into elastic:main Sep 12, 2022
@pxsalehi
Copy link
Member Author

Thanks, Armin!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs >non-issue Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v8.5.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants