Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-7900][VL] Enable prefix sort in spill #7904

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

jinchengchenghh
Copy link
Contributor

@jinchengchenghh jinchengchenghh commented Nov 12, 2024

Relevant Velox PR: facebookincubator/velox#11384
Resolves #7900

@github-actions github-actions bot added the VELOX label Nov 12, 2024
Copy link

#7900

@zhztheplayer zhztheplayer changed the title [GLUTEN-7900] [VL] Enable prefix sort in spill [GLUTEN-7900][VL] Enable prefix sort in spill Nov 12, 2024
@zhztheplayer
Copy link
Member

zhztheplayer commented Nov 12, 2024

Would you like to refer the related Velox PRs for this feature in PR description? Which will help users to track. Thanks.

I'm also thinking about setting up a more comprehensive integration benchmark for spill performance.

The following is by the existing GHA oom tests:

Before:

image

After:

image

@jinchengchenghh
Copy link
Contributor Author

We have a spill performance in internal Jenkins, I have trigger it. It will run after machine is ready since serves down today.

@FelixYBW
Copy link
Contributor

Let's put the jenkins performance here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[VL] Enable prefix sort in velox spill by config
3 participants