Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Support "consecutive=true" argument in dedup command with Calcite #3438

Open
LantaoJin opened this issue Mar 17, 2025 · 0 comments
Labels
calcite calcite migration releated enhancement New feature or request untriaged

Comments

@LantaoJin
Copy link
Member

Is your feature request related to a problem?
Currently, we implements dedup by row number window function. The argument "consecutive=true" required the input data forced with certain ordering.
For example, only following ppl have business meaning.
source=t | sort timestamp | dedup 2 col1 consecutive=true
or
source=t | dedup 2 col1 consecutive=true sort by timestamp

query without sorting, such as
source=t | dedup 2 col1 consecutive=true
should throw exception "dedupe data with consecutive has no ordering"

What solution would you like?
A clear and concise description of what you want to happen.

What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.

Do you have any additional context?
Add any other context or screenshots about the feature request here.

@LantaoJin LantaoJin added calcite calcite migration releated enhancement New feature or request labels Mar 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
calcite calcite migration releated enhancement New feature or request untriaged
Projects
None yet
Development

No branches or pull requests

1 participant