Skip a list of sequentially executing task

[samirsilwal]

Description

Requirement

• To skip a set of task downstream and continue with other
• I do not want to branch by task (with branchPython operator) flows neither stop the flow conditionally (with shorCircutOperator)
• Introduce a feature to conditionally skip a specific set of downstream tasks in the Airflow DAG.
• The logic should allow flexibility to define which downstream tasks to skip based on the outcome or conditions set by previous tasks.
• Ensure that the tasks that follow the skipped set resume execution as per the DAG's original sequence, without requiring manual intervention.

Example

task A => task B => task C => task D => task E

Suppose this is the DAG initially

• I want to have an operator that gets a conditional based on which it can skip task C and D and proceed directly with E like

task A => taskB => SkipOperator (true)=> taskC (skipped) => task D(skipped) => task E

Use case/motivation

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg[bot]]

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

[potiuk]

this is at most a discussion, not Airflow issue. Hopefully someone will be able to help to answer your question.

Please only use issues to report a reproducible issue (as instructed in the template) - when you have a question, create a discussion instead.