Skip to content

[FLINK-38779] Route module supports standard RegExp replacement rules#4190

Merged
lvyanquan merged 2 commits intoapache:masterfrom
yuxiqian:FLINK-38779
Jan 15, 2026
Merged

[FLINK-38779] Route module supports standard RegExp replacement rules#4190
lvyanquan merged 2 commits intoapache:masterfrom
yuxiqian:FLINK-38779

Conversation

@yuxiqian
Copy link
Member

This closes FLINK-38779.

CDC Pipeline router supports simple table name replacement for now. A route rule like this:

- { source-table: 'db.\\.*', sink-table: 'new_db.<>', replace-symbol: '<>' }

synchronizes all tables in db to new_db.

More complicated routing rules, including re-mapping database and schema name, or capturing parts of identifiers, is not possible.

Current API could be extended to support standard RegEx capturing & replacement syntaxes like this:

- { source-table: 'db.(\\.*)', sink-table: 'new_db.$1' }

and keep backwards compatiblility.

TableIdRouter has been moved to flink-cdc-common as a Public API.

@github-actions github-actions bot added docs Improvements or additions to documentation common runtime mysql-pipeline-connector labels Dec 10, 2025
@yuxiqian
Copy link
Member Author

Blocked by #4187.

@yuxiqian yuxiqian marked this pull request as draft December 10, 2025 09:55
@lvyanquan
Copy link
Contributor

lvyanquan commented Jan 4, 2026

Hi @yuxiqian, now that the pr #4187 was completed, you can go ahead.

@yuxiqian yuxiqian marked this pull request as ready for review January 4, 2026 13:33
@yuxiqian
Copy link
Member Author

yuxiqian commented Jan 4, 2026

Hi @yuxiqian, now that the pr #4187 was completed, you can go ahead.

Thanks! Rebased and marked this ready for review.

@yuxiqian yuxiqian requested a review from lvyanquan January 12, 2026 03:06
@lvyanquan lvyanquan requested a review from Copilot January 13, 2026 09:44
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

@lvyanquan lvyanquan requested a review from Copilot January 13, 2026 09:52
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Copy link
Contributor

@lvyanquan lvyanquan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1.

@lvyanquan lvyanquan merged commit 538b8fa into apache:master Jan 15, 2026
76 of 98 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments