Skip to content

[hotfix][build] Update CI to support Flink 2.0 #200

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

hlteoh37
Copy link
Contributor

Purpose of the change

Support Flink 2.0 in flink-connector-aws

Verifying this change

This change is already covered by existing tests (unit test, integ test in CI)

Significant changes

(Please check any boxes [x] if the answer is "yes". You can first publish the PR and check them afterwards, for convenience.)

  • Dependencies have been added or upgraded
  • Public API has been changed (Public API is any class annotated with @Public(Evolving))
  • Serializers have been changed
  • New feature has been introduced
    • If yes, how is this documented? (not applicable / docs / JavaDocs / not documented)

Copy link
Contributor

@leekeiabstraction leekeiabstraction left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for raising the PR!

Looks like the added coverage for 2.0 has found changes on the Sink interface breaking DynamoDbSink. I assume the same applies for KinesisSink as well.

 Error:  Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default-compile) on project flink-connector-dynamodb: Compilation failure: Compilation failure: 
Error:  /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSink.java:[138,13] cannot find symbol
Error:    symbol:   class InitContext
Error:    location: class org.apache.flink.connector.dynamodb.sink.DynamoDbSink<InputT>
Error:  /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSink.java:[137,12] cannot find symbol
Error:    symbol:   class StatefulSinkWriter
Error:    location: class org.apache.flink.connector.dynamodb.sink.DynamoDbSink<InputT>
Error:  /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSink.java:[145,13] cannot find symbol
Error:    symbol:   class InitContext
Error:    location: class org.apache.flink.connector.dynamodb.sink.DynamoDbSink<InputT>
Error:  /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSink.java:[144,12] cannot find symbol
Error:    symbol:   class StatefulSinkWriter
Error:    location: class org.apache.flink.connector.dynamodb.sink.DynamoDbSink<InputT>
Error:  /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DefaultDynamoDbElementConverter.java:[55,26] cannot find symbol
Error:    symbol:   class InitContext
Error:    location: interface org.apache.flink.api.connector.sink2.Sink
Error:  /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSinkWriter.java:[22,49] cannot find symbol
Error:    symbol:   class InitContext
Error:    location: interface org.apache.flink.api.connector.sink2.Sink
Error:  /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSinkWriter.java:[129,13] cannot find symbol
Error:    symbol:   class InitContext
Error:    location: class org.apache.flink.connector.dynamodb.sink.DynamoDbSinkWriter<InputT>
Error:  /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbBeanElementConverter.java:[67,26] cannot find symbol
Error:    symbol:   class InitContext
Error:    location: interface org.apache.flink.api.connector.sink2.Sink
Error:  /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSinkWriter.java:[160,5] method does not override or implement a method from a supertype
Error:  -> [Help 1]

Approved. Also raised a Jira for 2.0 migration: https://issues.apache.org/jira/browse/FLINK-37687

@@ -25,7 +25,7 @@ jobs:
if: github.repository_owner == 'apache'
strategy:
matrix:
flink: [1.19-SNAPSHOT, 1.20-SNAPSHOT]
flink: [ 1.20-SNAPSHOT ]
java: [ '8, 11, 17']
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we plan to continue supporting java 8? If not, should we remove it?

Copy link
Contributor

@darenwkt darenwkt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR and looking forward to support for Flink 2.0! Left a small clarification question

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants