[ https://issues.apache.org/jira/browse/FLINK-7673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Radoslaw Gruchalski updated FLINK-7673: --------------------------------------- Description: Currently the Flink Kinesis connector depends on two artifacts which are available under Amazon Software License code. The artifacts are: {noformat} <dependency> <groupId>com.amazonaws</groupId> <artifactId>amazon-kinesis-producer</artifactId> <version>${aws.kinesis-kpl.version}</version> </dependency> <dependency> <groupId>com.amazonaws</groupId> <artifactId>amazon-kinesis-client</artifactId> <version>${aws.kinesis-kcl.version}</version> <!-- We're excluding the below from the KCL since we'll only be using the com.amazonaws.services.kinesis.clientlibrary.types.UserRecord class, which will not need these dependencies. --> <exclusions> <exclusion> <groupId>com.amazonaws</groupId> <artifactId>aws-java-sdk-dynamodb</artifactId> </exclusion> <exclusion> <groupId>com.amazonaws</groupId> <artifactId>aws-java-sdk-cloudwatch</artifactId> </exclusion> </exclusions> </dependency> {noformat} This prevents the connector being published to Maven Central. I would like to contribute to Flink Kinesis connector by replacing the ASL licensed code with an implementation using AWS SDK for Java. For that, I'd like to understand two things: - what's the correct process for making the contribution (contributor agreement, etc.) - what's the minimum functionality the alternative implementation would have to provide in order to get accepted There are three classes in the connector's source requiring modification: - org.apache.flink.streaming.connectors.kinesis.FlinkKinesisProducer - org.apache.flink.streaming.connectors.kinesis.util.KinesisConfigUtil - org.apache.flink.streaming.connectors.kinesis.internals.ShardConsumer Thank you. was: Currently the Flink Kinesis connector depends on two artifacts which are available under Amazon Software License code. The artifacts are: {noformat} <dependency> <groupId>com.amazonaws</groupId> <artifactId>amazon-kinesis-producer</artifactId> <version>${aws.kinesis-kpl.version}</version> </dependency> <dependency> <groupId>com.amazonaws</groupId> <artifactId>amazon-kinesis-client</artifactId> <version>${aws.kinesis-kcl.version}</version> <!-- We're excluding the below from the KCL since we'll only be using the com.amazonaws.services.kinesis.clientlibrary.types.UserRecord class, which will not need these dependencies. --> <exclusions> <exclusion> <groupId>com.amazonaws</groupId> <artifactId>aws-java-sdk-dynamodb</artifactId> </exclusion> <exclusion> <groupId>com.amazonaws</groupId> <artifactId>aws-java-sdk-cloudwatch</artifactId> </exclusion> </exclusions> </dependency> {noformat} This prevents the connector being published to Maven Central. I would like to contribute to Flink Kinesis connector by replacing the ASL licensed code with an implementation using AWS SDK for Java. For that, I'd like to understand two things: - what's the correct process for making the contribution (contributor agreement, etc.) - what's the minimum functionality the alternative implementation would have to provide in order to get accepted Thank you. > Flink Kinesis connector - remove dependency on the ASL code > ----------------------------------------------------------- > > Key: FLINK-7673 > URL: https://issues.apache.org/jira/browse/FLINK-7673 > Project: Flink > Issue Type: Improvement > Reporter: Radoslaw Gruchalski > > Currently the Flink Kinesis connector depends on two artifacts which are > available under Amazon Software License code. The artifacts are: > {noformat} > <dependency> > <groupId>com.amazonaws</groupId> > <artifactId>amazon-kinesis-producer</artifactId> > <version>${aws.kinesis-kpl.version}</version> > </dependency> > <dependency> > <groupId>com.amazonaws</groupId> > <artifactId>amazon-kinesis-client</artifactId> > <version>${aws.kinesis-kcl.version}</version> > <!-- > We're excluding the below from the KCL since > we'll only be using the > > com.amazonaws.services.kinesis.clientlibrary.types.UserRecord class, which > will not need these dependencies. > --> > <exclusions> > <exclusion> > <groupId>com.amazonaws</groupId> > > <artifactId>aws-java-sdk-dynamodb</artifactId> > </exclusion> > <exclusion> > <groupId>com.amazonaws</groupId> > > <artifactId>aws-java-sdk-cloudwatch</artifactId> > </exclusion> > </exclusions> > </dependency> > {noformat} > This prevents the connector being published to Maven Central. I would like to > contribute to Flink Kinesis connector by replacing the ASL licensed code with > an implementation using AWS SDK for Java. For that, I'd like to understand > two things: > - what's the correct process for making the contribution (contributor > agreement, etc.) > - what's the minimum functionality the alternative implementation would have > to provide in order to get accepted > There are three classes in the connector's source requiring modification: > - org.apache.flink.streaming.connectors.kinesis.FlinkKinesisProducer > - org.apache.flink.streaming.connectors.kinesis.util.KinesisConfigUtil > - org.apache.flink.streaming.connectors.kinesis.internals.ShardConsumer > Thank you. -- This message was sent by Atlassian JIRA (v6.4.14#64029)