Hey all, All connectors are now out for VOTE to include Flink 1.17 support. Please find the VOTE threads in the mailing list. I had missed the GCP pub-sub connector, but this one is also out for VOTE.
Thanks all, Danny On Mon, Apr 3, 2023 at 4:59 PM Danny Cranmer <[email protected]> wrote: > Hi everyone, > > I started the release process for flink-connector-aws and > flink-connector-pulsar. Unfortunately the Pulsar connector does not build > against Flink 1.17 at the v3.0.0 tag, errors below. The nightly is passing > since the code has been updated to support 1.17. > The PulsarFetcherManagerBase [1] was using a @VisibleForTesting constructor > of SplitFetcherManager which has been modified in Flink 1.17 [2]. This > means we will need a new source release for flink-connector-pulsar to > support Flink 1.17. > > For now I will follow up with the release of flink-connector-aws. > > Thanks, > Danny > > [1] > https://github.com/apache/flink-connector-pulsar/blob/v3.0.0/flink-connector-pulsar/src/main/java/org/apache/flink/connector/pulsar/source/reader/fetcher/PulsarFetcherManagerBase.java#L61 > [2] > https://github.com/apache/flink/pull/20485/files#diff-2b83c936a0cbf7c013c8cf9316966efefe72494e0a658d1cefb5ce1af13b7db8 > > On Mon, Apr 3, 2023 at 12:01 PM Hang Ruan <[email protected]> wrote: > >> Hi Denny, >> >> I could help with JDBC connectors. Thanks~ >> >> Best, >> Hang >> >> Danny Cranmer <[email protected]> 于2023年4月3日周一 17:57写道： >> >> > Hi everyone, >> > >> > I have created Jiras to investigate each failing build. Thanks Andriy, I >> > have assigned the Elasticsearch/Opensearch ones to you. Let me know if >> you >> > do not have capacity. >> > >> > - Elasticsearch: https://issues.apache.org/jira/browse/FLINK-31696 >> > - Opensearch: https://issues.apache.org/jira/browse/FLINK-31697 >> > - RabbitMQ: https://issues.apache.org/jira/browse/FLINK-31701 >> > - JDBC: https://issues.apache.org/jira/browse/FLINK-31699 >> > - Cassandra: https://issues.apache.org/jira/browse/FLINK-31698 >> > - MongoDB: https://issues.apache.org/jira/browse/FLINK-31700 >> > >> > Thanks, >> > Danny >> > >> > >> > On Fri, Mar 31, 2023 at 5:59 PM Andrey Redko <[email protected]> wrote: >> > >> > > Hi Denny, >> > > >> > > I could give you a hand with Elasticsearch / Opensearch connectors, >> > please >> > > let me know if help is needed. Thank you. >> > > >> > > Best Regards, >> > > Andriy Redko >> > > >> > > On Fri, Mar 31, 2023, 9:39 AM Danny Cranmer <[email protected]> >> > > wrote: >> > > >> > > > Apologies for the typo. >> Elasticsearch/Opensearch/Cassandra/JDBC/MongoDB >> > > are >> > > > build __failures__. >> > > > >> > > > On Fri, Mar 31, 2023 at 2:36 PM Danny Cranmer < >> [email protected] >> > > >> > > > wrote: >> > > > >> > > > > Hello all, >> > > > > >> > > > > With the release of 1.17.0 [1], we now need to add support for our >> > > > > externalized connectors. This release is lightweight compared to >> > normal >> > > > > since we are ideally not updating any source code; we only need to >> > > > rebuild >> > > > > and distribute the binary to Maven. Therefore I am proposing that >> we >> > > > bundle >> > > > > all the connectors into a single VOTE, and release them in one >> go. I >> > am >> > > > > considering connectors that are released and passing CI for 1.17, >> > which >> > > > > unfortunately only includes: >> > > > > - flink-connector-aws [2] at version 4.1.0-1.17 (build success >> [3]) >> > > > > - flink-connector-pulsar [4] at version 3.0.0-1.17 (build success >> > [5]) >> > > > > >> > > > > The following connectors are not passing builds against Flink >> 1.17.0 >> > > and >> > > > > potentially need a new source release, therefore are excluded and >> > will >> > > > need >> > > > > dedicated releases: >> > > > > - flink-connector-elasticsearch [6] at version 3.0.0-1.17 (build >> > > success >> > > > > [7]) >> > > > > - flink-connector-opensearch [8] at version 1.0.0-1.17 (build >> success >> > > > [9]) >> > > > > - flink-connector-cassandra [10] at version 3.0.0-1.17 (build >> success >> > > > [11]) >> > > > > - flink-connector-jdbc [12] at version 3.0.0-1.17 (build success >> > [13]) >> > > > > - flink-connector-mongodb [14] at version 1.0.0-1.17 (build >> success >> > > [15]) >> > > > > - flink-connector-rabbitmq [16] at version 3.0.0-1.17 (build >> failure >> > > > [17]) >> > > > > >> > > > > The following connectors are not yet released and are therefore >> > > excluded: >> > > > > - flink-connector-kafka [18] >> > > > > >> > > > > I volunteer myself as the release manager for flink-connector-aws >> and >> > > > > flink-connector-pulsar. I am happy to pick up others too, but will >> > move >> > > > to >> > > > > different threads. >> > > > > >> > > > > Thanks, >> > > > > Danny >> > > > > >> > > > > [1] >> > > > > >> > > > >> > > >> > >> https://flink.apache.org/2023/03/23/announcing-the-release-of-apache-flink-1.17/ >> > > > > [2] https://github.com/apache/flink-connector-aws >> > > > > [3] >> > > > >> https://github.com/apache/flink-connector-aws/actions/runs/4570151032 >> > > > > [4] https://github.com/apache/flink-connector-pulsar >> > > > > [5] >> > > > > >> > > >> https://github.com/apache/flink-connector-pulsar/actions/runs/4570233207 >> > > > > [6] https://github.com/apache/flink-connector-elasticsearch >> > > > > [7] >> > > > > >> > > > >> > > >> > >> https://github.com/apache/flink-connector-elasticsearch/actions/runs/4575392625 >> > > > > [8] https://github.com/apache/flink-connector-opensearch >> > > > > [9] >> > > > > >> > > > >> > > >> > >> https://github.com/apache/flink-connector-opensearch/actions/runs/4575383878 >> > > > > [10] https://github.com/apache/flink-connector-cassandra >> > > > > [11] >> > > > > >> > > > >> > > >> > >> https://github.com/apache/flink-connector-cassandra/actions/runs/4575364252 >> > > > > [12] https://github.com/apache/flink-connector-jdbc >> > > > > [13] >> > > > > >> > https://github.com/apache/flink-connector-jdbc/actions/runs/4575361507 >> > > > > [14] https://github.com/apache/flink-connector-mongodb >> > > > > [15] >> > > > > >> > > > >> > > >> > >> https://github.com/apache/flink-connector-mongodb/actions/runs/4575230622 >> > > > > [16] https://github.com/apache/flink-connector-rabbitmq >> > > > > [17] >> > > > > >> > > > >> > > >> > >> https://github.com/apache/flink-connector-rabbitmq/actions/runs/4575370483 >> > > > > [18] https://github.com/apache/flink-connector-kafka >> > > > > >> > > > > >> > > > > >> > > > >> > > >> > >> >
