Re: [VOTE] Release 1.19.1, release candidate #1
+1(non-binding) - Verified signatures and sha512 - Checked Github release tag exsit - Source archives with no binary files - Build the source with jdk8 on ubuntu 22.04 succeed - Reviewed the flink-web PR Best, Zhongqiang Gong Hong Liang 于2024年6月6日周四 23:39写道： > Hi everyone, > Please review and vote on the release candidate #1 for the flink v1.19.1, > as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > > The complete staging area is available for your review, which includes: > * JIRA release notes [1], > * the official Apache source release and binary convenience releases to be > deployed to dist.apache.org [2], which are signed with the key with > fingerprint B78A5EA1 [3], > * all artifacts to be deployed to the Maven Central Repository [4], > * source code tag "release-1.19.1-rc1" [5], > * website pull request listing the new release and adding announcement blog > post [6]. > > The vote will be open for at least 72 hours. It is adopted by majority > approval, with at least 3 PMC affirmative votes. > > Thanks, > Hong > > [1] > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12354399 > [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.19.1-rc1/ > [3] https://dist.apache.org/repos/dist/release/flink/KEYS > [4] > https://repository.apache.org/content/repositories/orgapacheflink-1736/ > [5] https://github.com/apache/flink/releases/tag/release-1.19.1-rc1 > [6] https://github.com/apache/flink-web/pull/745 >
Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo
Congratulations Weijie! Best, Zhongqiang Gong Xintong Song 于2024年6月4日周二 14:46写道： > Hi everyone, > > On behalf of the PMC, I'm very happy to announce that Weijie Guo has joined > the Flink PMC! > > Weijie has been an active member of the Apache Flink community for many > years. He has made significant contributions in many components, including > runtime, shuffle, sdk, connectors, etc. He has driven / participated in > many FLIPs, authored and reviewed hundreds of PRs, been consistently active > on mailing lists, and also helped with release management of 1.20 and > several other bugfix releases. > > Congratulations and welcome Weijie! > > Best, > > Xintong (on behalf of the Flink PMC) >
Re: [VOTE] Release flink-connector-jdbc v3.2.0, release candidate #2
+1 (non-binding) - Validated checksum hash and signature. - Confirmed that no binaries exist in the source archive. - Built the source with JDK 8. - Verified the web PR. - Ensured the JAR is built by JDK 8. Best, Zhongqiang Gong Danny Cranmer 于2024年4月18日周四 18:20写道： > Hi everyone, > > Please review and vote on the release candidate #1 for the version 3.2.0, > as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > This release supports Flink 1.18 and 1.19. > > The complete staging area is available for your review, which includes: > * JIRA release notes [1], > * the official Apache source release to be deployed to dist.apache.org > [2], > which are signed with the key with fingerprint 125FD8DB [3], > * all artifacts to be deployed to the Maven Central Repository [4], > * source code tag v3.2.0-rc1 [5], > * website pull request listing the new release [6]. > * CI run of tag [7]. > > The vote will be open for at least 72 hours. It is adopted by majority > approval, with at least 3 PMC affirmative votes. > > Thanks, > Danny > > [1] > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12353143 > [2] > https://dist.apache.org/repos/dist/dev/flink/flink-connector-jdbc-3.2.0-rc2 > [3] https://dist.apache.org/repos/dist/release/flink/KEYS > [4] > https://repository.apache.org/content/repositories/orgapacheflink-1718/ > [5] https://github.com/apache/flink-connector-jdbc/releases/tag/v3.2.0-rc2 > [6] https://github.com/apache/flink-web/pull/734 > [7] https://github.com/apache/flink-connector-jdbc/actions/runs/8736019099 >
Re: [VOTE] Release flink-connector-aws v4.3.0, release candidate #2
+1 (non-binding) - Validated the checksum hash and signature. - No binaries exist in the source archive. - Built the source with JDK 8 succeed. - Verified the flink-web PR. - Ensured the JAR is built by JDK 8. Best, Zhongqiang Gong Danny Cranmer 于2024年4月19日周五 18:08写道： > Hi everyone, > > Please review and vote on release candidate #2 for flink-connector-aws > v4.3.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > This version supports Flink 1.18 and 1.19. > > The complete staging area is available for your review, which includes: > * JIRA release notes [1], > * the official Apache source release to be deployed to dist.apache.org > [2], > which are signed with the key with fingerprint 125FD8DB [3], > * all artifacts to be deployed to the Maven Central Repository [4], > * source code tag v4.3.0-rc2 [5], > * website pull request listing the new release [6]. > * CI build of the tag [7]. > > The vote will be open for at least 72 hours. It is adopted by majority > approval, with at least 3 PMC affirmative votes. > > Thanks, > Release Manager > > [1] > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12353793 > [2] > https://dist.apache.org/repos/dist/dev/flink/flink-connector-aws-4.3.0-rc2 > [3] https://dist.apache.org/repos/dist/release/flink/KEYS > [4] > https://repository.apache.org/content/repositories/orgapacheflink-1721/ > [5] https://github.com/apache/flink-connector-aws/releases/tag/v4.3.0-rc2 > [6] https://github.com/apache/flink-web/pull/733 > [7] https://github.com/apache/flink-connector-aws/actions/runs/8751694197 >
Re: Slack Invite
Hi, The invite link : https://join.slack.com/t/apache-flink/shared_invite/zt-2jtsd06wy-31q_aELVkdc4dHsx0GMhOQ Best, Zhongqiang Gong Nelson de Menezes Neto 于2024年5月30日周四 15:01写道： > Hey guys! > > I want to join the slack community but the invite has expired.. > Can u send me a new one? >
Re: Slack invite
Hi, The invite link : https://join.slack.com/t/apache-flink/shared_invite/zt-2jtsd06wy-31q_aELVkdc4dHsx0GMhOQ Best, Zhongqiang Gong Sai Sankeerth Rao 于2024年5月30日周四 15:40写道： > Hi, > > I would like to join the slack community but the link has expired. Can > someone send me a new one ? > > Thanks > > -- > Regards > P Sai Sankeerth Rao > +91-9600129402 >
Re: [DISCUSS] Flink CDC 3.1.1 Release
+1 Thanks Xiqian. Best, Zhongqiang Gong Xiqian YU 于2024年5月28日周二 19:44写道： > Hi devs, > > I would like to make a proposal about creating a new Flink CDC 3.1 patch > release (3.1.1). It’s been a week since the last CDC version 3.1.0 got > released [1], and since then, 7 tickets have been closed, 4 of them are of > high priority. > > Currently, there are 5 items open at the moment: 1 of them is a blocker, > which stops users from restoring with existed checkpoints after upgrading > [2]. There’s a PR ready and will be merged soon. Other 4 of them have > approved PRs, and will be merged soon [3][4][5][6]. I propose that a patch > version could be released after all pending tickets closed. > > Please reply if there are any unresolved blocking issues you’d like to > include in this release. > > Regards, > Xiqian > > [1] > https://flink.apache.org/2024/05/17/apache-flink-cdc-3.1.0-release-announcement/ > [2] https://issues.apache.org/jira/browse/FLINK-35464 > [3] https://issues.apache.org/jira/browse/FLINK-35149 > [4] https://issues.apache.org/jira/browse/FLINK-35323 > [5] https://issues.apache.org/jira/browse/FLINK-35430 > [6] https://issues.apache.org/jira/browse/FLINK-35447 > >
Re: [VOTE] Release flink-connector-opensearch v1.2.0, release candidate #1
+1(non-binding) - Verified signatures and hash sums - Reviewed the web PR - Built from source code with JDK 1.8 on Ubuntu 22.04 - Checked release notes Best, Zhongqiang Gong Sergey Nuyanzin 于2024年5月16日周四 06:03写道： > Hi everyone, > Please review and vote on release candidate #1 for > flink-connector-opensearch v1.2.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > > The complete staging area is available for your review, which includes: > * JIRA release notes [1], > * the official Apache source release to be deployed to dist.apache.org > [2], > which are signed with the key with fingerprint > F7529FAE24811A5C0DF3CA741596BBF0726835D8 [3], > * all artifacts to be deployed to the Maven Central Repository [4], > * source code tag v1.2.0-rc1 [5], > * website pull request listing the new release [6]. > * CI build of the tag [7]. > > The vote will be open for at least 72 hours. It is adopted by majority > approval, with at least 3 PMC affirmative votes. > > Note that this release is for Opensearch v1.x > > Thanks, > Release Manager > > [1] https://issues.apache.org/jira/projects/FLINK/versions/12353812 > [2] > > https://dist.apache.org/repos/dist/dev/flink/flink-connector-opensearch-1.2.0-rc1 > [3] https://dist.apache.org/repos/dist/release/flink/KEYS > [4] https://repository.apache.org/content/repositories/orgapacheflink-1734 > [5] > > https://github.com/apache/flink-connector-opensearch/releases/tag/v1.2.0-rc1 > [6] https://github.com/apache/flink-web/pull/740 > [7] > > https://github.com/apache/flink-connector-opensearch/actions/runs/9102334125 >
[DISCUSS] Add Flink CDC Channel to Apache Flink Slack Workspace
Hi devs, I would like to propose adding a dedicated Flink CDC channel to the Apache Flink Slack workspace. Creating a channel focused on Flink CDC will help community members easily find previous discussions and target new discussions and questions to the correct place. Flink CDC is a sufficiently distinct component within the Apache Flink ecosystem, and having a dedicated channel will make it viable and useful for those specifically working with or interested in this technology. Looking forward to your feedback and support on this proposal. Best, Zhongqiang Gong
Re: [VOTE] FLIP-457: Improve Table/SQL Configuration for Flink 2.0
+1 (non-binding) Best, Zhongqiang Gong Jane Chan 于2024年5月24日周五 09:52写道： > Hi all, > > I'd like to start a vote on FLIP-457[1] after reaching a consensus through > the discussion thread[2]. > > The vote will be open for at least 72 hours unless there is an objection or > insufficient votes. > > > [1] > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=307136992 > [2] https://lists.apache.org/thread/1sthbv6q00sq52pp04n2p26d70w4fqj1 > > Best, > Jane >
[DISCUSS] Flink CDC Upgrade Debezium version to 2.x
Hi all, I would like to start a discussion about upgrading Debezium to version 2.x. Background: Currently, the Debezium community no longer maintains versions prior to 2.0, and the website has taken down the documentation for versions before 2.0. However, Flink CDC depends on Debezium version 1.9, and the documentation references links to that version. Problem: - References to Debezium's documentation links report errors [1] - The Debezium community will no longer maintain versions prior to 2.0. Flink CDC synchronizes bug fixes from Debezium 2.0 by overwriting classes, but the classes differ significantly between 2.x and 1.9. Compatibility and Deprecation: - Debezium uses JDK 11 starting from version 2.0 [2] Plan: - Migrate references in Flink CDC documentation from Debezium 1.9 to 2.0 - Upgrade Debezium to version 2.x [1] https://github.com/apache/flink-cdc/actions/runs/9192497396/job/25281283926#step:4:1148 [2] https://debezium.io/releases/2.0/ Best, Zhongqiang Gong
Re: [ANNOUNCE] Apache Flink CDC 3.1.0 released
Congratulations ! Thanks for all contributors. Best, Zhongqiang Gong Qingsheng Ren 于 2024年5月17日周五 17:33写道： > The Apache Flink community is very happy to announce the release of > Apache Flink CDC 3.1.0. > > Apache Flink CDC is a distributed data integration tool for real time > data and batch data, bringing the simplicity and elegance of data > integration via YAML to describe the data movement and transformation > in a data pipeline. > > Please check out the release blog post for an overview of the release: > > https://flink.apache.org/2024/05/17/apache-flink-cdc-3.1.0-release-announcement/ > > The release is available for download at: > https://flink.apache.org/downloads.html > > Maven artifacts for Flink CDC can be found at: > https://search.maven.org/search?q=g:org.apache.flink%20cdc > > The full release notes are available in Jira: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12354387 > > We would like to thank all contributors of the Apache Flink community > who made this release possible! > > Regards, > Qingsheng Ren >
Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3
+1 (non-binding) - Verified signature and checksum hash - Verified that no binaries exist in the source archive - Build source code successful on ubuntu 22.04 with jdk8 - Check tag and branch exist - Check jars are built by jdk8 Best, Zhongqiang Gong Qingsheng Ren 于2024年5月11日周六 10:10写道： > Hi everyone, > > Please review and vote on the release candidate #3 for the version 3.1.0 of > Apache Flink CDC, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > **Release Overview** > > As an overview, the release consists of the following: > a) Flink CDC source release to be deployed to dist.apache.org > b) Maven artifacts to be deployed to the Maven Central Repository > > **Staging Areas to Review** > > The staging areas containing the above mentioned artifacts are as follows, > for your review: > * All artifacts for a) can be found in the corresponding dev repository at > dist.apache.org [1], which are signed with the key with fingerprint > A1BD477F79D036D2C30CA7DBCA8AEEC2F6EB040B [2] > * All artifacts for b) can be found at the Apache Nexus Repository [3] > > Other links for your review: > * JIRA release notes [4] > * Source code tag "release-3.1.0-rc3" with commit hash > 5452f30b704942d0ede64ff3d4c8699d39c63863 [5] > * PR for release announcement blog post of Flink CDC 3.1.0 in flink-web [6] > > **Vote Duration** > > The voting time will run for at least 72 hours, adopted by majority > approval with at least 3 PMC affirmative votes. > > Thanks, > Qingsheng Ren > > [1] https://dist.apache.org/repos/dist/dev/flink/flink-cdc-3.1.0-rc3/ > [2] https://dist.apache.org/repos/dist/release/flink/KEYS > [3] https://repository.apache.org/content/repositories/orgapacheflink-1733 > [4] > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12354387 > [5] https://github.com/apache/flink-cdc/releases/tag/release-3.1.0-rc3 > [6] https://github.com/apache/flink-web/pull/739 >
Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction
+1 (non-binding) Best. Zhongqiang Gong Martijn Visser 于2024年5月14日周二 14:45写道： > Hi everyone, > > With no more discussions being open in the thread [1] I would like to start > a vote on FLIP-453: Promote Unified Sink API V2 to Public and Deprecate > SinkFunction [2] > > The vote will be open for at least 72 hours unless there is an objection or > insufficient votes. > > Best regards, > > Martijn > > [1] https://lists.apache.org/thread/hod6bg421bzwhbfv60lwsck7r81dvo59 > [2] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-453%3A+Promote+Unified+Sink+API+V2+to+Public+and+Deprecate+SinkFunction >
Re: [DISCUSS] Flink CDC 3.2 Release Planning
Hi Qingsheng Thank you for driving the release. Agree with the goal and I'm willing to help. Best, Zhongqiang Gong Qingsheng Ren 于2024年5月8日周三 14:22写道： > Hi devs, > > As we are in the midst of the release voting process for Flink CDC 3.1.0, I > think it's a good time to kick off the upcoming Flink CDC 3.2 release > cycle. > > In this release cycle I would like to focus on the stability of Flink CDC, > especially for the newly introduced YAML-based data integration > framework. To ensure we can iterate and improve swiftly, I propose to make > 3.2 a relatively short release cycle, targeting a feature freeze by May 24, > 2024. > > For developers that are interested in participating and contributing new > features in this release cycle, please feel free to list your planning > features in the wiki page [1]. > > I'm happy to volunteer as a release manager and of course open to work > together with someone on this. > > What do you think? > > Best, > Qingsheng > > [1] > https://cwiki.apache.org/confluence/display/FLINK/Flink+CDC+3.2+Release >
Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #1
Hi Qingsheng, I open a block issue[1] to add ci for NOTICE check and fix NOTICE file. Best, Zhongqiang Gong [1] https://issues.apache.org/jira/browse/FLINK-35309 Qingsheng Ren 于2024年5月8日周三 14:28写道： > Thanks everyone for your verification! > > I'll investigate the issue and prepare another RC once it is resolved. Much > appreciated to Jingsong! > > This release candidate is now canceled. > > Best, > Qingsheng > > On Wed, May 8, 2024 at 2:20 PM Jingsong Li wrote: > > > -1 > > > > Thanks Qingsheng for preparing this RC. > > > > If you bundle third-party dependencies (non Flink dependencies) in > > your published jar, you need to write them in the NOTICE file. > > > > I recommend adding a test using flink-ci-tools to verify if the NOTICE > > file is correct. Of course, you cannot rely too much on tools and > > still need to manually verify if it is correct. > > > > Best, > > Jingsong > > > > On Sat, May 4, 2024 at 7:45 PM Ahmed Hamdy wrote: > > > > > > Hi Qisheng, > > > > > > +1 (non-binding) > > > > > > - Verified checksums and hashes > > > - Verified signatures > > > - Verified github tag exists > > > - Verified no binaries in source > > > - build source > > > > > > > > > Best Regards > > > Ahmed Hamdy > > > > > > > > > On Fri, 3 May 2024 at 23:03, Jeyhun Karimov > > wrote: > > > > > > > Hi Qinsheng, > > > > > > > > Thanks for driving the release. > > > > +1 (non-binding) > > > > > > > > - No binaries in source > > > > - Verified Signatures > > > > - Github tag exists > > > > - Build source > > > > > > > > Regards, > > > > Jeyhun > > > > > > > > On Thu, May 2, 2024 at 10:52 PM Muhammet Orazov > > > > wrote: > > > > > > > > > Hey Qingsheng, > > > > > > > > > > Thanks a lot! +1 (non-binding) > > > > > > > > > > - Checked sha512sum hash > > > > > - Checked GPG signature > > > > > - Reviewed release notes > > > > > - Reviewed GitHub web pr (added minor suggestions) > > > > > - Built the source with JDK 11 & 8 > > > > > - Checked that src doesn't contain binary files > > > > > > > > > > Best, > > > > > Muhammet > > > > > > > > > > On 2024-04-30 05:11, Qingsheng Ren wrote: > > > > > > Hi everyone, > > > > > > > > > > > > Please review and vote on the release candidate #1 for the > version > > > > > > 3.1.0 of > > > > > > Apache Flink CDC, as follows: > > > > > > [ ] +1, Approve the release > > > > > > [ ] -1, Do not approve the release (please provide specific > > comments) > > > > > > > > > > > > **Release Overview** > > > > > > > > > > > > As an overview, the release consists of the following: > > > > > > a) Flink CDC source release to be deployed to dist.apache.org > > > > > > b) Maven artifacts to be deployed to the Maven Central Repository > > > > > > > > > > > > **Staging Areas to Review** > > > > > > > > > > > > The staging areas containing the above mentioned artifacts are as > > > > > > follows, > > > > > > for your review: > > > > > > * All artifacts for a) can be found in the corresponding dev > > repository > > > > > > at > > > > > > dist.apache.org [1], which are signed with the key with > > fingerprint > > > > > > A1BD477F79D036D2C30CA7DBCA8AEEC2F6EB040B [2] > > > > > > * All artifacts for b) can be found at the Apache Nexus > Repository > > [3] > > > > > > > > > > > > Other links for your review: > > > > > > * JIRA release notes [4] > > > > > > * Source code tag "release-3.1.0-rc1" with commit hash > > > > > > 63b42cb937d481f558209ab3c8547959cf039643 [5] > > > > > > * PR for release announcement blog post of Flink CDC 3.1.0 in > > flink-web > > > > > > [6] > > > > > > > > > > > > **Vote Duration** > > > > > > > > > > > > The voting time will run for at least 72 hours, adopted by > majority > > > > > > approval with at least 3 PMC affirmative votes. > > > > > > > > > > > > Thanks, > > > > > > Qingsheng Ren > > > > > > > > > > > > [1] > > https://dist.apache.org/repos/dist/dev/flink/flink-cdc-3.1.0-rc1/ > > > > > > [2] https://dist.apache.org/repos/dist/release/flink/KEYS > > > > > > [3] > > > > > > > > https://repository.apache.org/content/repositories/orgapacheflink-1731 > > > > > > [4] > > > > > > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12354387 > > > > > > [5] > > https://github.com/apache/flink-cdc/releases/tag/release-3.1.0-rc1 > > > > > > [6] https://github.com/apache/flink-web/pull/739 > > > > > > > > > > > >
Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0
+1 (non-binding) Best, Zhongqiang Gong yue ma 于2024年5月6日周一 10:54写道： > Hi everyone, > > Thanks for all the feedback, I'd like to start a vote on the FLIP-447: > Upgrade FRocksDB from 6.20.3 to 8.10.0 [1]. The discussion thread is here > [2]. > > The vote will be open for at least 72 hours unless there is an objection or > insufficient votes. > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-447%3A+Upgrade+FRocksDB+from+6.20.3++to+8.10.0 > [2] https://lists.apache.org/thread/lrxjfpjjwlq4sjzm1oolx58n1n8r48hw > > -- > Best, > Yue >
Re: [VOTE] FLIP-446: Kubernetes Operator State Snapshot CRD
+1( (non-binding) Best, Zhongqiang Gong Mate Czagany 于2024年4月24日周三 16:06写道： > Hi everyone, > > I'd like to start a vote on the FLIP-446: Kubernetes Operator State > Snapshot CRD [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or > insufficient votes. > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-446%3A+Kubernetes+Operator+State+Snapshot+CRD > [2] https://lists.apache.org/thread/q5dzjwj0qk34rbg2sczyypfhokxoc3q7 > > Regards, > Mate >
Re: [VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines
+1(non-binding) Best, Zhongqiang Gong Ron liu 于2024年4月17日周三 14:28写道： > Hi Dev, > > Thank you to everyone for the feedback on FLIP-435: Introduce a New > Materialized Table for Simplifying Data Pipelines[1][2]. > > I'd like to start a vote for it. The vote will be open for at least 72 > hours unless there is an objection or not enough votes. > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines > [2] https://lists.apache.org/thread/c1gnn3bvbfs8v1trlf975t327s4rsffs > > Best, > Ron >
Re: [VOTE] FLIP-442: General Improvement to Configuration for Flink 2.0
+1 (non-binding) Best, Zhongqiang Gong Xuannan Su 于2024年4月17日周三 13:02写道： > Hi everyone, > > Thanks for all the feedback about the FLIP-442: General Improvement to > Configuration for Flink 2.0 [1] [2]. > > I'd like to start a vote for it. The vote will be open for at least 72 > hours(excluding weekends,until APR 22, 12:00AM GMT) unless there is an > objection or an insufficient number of votes. > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-442%3A+General+Improvement+to+Configuration+for+Flink+2.0 > [2] https://lists.apache.org/thread/15k0stwyoknhxvd643ctwjw3fd17pqwk > > > Best regards, > Xuannan >
Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan
Congratulations, Zakelly! Best, Zhongqiang Gong Yuan Mei 于2024年4月15日周一 10:51写道： > Hi everyone, > > On behalf of the PMC, I'm happy to let you know that Zakelly Lan has become > a new Flink Committer! > > Zakelly has been continuously contributing to the Flink project since 2020, > with a focus area on Checkpointing, State as well as frocksdb (the default > on-disk state db). > > He leads several FLIPs to improve checkpoints and state APIs, including > File Merging for Checkpoints and configuration/API reorganizations. He is > also one of the main contributors to the recent efforts of "disaggregated > state management for Flink 2.0" and drives the entire discussion in the > mailing thread, demonstrating outstanding technical depth and breadth of > knowledge. > > Beyond his technical contributions, Zakelly is passionate about helping the > community in numerous ways. He spent quite some time setting up the Flink > Speed Center and rebuilding the benchmark pipeline after the original one > was out of lease. He helps build frocksdb and tests for the upcoming > frocksdb release (bump rocksdb from 6.20.3->8.10). > > Please join me in congratulating Zakelly for becoming an Apache Flink > committer! > > Best, > Yuan (on behalf of the Flink PMC) >
Re: [VOTE] Release flink-connector-mongodb v1.2.0, release candidate #1
+1 (non-binding) - Flink website pr reviewed - Check source code without binary files - Validated checksum hash and signature - CI passed with tag v1.2.0-rc1 Best, Zhongqiang Gong Danny Cranmer 于2024年4月17日周三 18:44写道： > Hi everyone, > > Please review and vote on the release candidate #1 for v1.2.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > This release supports Flink 1.18 and 1.19. > > The complete staging area is available for your review, which includes: > * JIRA release notes [1], > * the official Apache source release to be deployed to dist.apache.org > [2], > which are signed with the key with fingerprint 125FD8DB [3], > * all artifacts to be deployed to the Maven Central Repository [4], > * source code tag v1.2.0-rc1 [5], > * website pull request listing the new release [6]. > * CI build of tag [7]. > > The vote will be open for at least 72 hours. It is adopted by majority > approval, with at least 3 PMC affirmative votes. > > Thanks, > Danny > > [1] > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12354192 > [2] > > https://dist.apache.org/repos/dist/dev/flink/flink-connector-mongodb-1.2.0-rc1 > [3] https://dist.apache.org/repos/dist/release/flink/KEYS > [4] > https://repository.apache.org/content/repositories/orgapacheflink-1715/ > [5] > https://github.com/apache/flink-connector-mongodb/releases/tag/v1.2.0-rc1 > [6] https://github.com/apache/flink-web/pull/735 > [7] > https://github.com/apache/flink-connector-mongodb/actions/runs/8720057880 >
Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge
Congratulations, Jing! Best regards, Zhongqiang Gong Jark Wu 于2024年4月12日周五 16:02写道： > Hi everyone, > > On behalf of the PMC, I'm very happy to announce that Jing Ge has > joined the Flink PMC! > > Jing has been contributing to Apache Flink for a long time. He continuously > works on SQL, connectors, Source, and Sink APIs, test, and document > modules while contributing lots of code and insightful discussions. He is > one of the maintainers of Flink CI infra. He is also willing to help a lot > in the > community work, such as being the release manager for both 1.18 and 1.19, > verifying releases, and answering questions on the mailing list. Besides > that, > he is continuously helping with the expansion of the Flink community and > has > given several talks about Flink at many conferences, such as Flink Forward > 2022 and 2023. > > Congratulations and welcome Jing! > > Best, > Jark (on behalf of the Flink PMC) >
Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee
Congratulations, Lincoln! Best, Zhongqiang Gong Jark Wu 于2024年4月12日周五 16:01写道： > Hi everyone, > > On behalf of the PMC, I'm very happy to announce that Lincoln Lee has > joined the Flink PMC! > > Lincoln has been an active member of the Apache Flink community for > many years. He mainly works on Flink SQL component and has driven > /pushed many FLIPs around SQL, including FLIP-282/373/415/435 in > the recent versions. He has a great technical vision of Flink SQL and > participated in plenty of discussions in the dev mailing list. Besides > that, > he is community-minded, such as being the release manager of 1.19, > verifying releases, managing release syncs, writing the release > announcement etc. > > Congratulations and welcome Lincoln! > > Best, > Jark (on behalf of the Flink PMC) >
Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI
+1 (non binding) Bests, Zhongqiang Gong Rui Fan <1996fan...@gmail.com> 于2024年4月10日周三 12:36写道： > Hi devs, > > Thank you to everyone for the feedback on FLIP-441: Show > the JobType and remove Execution Mode on Flink WebUI[1] > which has been discussed in this thread [2]. > > I would like to start a vote for it. The vote will be open for at least 72 > hours unless there is an objection or not enough votes. > > [1] https://cwiki.apache.org/confluence/x/agrPEQ > [2] https://lists.apache.org/thread/0s52w17w24x7m2zo6ogl18t1fy412vcd > > Best, > Rui >
Re: [VOTE] FLIP-399: Flink Connector Doris
+1 (non-binding) Best, Zhongqiang Gong wudi <676366...@qq.com.invalid> 于2024年4月9日周二 10:48写道： > Hi devs, > > I would like to start a vote about FLIP-399 [1]. The FLIP is about > contributing the Flink Doris Connector[2] to the Flink community. > Discussion thread [3]. > > The vote will be open for at least 72 hours unless there is an objection or > insufficient votes. > > > Thanks, > Di.Wu > > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-399%3A+Flink+Connector+Doris > [2] https://github.com/apache/doris-flink-connector > [3] https://lists.apache.org/thread/p3z4wsw3ftdyfs9p2wd7bbr2gfyl3xnh > >
Re: [VOTE] FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State
+1(non-binding) Best, Zhongqiang Gong Jinzhong Li 于2024年3月27日周三 19:31写道： > Hi devs, > > > I'd like to start a vote on the FLIP-428: Fault Tolerance/Rescale > Integration for Disaggregated State [1]. The discussion thread is here [2]. > > > The vote will be open for at least 72 hours unless there is an objection or > insufficient votes. > > [1] https://cwiki.apache.org/confluence/x/UYp3EQ > > [2] https://lists.apache.org/thread/vr8f91p715ct4lop6b3nr0fh4z5p312b > > Best, > > Jinzhong >
Re: [VOTE] FLIP-426: Grouping Remote State Access
+1(non-binding) Best, Zhongqiang Gong Jinzhong Li 于2024年3月27日周三 18:57写道： > Hi devs, > > I'd like to start a vote on the FLIP-426: Grouping Remote State Access [1]. > The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or > insufficient votes. > > > [1] https://cwiki.apache.org/confluence/x/TYp3EQ > > [2] https://lists.apache.org/thread/bt931focfl9971cwq194trmf3pkdsxrf > > > Best, > > Jinzhong >
Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project
Congratulations! Best, Zhongqiang Gong Yu Li 于2024年3月28日周四 15:57写道： > CC the Flink user and dev mailing list. > > Paimon originated within the Flink community, initially known as Flink > Table Store, and all our incubating mentors are members of the Flink > Project Management Committee. I am confident that the bonds of > enduring friendship and close collaboration will continue to unite the > two communities. > > And congratulations all! > > Best Regards, > Yu > > On Wed, 27 Mar 2024 at 20:35, Guojun Li wrote: > > > > Congratulations! > > > > Best, > > Guojun > > > > On Wed, Mar 27, 2024 at 5:24 PM wulin wrote: > > > > > Congratulations~ > > > > > > > 2024年3月27日 15:54，王刚 写道： > > > > > > > > Congratulations~ > > > > > > > >> 2024年3月26日 10:25，Jingsong Li 写道： > > > >> > > > >> Hi Paimon community, > > > >> > > > >> I’m glad to announce that the ASF board has approved a resolution to > > > >> graduate Paimon into a full Top Level Project. Thanks to everyone > for > > > >> your help to get to this point. > > > >> > > > >> I just created an issue to track the things we need to modify [2], > > > >> please comment on it if you feel that something is missing. You can > > > >> refer to apache documentation [1] too. > > > >> > > > >> And, we already completed the GitHub repo migration [3], please > update > > > >> your local git repo to track the new repo [4]. > > > >> > > > >> You can run the following command to complete the remote repo > tracking > > > >> migration. > > > >> > > > >> git remote set-url origin https://github.com/apache/paimon.git > > > >> > > > >> If you have a different name, please change the 'origin' to your > remote > > > name. > > > >> > > > >> Please join me in celebrating! > > > >> > > > >> [1] > > > > https://incubator.apache.org/guides/transferring.html#life_after_graduation > > > >> [2] https://github.com/apache/paimon/issues/3091 > > > >> [3] https://issues.apache.org/jira/browse/INFRA-25630 > > > >> [4] https://github.com/apache/paimon > > > >> > > > >> Best, > > > >> Jingsong Lee > > > > > > >
Re: [DISCUSS] Flink Website Menu Adjustment
Hi everyone, Thanks for feedback. It seems that there is no consensus on this change. I have opened a FLINK-34946 <https://issues.apache.org/jira/browse/FLINK-34946> issue to follow up on this matter. Best regards, Zhongqiang Gong Hang Ruan 于2024年3月26日周二 14:11写道： > +1 for the proposal. > > Best, > Hang > > Hangxiang Yu 于2024年3月26日周二 13:40写道： > > > Thanks Zhongqiang for driving this. > > +1 for the proposal. > > > > On Tue, Mar 26, 2024 at 1:36 PM Shawn Huang wrote: > > > > > +1 for the proposal > > > > > > Best, > > > Shawn Huang > > > > > > > > > Hongshun Wang 于2024年3月26日周二 11:56写道： > > > > > > > +1 for the proposal > > > > > > > > Best Regards, > > > > Hongshun Wang > > > > > > > > On Tue, Mar 26, 2024 at 11:37 AM gongzhongqiang < > > > gongzhongqi...@apache.org > > > > > > > > > wrote: > > > > > > > > > Hi Martijn, > > > > > > > > > > Thank you for your feedback. > > > > > > > > > > I agree with your point that we should make a one-time update to > the > > > > menu, > > > > > rather than continuously updating it. This will be done unless some > > > > > sub-projects are moved or archived. > > > > > > > > > > Best regards, > > > > > > > > > > Zhongqiang Gong > > > > > > > > > > > > > > > Martijn Visser 于2024年3月25日周一 23:35写道： > > > > > > > > > > > Hi Zhongqiang Gong, > > > > > > > > > > > > Are you suggesting to continuously update the menu based on the > > > number > > > > of > > > > > > releases, or just this one time? I wouldn't be in favor of > > > continuously > > > > > > updating: returning customers expect a certain order in the menu, > > > and I > > > > > > don't see a lot of value in continuously changing that. I do > think > > > that > > > > > the > > > > > > order that you have currently proposed is better then the one we > > have > > > > > right > > > > > > now, so I would +1 a one-time update but not a continuously > > updating > > > > > order. > > > > > > > > > > > > Best regards, > > > > > > > > > > > > Martijn > > > > > > > > > > > > On Mon, Mar 25, 2024 at 4:15 PM Yanquan Lv > > > > > wrote: > > > > > > > > > > > > > +1 for this proposal. > > > > > > > > > > > > > > gongzhongqiang 于2024年3月25日周一 > > 15:49写道： > > > > > > > > > > > > > > > Hi everyone, > > > > > > > > > > > > > > > > I'd like to start a discussion on adjusting the Flink website > > [1] > > > > > menu > > > > > > to > > > > > > > > improve accuracy and usability.While migrating Flink CDC > > > > > documentation > > > > > > > > to the website, I found outdated links, need to review and > > update > > > > > menus > > > > > > > > for the most relevant information for our users. > > > > > > > > > > > > > > > > > > > > > > > > Proposal: > > > > > > > > > > > > > > > > - Remove Paimon [2] from the "Getting Started" and > > > "Documentation" > > > > > > menus: > > > > > > > > Paimon [2] is now an independent top project of ASF. CC： > > jingsong > > > > > lees > > > > > > > > > > > > > > > > - Sort the projects in the subdirectory by the activity of > the > > > > > > projects. > > > > > > > > Here I list the number of releases for each project in the > past > > > > year. > > > > > > > > > > > > > > > > Flink Kubernetes Operator : 7 > > > > > > > > Flink CDC : 5 > > > > > > > > Flink ML : 2 > > > > > > > > Flink Stateful Functions : 1 > > > > > > > > > > > > > > > > > > > > > > > > Expected Outcome : > > > > > > > > > > > > > > > > - Menu "Getting Started" > > > > > > > > > > > > > > > > Before: > > > > > > > > > > > > > > > > With Flink > > > > > > > > > > > > > > > > With Flink Stateful Functions > > > > > > > > > > > > > > > > With Flink ML > > > > > > > > > > > > > > > > With Flink Kubernetes Operator > > > > > > > > > > > > > > > > With Paimon(incubating) (formerly Flink Table Store) > > > > > > > > > > > > > > > > With Flink CDC > > > > > > > > > > > > > > > > Training Course > > > > > > > > > > > > > > > > > > > > > > > > After: > > > > > > > > > > > > > > > > With Flink > > > > > > > > With Flink Kubernetes Operator > > > > > > > > > > > > > > > > With Flink CDC > > > > > > > > > > > > > > > > With Flink ML > > > > > > > > > > > > > > > > With Flink Stateful Functions > > > > > > > > > > > > > > > > Training Course > > > > > > > > > > > > > > > > > > > > > > > > - Menu "Documentation" will same with "Getting Started" > > > > > > > > > > > > > > > > > > > > > > > > I look forward to hearing your thoughts and suggestions on > this > > > > > > proposal. > > > > > > > > > > > > > > > > [1] https://flink.apache.org/ > > > > > > > > [2] https://github.com/apache/incubator-paimon > > > > > > > > [3] https://github.com/apache/flink-statefun > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Best regards, > > > > > > > > > > > > > > > > Zhongqiang Gong > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > Best, > > Hangxiang. > > >
Re: [DISCUSS] Flink Website Menu Adjustment
Hi Martijn, Thank you for your feedback. I agree with your point that we should make a one-time update to the menu, rather than continuously updating it. This will be done unless some sub-projects are moved or archived. Best regards, Zhongqiang Gong Martijn Visser 于2024年3月25日周一 23:35写道： > Hi Zhongqiang Gong, > > Are you suggesting to continuously update the menu based on the number of > releases, or just this one time? I wouldn't be in favor of continuously > updating: returning customers expect a certain order in the menu, and I > don't see a lot of value in continuously changing that. I do think that the > order that you have currently proposed is better then the one we have right > now, so I would +1 a one-time update but not a continuously updating order. > > Best regards, > > Martijn > > On Mon, Mar 25, 2024 at 4:15 PM Yanquan Lv wrote: > > > +1 for this proposal. > > > > gongzhongqiang 于2024年3月25日周一 15:49写道： > > > > > Hi everyone, > > > > > > I'd like to start a discussion on adjusting the Flink website [1] menu > to > > > improve accuracy and usability.While migrating Flink CDC documentation > > > to the website, I found outdated links, need to review and update menus > > > for the most relevant information for our users. > > > > > > > > > Proposal: > > > > > > - Remove Paimon [2] from the "Getting Started" and "Documentation" > menus: > > > Paimon [2] is now an independent top project of ASF. CC： jingsong lees > > > > > > - Sort the projects in the subdirectory by the activity of the > projects. > > > Here I list the number of releases for each project in the past year. > > > > > > Flink Kubernetes Operator : 7 > > > Flink CDC : 5 > > > Flink ML : 2 > > > Flink Stateful Functions : 1 > > > > > > > > > Expected Outcome : > > > > > > - Menu "Getting Started" > > > > > > Before: > > > > > > With Flink > > > > > > With Flink Stateful Functions > > > > > > With Flink ML > > > > > > With Flink Kubernetes Operator > > > > > > With Paimon(incubating) (formerly Flink Table Store) > > > > > > With Flink CDC > > > > > > Training Course > > > > > > > > > After: > > > > > > With Flink > > > With Flink Kubernetes Operator > > > > > > With Flink CDC > > > > > > With Flink ML > > > > > > With Flink Stateful Functions > > > > > > Training Course > > > > > > > > > - Menu "Documentation" will same with "Getting Started" > > > > > > > > > I look forward to hearing your thoughts and suggestions on this > proposal. > > > > > > [1] https://flink.apache.org/ > > > [2] https://github.com/apache/incubator-paimon > > > [3] https://github.com/apache/flink-statefun > > > > > > > > > > > > Best regards, > > > > > > Zhongqiang Gong > > > > > >
[DISCUSS] Flink Website Menu Adjustment
Hi everyone, I'd like to start a discussion on adjusting the Flink website [1] menu to improve accuracy and usability.While migrating Flink CDC documentation to the website, I found outdated links, need to review and update menus for the most relevant information for our users. Proposal: - Remove Paimon [2] from the "Getting Started" and "Documentation" menus: Paimon [2] is now an independent top project of ASF. CC： jingsong lees - Sort the projects in the subdirectory by the activity of the projects. Here I list the number of releases for each project in the past year. Flink Kubernetes Operator : 7 Flink CDC : 5 Flink ML : 2 Flink Stateful Functions : 1 Expected Outcome : - Menu "Getting Started" Before: With Flink With Flink Stateful Functions With Flink ML With Flink Kubernetes Operator With Paimon(incubating) (formerly Flink Table Store) With Flink CDC Training Course After: With Flink With Flink Kubernetes Operator With Flink CDC With Flink ML With Flink Stateful Functions Training Course - Menu "Documentation" will same with "Getting Started" I look forward to hearing your thoughts and suggestions on this proposal. [1] https://flink.apache.org/ [2] https://github.com/apache/incubator-paimon [3] https://github.com/apache/flink-statefun Best regards, Zhongqiang Gong
Re: [VOTE] FLIP-402: Extend ZooKeeper Curator configurations
+1 (non-binding) Best, Zhongqiang Gong Alex Nitavsky 于2024年3月7日周四 23:09写道： > Hi everyone, > > I'd like to start a vote on FLIP-402 [1]. It introduces new configuration > options for Apache Flink's ZooKeeper integration for high availability by > reflecting existing Apache Curator configuration options. It has been > discussed in this thread [2]. > > I would like to start a vote. The vote will be open for at least 72 hours > (until March 10th 18:00 GMT) unless there is an objection or > insufficient votes. > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-402%3A+Extend+ZooKeeper+Curator+configurations > [2] https://lists.apache.org/thread/gqgs2jlq6bmg211gqtgdn8q5hp5v9l1z > > Thanks > Alex >
Re: [VOTE] FLIP-439: Externalize Kudu Connector from Bahir
+1 (non-binding) Bests, Zhongqiang Gong Ferenc Csaky 于2024年3月20日周三 22:11写道： > Hello devs, > > I would like to start a vote about FLIP-439 [1]. The FLIP is about to > externalize the Kudu > connector from the recently retired Apache Bahir project [2] to keep it > maintainable and > make it up to date as well. Discussion thread [3]. > > The vote will be open for at least 72 hours (until 2024 March 23 14:03 > UTC) unless there > are any objections or insufficient votes. > > Thanks, > Ferenc > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-439%3A+Externalize+Kudu+Connector+from+Bahir > [2] https://attic.apache.org/projects/bahir.html > [3] https://lists.apache.org/thread/oydhcfkco2kqp4hdd1glzy5vkw131rkz
Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed
Congrattulations! Thanks for the great work! Best, Zhongqiang Gong Leonard Xu 于2024年3月20日周三 21:36写道： > Hi devs and users, > > We are thrilled to announce that the donation of Flink CDC as a > sub-project of Apache Flink has completed. We invite you to explore the new > resources available: > > - GitHub Repository: https://github.com/apache/flink-cdc > - Flink CDC Documentation: > https://nightlies.apache.org/flink/flink-cdc-docs-stable > > After Flink community accepted this donation[1], we have completed > software copyright signing, code repo migration, code cleanup, website > migration, CI migration and github issues migration etc. > Here I am particularly grateful to Hang Ruan, Zhongqaing Gong, Qingsheng > Ren, Jiabao Sun, LvYanquan, loserwang1024 and other contributors for their > contributions and help during this process！ > > > For all previous contributors: The contribution process has slightly > changed to align with the main Flink project. To report bugs or suggest new > features, please open tickets > Apache Jira (https://issues.apache.org/jira). Note that we will no > longer accept GitHub issues for these purposes. > > > Welcome to explore the new repository and documentation. Your feedback and > contributions are invaluable as we continue to improve Flink CDC. > > Thanks everyone for your support and happy exploring Flink CDC! > > Best， > Leonard > [1] https://lists.apache.org/thread/cw29fhsp99243yfo95xrkw82s5s418ob > >
Re: [VOTE] FLIP-436: Introduce Catalog-related Syntax
+1 (non-binding) Best, Zhongqiang Gong Yubin Li 于2024年3月19日周二 18:03写道： > Hi everyone, > > Thanks for all the feedback, I'd like to start a vote on the FLIP-436: > Introduce Catalog-related Syntax [1]. The discussion thread is here > [2]. > > The vote will be open for at least 72 hours unless there is an > objection or insufficient votes. > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-436%3A+Introduce+Catalog-related+Syntax > [2] https://lists.apache.org/thread/10k1bjb4sngyjwhmfqfky28lyoo7sv0z > > Best regards, > Yubin >
Re: [ANNOUNCE] Apache Flink 1.19.0 released
Congrats! Thanks to everyone involved! Best, Zhongqiang Gong Lincoln Lee 于2024年3月18日周一 16:27写道： > The Apache Flink community is very happy to announce the release of Apache > Flink 1.19.0, which is the fisrt release for the Apache Flink 1.19 series. > > Apache Flink® is an open-source stream processing framework for > distributed, high-performing, always-available, and accurate data streaming > applications. > > The release is available for download at: > https://flink.apache.org/downloads.html > > Please check out the release blog post for an overview of the improvements > for this bugfix release: > > https://flink.apache.org/2024/03/18/announcing-the-release-of-apache-flink-1.19/ > > The full release notes are available in Jira: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12353282 > > We would like to thank all contributors of the Apache Flink community who > made this release possible! > > > Best, > Yun, Jing, Martijn and Lincoln >
Re: [VOTE] Release 1.19.0, release candidate #2
+1 (non-binding) - Verified no binary files in source code - Verified signature and checksum - Build source code and run a simple job successfully - Reviewed the release announcement PR Best, Zhongqiang Gong Ferenc Csaky 于2024年3月14日周四 20:07写道： > +1 (non-binding) > > - Verified checksum and signature > - Verified no binary in src > - Built from src > - Reviewed release note PR > - Reviewed web PR > - Tested a simple datagen query and insert to blackhole sink via SQL > Gateway > > Best, > Ferenc > > > > > On Thursday, March 14th, 2024 at 12:14, Jane Chan > wrote: > > > > > > > Hi Lincoln, > > > > Thank you for the prompt response and the effort to provide clarity on > this > > matter. > > > > Best, > > Jane > > > > On Thu, Mar 14, 2024 at 6:02 PM Lincoln Lee lincoln.8...@gmail.com > wrote: > > > > > Hi Jane, > > > > > > Thank you for raising this question. I saw the discussion in the Jira > > > (include Matthias' point) > > > and sought advice from several PMCs (including the previous RMs), the > > > majority of people > > > are in favor of merging the bugfix into the release branch even during > the > > > release candidate > > > (RC) voting period, so we should accept all bugfixes (unless there is a > > > specific community > > > rule preventing it). > > > > > > Thanks again for contributing to the community! > > > > > > Best, > > > Lincoln Lee > > > > > > Matthias Pohl matthias.p...@aiven.io.invalid 于2024年3月14日周四 17:50写道： > > > > > > > Update on FLINK-34227 [1] which I mentioned above: Chesnay helped > > > > identify > > > > a concurrency issue in the JobMaster shutdown logic which seems to > be in > > > > the code for quite some time. I created a PR fixing the issue hoping > that > > > > the test instability is resolved with it. > > > > > > > > The concurrency issue doesn't really explain why it only started to > > > > appear > > > > recently in a specific CI setup (GHA with AdaptiveScheduler). There > is no > > > > hint in the git history indicating that it's caused by some newly > > > > introduced change. That is why I wouldn't make FLINK-34227 a reason > to > > > > cancel rc2. Instead, the fix can be provided in subsequent patch > > > > releases. > > > > > > > > Matthias > > > > > > > > [1] https://issues.apache.org/jira/browse/FLINK-34227 > > > > > > > > On Thu, Mar 14, 2024 at 8:49 AM Jane Chan qingyue@gmail.com > wrote: > > > > > > > > > Hi Yun, Jing, Martijn and Lincoln, > > > > > > > > > > I'm seeking guidance on whether merging the bugfix[1][2] at this > stage > > > > > is > > > > > appropriate. I want to ensure that the actions align with the > current > > > > > release process and do not disrupt the ongoing preparations. > > > > > > > > > > [1] https://issues.apache.org/jira/browse/FLINK-29114 > > > > > [2] https://github.com/apache/flink/pull/24492 > > > > > > > > > > Best, > > > > > Jane > > > > > > > > > > On Thu, Mar 14, 2024 at 1:33 PM Yun Tang myas...@live.com wrote: > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > * > > > > > > Verified the signature and checksum. > > > > > > * > > > > > > Reviewed the release note PR > > > > > > * > > > > > > Reviewed the web announcement PR > > > > > > * > > > > > > Start a standalone cluster to submit the state machine example, > which > > > > > > works well. > > > > > > * > > > > > > Checked the pre-built jars are generated via JDK8 > > > > > > * > > > > > > Verified the process profiler works well after setting > > > > > > rest.profiling.enabled: true > > > > > > > > > > > > Best > > > > > > Yun Tang > > > > > > > > > > > > > > > > > > From: Qingsheng Ren re...@apache.org > > > > > > Sent: Wednesday, March 13, 2024 12:45 > > > > > > To: dev@flink.apache.org dev@flink.apache.org > > > > > > Subject: Re: [VOTE] Release 1.19.0, release candidate #2 > > > > > > > > > > > > +1 (binding) > > > > > > > > > > > > - Verified signature and checksum > > > > > > - Verified no binary in source > > > > > > - Built from source > > > > > > - Tested reading and writing Kafka with SQL client and Kafka > > > > > > connector > > > > > > 3.1.0 > > > > > > - Verified source code tag > > > > > > - Reviewed release note > > > > > > - Reviewed web PR > > > > > > > > > > > > Thanks to all release managers and contributors for the awesome > work! > > > > > > > > > > > > Best, > > > > > > Qingsheng > > > > > > > > > > > > On Wed, Mar 13, 2024 at 1:23 AM Matthias Pohl > > > > > > matthias.p...@aiven.io.invalid wrote: > > > > > > > > > > > > > I want to share an update on FLINK-34227 [1]: It's still not > clear > > > > > > > what's > > > > > > > causing the test instability. So far, we agreed in today's > release > > > > > > > sync > > > > > > > [2] > > > > > > > that it's not considered a blocker because it is observed in > 1.18 > > > > > > > nightly > > > > > > > builds and it only appears in the GitHub Actions workflow. But > I > > > > > > > still > > > > > > > have > > > > > > > a bit of a concern that this is
Re: [DISCUSS] FLIP-436: Introduce "SHOW CREATE CATALOG" Syntax
Hi, Yubin. Thanks for leading the discussion. +1 for the FLIP. Best, Zhongqiang Gong Ferenc Csaky 于2024年3月14日周四 18:58写道： > Hi Yubin, > > Thank you for initiating this discussion! +1 for the proposal. > > I also think it makes sense to group the missing catalog related > SQL syntaxes under this FLIP. > > Looking forward to these features! > > Best, > Ferenc > > > > > On Thursday, March 14th, 2024 at 08:31, Jane Chan > wrote: > > > > > > > Hi Yubin, > > > > Thanks for leading the discussion. I'm +1 for the FLIP. > > > > As Jark said, it's a good opportunity to enhance the syntax for Catalog > > from a more comprehensive perspective. So, I suggest expanding the scope > of > > this FLIP by focusing on the mechanism instead of one use case to enhance > > the overall functionality. WDYT? > > > > Best, > > Jane > > > > On Thu, Mar 14, 2024 at 11:38 AM Hang Ruan ruanhang1...@gmail.com wrote: > > > > > Hi, Yubin. > > > > > > Thanks for the FLIP. +1 for it. > > > > > > Best, > > > Hang > > > > > > Yubin Li lyb5...@gmail.com 于2024年3月14日周四 10:15写道： > > > > > > > Hi Jingsong, Feng, and Jeyhun > > > > > > > > Thanks for your support and feedback! > > > > > > > > > However, could we add a new method `getCatalogDescriptor()` to > > > > > CatalogManager instead of directly exposing CatalogStore? > > > > > > > > Good point, Besides the audit tracking issue, The proposed feature > > > > only requires `getCatalogDescriptor()` function. Exposing components > > > > with excessive functionality will bring unnecessary risks, I have > made > > > > modifications in the FLIP doc [1]. Thank Feng :) > > > > > > > > > Showing the SQL parser implementation in the FLIP for the SQL > syntax > > > > > might be a bit confusing. Also, the formal definition is missing > for > > > > > this SQL clause. > > > > > > > > Thank Jeyhun for pointing it out :) I have updated the doc [1] . > > > > > > > > [1] > > > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=296290756 > > > > > > > Best, > > > > Yubin > > > > > > > > On Thu, Mar 14, 2024 at 2:18 AM Jeyhun Karimov je.kari...@gmail.com > > > > wrote: > > > > > > > > > Hi Yubin, > > > > > > > > > > Thanks for the proposal. +1 for it. > > > > > I have one comment: > > > > > > > > > > I would like to see the SQL syntax for the proposed statement. > Showing > > > > > the > > > > > SQL parser implementation in the FLIP > > > > > for the SQL syntax might be a bit confusing. Also, the formal > > > > > definition > > > > > is > > > > > missing for this SQL clause. > > > > > Maybe something like [1] might be useful. WDYT? > > > > > > > > > > Regards, > > > > > Jeyhun > > > > > > > > > > [1] > > > > > > > https://github.com/apache/flink/blob/0da60ca1a4754f858cf7c52dd4f0c97ae0e1b0cb/docs/content/docs/dev/table/sql/show.md?plain=1#L620-L632 > > > > > > > > On Wed, Mar 13, 2024 at 3:28 PM Feng Jin jinfeng1...@gmail.com > > > > > wrote: > > > > > > > > > > > Hi Yubin > > > > > > > > > > > > Thank you for initiating this FLIP. > > > > > > > > > > > > I have just one minor question: > > > > > > > > > > > > I noticed that we added a new function `getCatalogStore` to > expose > > > > > > CatalogStore, and it seems fine. > > > > > > However, could we add a new method `getCatalogDescriptor()` to > > > > > > CatalogManager instead of directly exposing CatalogStore? > > > > > > By only providing the `getCatalogDescriptor()` interface, it may > be > > > > > > easier > > > > > > for us to implement audit tracking in CatalogManager in the > future. > > > > > > WDYT ? > > > > > > Although we have only collected some modified events at the > > > > > > moment.[1] > > > > > > > > > > > > [1]. > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-294%3A+Support+Customized+Catalog+Modification+Listener > > > > > > > > > Best, > > > > > > Feng > > > > > > > > > > > > On Wed, Mar 13, 2024 at 5:31 PM Jingsong Li > jingsongl...@gmail.com > > > > > > wrote: > > > > > > > > > > > > > +1 for this. > > > > > > > > > > > > > > We are missing a series of catalog related syntaxes. > > > > > > > Especially after the introduction of catalog store. [1] > > > > > > > > > > > > > > [1] > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-295%3A+Support+lazy+initialization+of+catalogs+and+persistence+of+catalog+configurations > > > > > > > > > > Best, > > > > > > > Jingsong > > > > > > > > > > > > > > On Wed, Mar 13, 2024 at 5:09 PM Yubin Li lyb5...@gmail.com > > > > > > > wrote: > > > > > > > > > > > > > > > Hi devs, > > > > > > > > > > > > > > > > I'd like to start a discussion about FLIP-436: Introduce > "SHOW > > > > > > > > CREATE > > > > > > > > CATALOG" Syntax [1]. > > > > > > > > > > > > > > > > At present, the `SHOW CREATE TABLE` statement provides strong > > > > > > > > support > > > > > > > > for > > > > > > > > users to easily > > > > > > > > reuse created tables. However, despite the increasing > importance > > > > > > > > of the > > > > > > > > `Catalog` in user's > > >
Re: [VOTE] Release flink-connector-parent 1.1.0 release candidate #2
+1 (non-binding) - checksum and signature are good - github tag exist - build success on Ubuntu 22.04 with jdk8 - no binaries in source - reviewed web pr Best, Zhongqiang Gong Etienne Chauchot 于2024年2月20日周二 01:34写道： > Hi everyone, > Please review and vote on the release candidate #2 for the version > 1.1.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > > The complete staging area is available for your review, which includes: > * JIRA release notes [1], > * the official Apache source release to be deployed to dist.apache.org > [2], which are signed with the key with fingerprint > D1A76BA19D6294DD0033F6843A019F0B8DD163EA [3], > * all artifacts to be deployed to the Maven Central Repository [4], > * source code tag v1.1.0-rc2 [5], > * website pull request listing the new release [6]. > > * confluence wiki: connector parent upgrade to version 1.1.0 that will > be validated after the artifact is released (there is no PR mechanism on > the wiki) [7] > > > The vote will be open for at least 72 hours. It is adopted by majority > approval, with at least 3 PMC affirmative votes. > > Thanks, > Etienne > > [1] > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12353442 > [2] > > https://dist.apache.org/repos/dist/dev/flink/flink-connector-parent-1.1.0-rc2 > [3] https://dist.apache.org/repos/dist/release/flink/KEYS > [4] https://repository.apache.org/content/repositories/orgapacheflink-1707 > [5] > > https://github.com/apache/flink-connector-shared-utils/releases/tag/v1.1.0-rc2 > > [6] https://github.com/apache/flink-web/pull/717 > > [7] > > https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development >
Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun
Congratulations, Jiabao! Best, Zhongqiang Gong Qingsheng Ren 于2024年2月19日周一 17:53写道： > Hi everyone, > > On behalf of the PMC, I'm happy to announce Jiabao Sun as a new Flink > Committer. > > Jiabao began contributing in August 2022 and has contributed 60+ commits > for Flink main repo and various connectors. His most notable contribution > is being the core author and maintainer of MongoDB connector, which is > fully functional in DataStream and Table/SQL APIs. Jiabao is also the > author of FLIP-377 and the main contributor of JUnit 5 migration in runtime > and table planner modules. > > Beyond his technical contributions, Jiabao is an active member of our > community, participating in the mailing list and consistently volunteering > for release verifications and code reviews with enthusiasm. > > Please join me in congratulating Jiabao for becoming an Apache Flink > committer! > > Best, > Qingsheng (on behalf of the Flink PMC) >
Re: [VOTE] Release flink-connector-mongodb v1.1.0, release candidate #2
+1(non-binding) - Signatures and Checksums are good - No binaries in the source archive - Tag is present - Build successful with jdk8 on ubuntu 22.04 Leonard Xu 于2024年1月30日周二 18:23写道： > Hey all, > > Please help review and vote on the release candidate #2 for the version > v1.1.0 of the > Apache Flink MongoDB Connector as follows: > > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > The complete staging area is available for your review, which includes: > * JIRA release notes [1], > * The official Apache source release to be deployed to dist.apache.org > [2], > which are signed with the key with fingerprint > 5B2F6608732389AEB67331F5B197E1F1108998AD [3], > * All artifacts to be deployed to the Maven Central Repository [4], > * Source code tag v1.1.0-rc2 [5], > * Website pull request listing the new release [6]. > > The vote will be open for at least 72 hours. It is adopted by majority > approval, with at least 3 PMC affirmative votes. > > > Best, > Leonard > [1] > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12353483 > [2] > https://dist.apache.org/repos/dist/dev/flink/flink-connector-mongodb-1.1.0-rc2/ > [3] https://dist.apache.org/repos/dist/release/flink/KEYS > [4] > https://repository.apache.org/content/repositories/orgapacheflink-1705/ > [5] https://github.com/apache/flink-connector-mongodb/tree/v1.1.0-rc2 > [6] https://github.com/apache/flink-web/pull/719
Re: [VOTE] Accept Flink CDC into Apache Flink
+1 non-binding Best, Zhongqiang Leonard Xu 于2024年1月9日周二 15:05写道： > Hello all, > > This is the official vote whether to accept the Flink CDC code contribution > to Apache Flink. > > The current Flink CDC code, documentation, and website can be > found here: > code: https://github.com/ververica/flink-cdc-connectors < > https://github.com/ververica/flink-cdc-connectors> > docs: https://ververica.github.io/flink-cdc-connectors/ < > https://ververica.github.io/flink-cdc-connectors/> > > This vote should capture whether the Apache Flink community is interested > in accepting, maintaining, and evolving Flink CDC. > > Regarding my original proposal[1] in the dev mailing list, I firmly believe > that this initiative aligns perfectly with Flink. For the Flink community, > it represents an opportunity to bolster Flink's competitive edge in > streaming > data integration, fostering the robust growth and prosperity of the Apache > Flink > ecosystem. For the Flink CDC project, becoming a sub-project of Apache > Flink > means becoming an integral part of a neutral open-source community, > capable of > attracting a more diverse pool of contributors. > > All Flink CDC maintainers are dedicated to continuously contributing to > achieve > seamless integration with Flink. Additionally, PMC members like Jark, > Qingsheng, > and I are willing to infacilitate the expansion of contributors and > committers to > effectively maintain this new sub-project. > > This is a "Adoption of a new Codebase" vote as per the Flink bylaws [2]. > Only PMC votes are binding. The vote will be open at least 7 days > (excluding weekends), meaning until Thursday January 18 12:00 UTC, or > until we > achieve the 2/3rd majority. We will follow the instructions in the Flink > Bylaws > in the case of insufficient active binding voters: > > > 1. Wait until the minimum length of the voting passes. > > 2. Publicly reach out via personal email to the remaining binding voters > in the > voting mail thread for at least 2 attempts with at least 7 days between > two attempts. > > 3. If the binding voter being contacted still failed to respond after > all the attempts, > the binding voter will be considered as inactive for the purpose of this > particular voting. > > Welcome voting ! > > Best, > Leonard > [1] https://lists.apache.org/thread/o7klnbsotmmql999bnwmdgo56b6kxx9l > [2] > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=120731026
Re: [VOTE] Release 1.18.1, release candidate #2
Thanks Jing Ge for driving this release. +1 (non-binding), I have checked: [✓] The checksums and signatures are validated [✓] The tag checked is fine [✓] Built from source is passed [✓] The flink-web PR is reviewed and checked Best， Zhongqiang Gong
Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink
It's very exciting to hear the news. +1 for adding CDC Connectors to Apache Flink ! Best, Zhongqiang Leonard Xu 于2023年12月7日周四 11:25写道： > Dear Flink devs, > > > As you may have heard, we at Alibaba (Ververica) are planning to donate CDC > Connectors for the Apache Flink project > *[1]* to the Apache Flink community. > > > > CDC Connectors for Apache Flink comprise a collection of source connectors > designed specifically for Apache Flink. These connectors > *[2]* > enable the ingestion of changes from various databases using Change Data > Capture (CDC), most of these CDC connectors are powered by Debezium > *[3]* > . They support both the DataStream API and the Table/SQL API, facilitating > the reading of database snapshots and continuous reading of transaction logs > with exactly-once processing, even in the event of failures. > > > > Additionally, in the latest version 3.0, we have introduced many long-awaited > features. Starting from CDC version 3.0, we've built a Streaming ELT > Framework available for streaming data integration. This framework allows > users to write their data synchronization logic in a simple YAML file, which > will automatically be translated into a Flink DataStreaming job. It > emphasizes optimizing the task submission process and offers advanced > functionalities such as whole database synchronization, merging sharded > tables, and schema evolution > *[4]*. > > > > > I believe this initiative is a perfect match for both sides. For the Flink > community, it presents an opportunity to enhance Flink's competitive > advantage in streaming data integration, promoting the healthy growth and > prosperity of the Apache Flink ecosystem. For the CDC Connectors project, > becoming a sub-project of Apache Flink means being part of a neutral > open-source community, which can attract a more diverse pool of contributors. > > > Please note that the aforementioned points represent only some of our > motivations and vision for this donation. Specific future operations need to > be further discussed in this thread. For example, the sub-project name after > the donation; we hope to name it Flink-CDC > aiming to streaming data intergration through Apache Flink, > following the naming convention of Flink-ML; And this project is managed by a > total of 8 maintainers, including 3 Flink PMC members and 1 Flink Committer. > The remaining 4 maintainers are also highly active contributors to the Flink > community, donating this project to the Flink community implies that their > permissions might be reduced. Therefore, we may need to bring up this topic > for further discussion within the Flink PMC. Additionally, we need to discuss > how to migrate existing users and documents. We have a user group of nearly > 10,000 people and a multi-version documentation site need to migrate. We also > need to plan for the migration of CI/CD processes and other specifics. > > > > While there are many intricate details that require implementation, we are > committed to progressing and finalizing this donation process. > > > > Despite being Flink’s most active ecological project (as evaluated by GitHub > metrics), it also boasts a significant user base. However, I believe it's > essential to commence discussions on future operations only after the > community reaches a consensus on whether they desire this donation. > > > Really looking forward to hear what you think! > > > > Best, > Leonard (on behalf of the Flink CDC Connectors project maintainers) > > [1] https://github.com/ververica/flink-cdc-connectors > [2] > https://ververica.github.io/flink-cdc-connectors/master/content/overview/cdc-connectors.html > [3] https://debezium.io > [4] > https://ververica.github.io/flink-cdc-connectors/master/content/overview/cdc-pipeline.html >
