Re: [DISCUSS] FLIP-423 ~FLIP-428: Introduce Disaggregated State Storage and Management in Flink 2.0

2024-03-05 Thread Yanfei Lei
Hi team, Thanks for your discussion. Regarding FLIP-425, we have supplemented several updates to answer high-frequency questions: 1. We captured a flame graph of the Hashmap state backend in "Synchronous execution with asynchronous APIs"[1], which reveals that the framework overhead (including

[jira] [Created] (FLINK-34585) [JUnit5 Migration] Module: Flink CDC

2024-03-05 Thread Hang Ruan (Jira)
Hang Ruan created FLINK-34585: - Summary: [JUnit5 Migration] Module: Flink CDC Key: FLINK-34585 URL: https://issues.apache.org/jira/browse/FLINK-34585 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34584) Change package name to org.apache.flink.cdc

2024-03-05 Thread Hang Ruan (Jira)
Hang Ruan created FLINK-34584: - Summary: Change package name to org.apache.flink.cdc Key: FLINK-34584 URL: https://issues.apache.org/jira/browse/FLINK-34584 Project: Flink Issue Type: Sub-task

Re: [VOTE] Release 1.19.0, release candidate #1

2024-03-05 Thread Yangze Guo
Hi, Lincoln, We are currently addressing the FLINK-34105, where we have encountered an Akka timeout during the TPC-DS benchmarks. We plan to revert the changes made in FLINK-33532, and we anticipate that the corresponding pull request will be ready today. Could you include this patch into the

[ANNOUNCE] Flink 1.19.0 rc1 cancelled & sync summary on 03/05/2024

2024-03-05 Thread Lincoln Lee
Hi devs, As mentioned in the vote thread[1] rc1 has been cancelled due to the incompleteness of python wheel packages(lost 2 newly added py3.11 packages for mac, both 10.9 & 11.0, will be fixed in [2]). If no new blockers, we'll start a new rc soon. Also share some highlights from the release

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread tison
> a rare way different than > individuals (few individuals can donate such resources) Theoretically, if an individual donates so, we list list him/her as well. I've seen such donations in The Perl Foundation like [1]. But since a PMC doesn't have a fundraising office, we may not accept raw money

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread Yun Tang
Thanks for Jark's proposal, and I'm +1 for adding such a page. The CI infrastructure helps the Apache Flink project to run well. I cannot imagine how insufficient CI machines would impact the development progress, especially when the feature freeze date is close. And I believe that most guys

Re: [VOTE] Release 1.19.0, release candidate #1

2024-03-05 Thread Lincoln Lee
Hi everyone, This rc is officially cancelled because of the incompleteness of python wheel packages(lost 2 newly added py3.11 packages for mac, both 10.9 & 11.0, will be fixed in [1]). A new rc will be created. [1] https://issues.apache.org/jira/browse/FLINK-34582 Best, Yun, Jing, Martijn and

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread Yun Tang
Thanks for Jark's proposal, and I'm +1 for adding such a page. The CI infrastructure helps the Apache Flink project to run well. I cannot imagine how insufficient CI machines would impact the development progress, especially when the feature freeze date is close. And I believe that most guys

[jira] [Created] (FLINK-34583) Bug for dynamic table option hints with multiple CTEs

2024-03-05 Thread Xingcan Cui (Jira)
Xingcan Cui created FLINK-34583: --- Summary: Bug for dynamic table option hints with multiple CTEs Key: FLINK-34583 URL: https://issues.apache.org/jira/browse/FLINK-34583 Project: Flink Issue

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread Jark Wu
Hi Max, Thank you for your input. According to ASF policy[1], the Thank Page is intended to thank third parties that provide physical resources like machines, services, and software that the committers or the project truly needs. I agree with Tison, such donation is countable and that's why I

[jira] [Created] (FLINK-34582) release build tools lost the newly added py3.11 packages for mac

2024-03-05 Thread lincoln lee (Jira)
lincoln lee created FLINK-34582: --- Summary: release build tools lost the newly added py3.11 packages for mac Key: FLINK-34582 URL: https://issues.apache.org/jira/browse/FLINK-34582 Project: Flink

[jira] [Created] (FLINK-34581) streaming code throws java.lang.reflect.InaccessibleObjectException

2024-03-05 Thread Henning Schmiedehausen (Jira)
Henning Schmiedehausen created FLINK-34581: -- Summary: streaming code throws java.lang.reflect.InaccessibleObjectException Key: FLINK-34581 URL: https://issues.apache.org/jira/browse/FLINK-34581

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-03-05 Thread Jing Ge
Hi Di, Thanks for your proposal. +1 for the contribution. I'd like to know your thoughts about the following questions: 1. According to your clarification of the exactly-once, thanks for it BTW, no PreCommitTopology is required. Does it make sense to let DorisSink[1] implement SupportsCommitter,

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread tison
Hi Max, Thanks for sharing your concerns :D I'd elaborate a bit on this topic with an example, that Apache Airflow has a small section for its special sponsor who offers machines for CI also [1]. In my understanding, companies employ developers to invest time in the development of Flink and

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread Maximilian Michels
I'm a bit torn on this idea. On the one hand, it makes sense to thank sponsors and entities who have supported Flink in the past. On other hand, this list is bound to be incomplete and maybe also biased, even if not intended to be so. I think the power of open-source comes from the unconditional

[VOTE] Release 1.19.0, release candidate #1

2024-03-05 Thread Lincoln Lee
Hi everyone, Please review and vote on the release candidate #1 for the version 1.19.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread Jingsong Li
+1 for setting up On Tue, Mar 5, 2024 at 5:39 PM Jing Ge wrote: > > +1 and thanks for the proposal! > > Best regards, > Jing > > On Tue, Mar 5, 2024 at 10:26 AM tison wrote: > > > I like this idea, so +1 for setting up. > > > > For anyone who have the access, this is a related thread about > >

[jira] [Created] (FLINK-34580) Job run via REST erases "pipeline.classpaths" config

2024-03-05 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-34580: Summary: Job run via REST erases "pipeline.classpaths" config Key: FLINK-34580 URL: https://issues.apache.org/jira/browse/FLINK-34580 Project: Flink Issue

[jira] [Created] (FLINK-34579) Introduce metric for time since last completed checkpoint

2024-03-05 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34579: -- Summary: Introduce metric for time since last completed checkpoint Key: FLINK-34579 URL: https://issues.apache.org/jira/browse/FLINK-34579 Project: Flink

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-03-05 Thread wudi
Hi, Jeyhun Karimov. Thanks for your question. - How to ensure Exactly-Once? 1. When the Checkpoint Barrier arrives, DorisSink will trigger the precommit api of StreamLoad to complete the persistence of data in Doris (the data will not be visible at this time), and will also pass this TxnID to

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-03-05 Thread wudi
Thanks, Yanquan, Test Plan has been added at the end of FLIP[1]. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-399%3A+Flink+Connector+Doris Brs, di.wu > 2024年3月2日 17:13,Yanquan Lv 写道: > > Thanks for driving this. > The content is very detailed, it is recommended to add a

Re: Temporal join on rolling aggregate

2024-03-05 Thread Gyula Fóra
Hi Everyone! I have discussed this with Sébastien Chevalley, he is going to prepare and drive the FLIP while I will assist him along the way. Thanks Gyula On Tue, Mar 5, 2024 at 9:57 AM wrote: > I do agree with Ron Liu. > This would definitely need a FLIP as it would impact SQL and extend it

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread Jing Ge
+1 and thanks for the proposal! Best regards, Jing On Tue, Mar 5, 2024 at 10:26 AM tison wrote: > I like this idea, so +1 for setting up. > > For anyone who have the access, this is a related thread about > project-wise sponsor in the foundation level [1]. > > Best, > tison. > > [1]

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread tison
I like this idea, so +1 for setting up. For anyone who have the access, this is a related thread about project-wise sponsor in the foundation level [1]. Best, tison. [1] https://lists.apache.org/thread/2nv0x9gfk9lfnpb2315xgywyx84y97v6 Jark Wu 于2024年3月5日周二 17:17写道: > > Sorry, I posted the

Re: [DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread Jark Wu
Sorry, I posted the wrong [7] link. The Flink benchmark ML link is: https://lists.apache.org/thread/bkw6ozoflgltwfwmzjtgx522hyssfko6 On Tue, 5 Mar 2024 at 16:56, Jark Wu wrote: > Hi all, > > > > I want to propose adding a "Special Thanks" page to our Apache Flink website > [1] > > to honor

Re: Temporal join on rolling aggregate

2024-03-05 Thread lorenzo . affetti
I do agree with Ron Liu. This would definitely need a FLIP as it would impact SQL and extend it with the equivalent of TimestampAssigners in the Java API. Is there any existing JIRA here, or is anybody willing to drive a FLIP? On Feb 26, 2024 at 02:36 +0100, Ron liu , wrote: > +1, > But I think

[DISCUSS] Add "Special Thanks" Page on the Flink Website

2024-03-05 Thread Jark Wu
Hi all, I want to propose adding a "Special Thanks" page to our Apache Flink website [1] to honor and appreciate the companies and organizations that have sponsored machines or services for our project. The establishment of such a page serves as a public acknowledgment of our sponsors'

[jira] [Created] (FLINK-34578) Remove issue template

2024-03-05 Thread Zhongqiang Gong (Jira)
Zhongqiang Gong created FLINK-34578: --- Summary: Remove issue template Key: FLINK-34578 URL: https://issues.apache.org/jira/browse/FLINK-34578 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34577) Add IssueNavigationLink for IDEA git log

2024-03-05 Thread Zhongqiang Gong (Jira)
Zhongqiang Gong created FLINK-34577: --- Summary: Add IssueNavigationLink for IDEA git log Key: FLINK-34577 URL: https://issues.apache.org/jira/browse/FLINK-34577 Project: Flink Issue Type: