Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

Congratulations! Best, Guowei On Mon, Apr 1, 2024 at 11:15 AM Feng Jin wrote: > Congratulations! > > Best, > Feng Jin > > On Mon, Apr 1, 2024 at 10:51 AM weijie guo > wrote: > >> Congratulations! >> >> Best regards, >> >> Weijie >> >> >> Hang Ruan 于2024年4月1日周一 09:49写道： >> >> >

Re: [VOTE] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

+1 (binding) Best, Guowei On Tue, Feb 27, 2024 at 10:08 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Tue, Feb 27, 2024 at 9:44 AM weijie guo > wrote: > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Xintong Song 于2024年2月27日周二 09:38写道： > > > >

Re: [VOTE] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

+1 (binding) Best, Guowei On Tue, Feb 27, 2024 at 10:09 AM Xuannan Su wrote: > +1 (non-binding) > > Best, > Xuannan > > On Tue, Feb 27, 2024 at 9:37 AM Xintong Song > wrote: > > > > +1 (binding) > > > > Best, > > > > Xintong > > > > > > > > On Mon, Feb 26, 2024 at 6:10 PM weijie guo > >

Re: [VOTE] FLIP-408: [Umbrella] Introduce DataStream API V2

+1(binding) Best, Guowei On Tue, Feb 27, 2024 at 10:06 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Tue, Feb 27, 2024 at 9:43 AM weijie guo > wrote: > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Xintong Song 于2024年2月27日周二 09:36写道： > > > >

Re: [DISCUSS] FLIP-408: [Umbrella] Introduce DataStream API V2

ery string. > > But for the Table API, it relies on the original DataStream(i.e. DataStream > V1), so the implementation is not decoupled from the API. > > In the future, we will consider building the Table API on top of DataStream > API V2, which solves this problem also. > > > Best

Re: [DISCUSS] FLIP-408: [Umbrella] Introduce DataStream API V2

Hi,weijie Thank you very much to Weijie for proposing this series of improvements, especially the complete decoupling of user interface and implementation. This part is actually a very serious problem that disturbs downstream users in the community. I hope this problem can be completely solved in

Re: [VOTE] Accept Flink CDC into Apache Flink

+1 (binding) Best, Guowei On Tue, Jan 9, 2024 at 4:49 PM Rui Fan <1996fan...@gmail.com> wrote: > +1 (non-binding) > > Best, > Rui > > On Tue, Jan 9, 2024 at 4:41 PM Hang Ruan wrote: > > > +1 (non-binding) > > > > Best, > > Hang > > > > gongzhongqiang 于2024年1月9日周二 16:25写道： > > > > > +1

Re: [DISCUSS] FLIP-383: Support Job Recovery for Batch Jobs

Hi, This is a very good proposal, as far as I know, it can solve some very critical production operations in certain scenarios. I have two minor issues: As far as I know, there are multiple job managers on standby in some scenarios. In this case, is your design still effective? I'm unsure if

Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

+1（binding） Best, Guowei On Wed, Jul 19, 2023 at 11:18 AM Hang Ruan wrote: > +1 (non-binding) > > Thanks for driving. > > Best, > Hang > > Leonard Xu 于2023年7月19日周三 10:42写道： > > > Thanks Dong for the continuous work. > > > > +1(binding) > > > > Best, > > Leonard > > > > > On Jul 18, 2023, at

Re: [VOTE] Apache Flink ML Release 2.2.0, release candidate #2

Hi Dong, Thanks for driving this release! +1 (binding) * Checked JIRA release notes * Verified signature and checksum for the source * Download the source code and build the code with JDK8 * Browsed through README.md files. Best, Guowei On Fri, Apr 14, 2023 at 2:48 PM Zhipeng Zhang wrote:

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

Congratulations! Best, Guowei On Tue, Mar 28, 2023 at 12:02 PM Yuxin Tan wrote: > Congratulations！ > > Best, > Yuxin > > > Guanghui Zhang 于2023年3月28日周二 11:06写道： > >> Congratulations！ >> >> Best, >> Zhang Guanghui >> >> Hang Ruan 于2023年3月28日周二 10:29写道： >> >> > Congratulations! >> > >> >

Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

congratulations Yuxia Best, Guowei On Mon, Mar 13, 2023 at 10:43 AM Junrui Lee wrote: > Congratulations, Yuxia! > > Best, > Junrui > > Yanfei Lei 于2023年3月13日周一 10:42写道： > > > Congratulations, Yuxia! > > > > Best, > > Yanfei > > > > > > Samrat Deb 于2023年3月13日周一 10:41写道： > > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

Congratulations, Anton! Best, Guowei On Tue, Feb 21, 2023 at 1:52 PM Shammon FY wrote: > Congratulations, Anton! > > Best, > Shammon > > On Tue, Feb 21, 2023 at 1:41 PM Sergey Nuyanzin > wrote: > > > Congratulations, Anton! > > > > On Tue, Feb 21, 2023 at 4:53 AM Weihua Hu > wrote: > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

Congratulations, Rui! Best, Guowei On Tue, Feb 21, 2023 at 2:57 PM Wei Zhong wrote: > Congratulations, Rui! > > Best, > Wei > > > 2023年2月21日 下午1:52，Shammon FY 写道： > > > > Congratulations, Rui! > > > > > > Best, > > Shammon > > > > On Tue, Feb 21, 2023 at 1:40 PM Sergey Nuyanzin > wrote: > >

[ANNOUNCE] New Apache Flink PMC Member - Dong Lin

Hi, everyone On behalf of the PMC, I'm very happy to announce Dong Lin as a new Flink PMC. Dong is currently the main driver of Flink ML. He reviewed a large number of Flink ML related PRs and also participated in many Flink ML improvements, such as "FLIP-173","FLIP-174" etc. At the same

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

Congratulations! Best, Guowei On Tue, Feb 14, 2023 at 5:11 PM Leonard Xu wrote: > Congratulations!! Jing > > Best, > Leonard > > > On Feb 14, 2023, at 4:33 PM, Hang Ruan wrote: > > > > Congratulations Jing! > > > > Shammon FY 于2023年2月14日周二 16:04写道： > > > >> Congratulations Jing! > >> > >>

Re: Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

Congratulations!!! Weijie Best, Guowei On Tue, Feb 14, 2023 at 1:49 PM Dian Fu wrote: > Congratulations, Weijie! > > Regards, > Dian > > On Mon, Feb 13, 2023 at 10:55 PM Matthias Pohl > wrote: > > > Congrats, Weijie! :-) > > > > On Mon, Feb 13, 2023 at 10:50 AM Sergey Nuyanzin > > wrote: >

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

Congratulations, Lincoln! Best, Guowei On Tue, Jan 10, 2023 at 2:57 PM Biao Geng wrote: > Congrats, Lincoln! > Best, > Biao Geng > > 获取 Outlook for iOS > > 发件人: Wencong Liu > 发送时间: Tuesday, January 10, 2023 2:39:47 PM > 收件人:

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

Hi, Thank you very much for driving this FLIP in order to improve user usability. I understand that a key goal of this FLIP is to adjust the memory requirements of shuffle to a more reasonable range. Through this adaptive range adjustment, the memory efficiency can be improved under the premise

Re: [ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer

Congratulations Danny! Best, Guowei On Tue, Nov 1, 2022 at 2:20 PM weijie guo wrote: > Congratulations Danny! > > Best regards, > > Weijie > > > Maximilian Michels 于2022年10月13日周四 21:41写道： > > > Congratulations Danny! Well deserved :) > > > > -Max > > > > On Thu, Oct 13, 2022 at 2:40 PM Yang

Re: [ANNOUNCE] New Apache Flink Committer - Junhan Yang

Congratulations, Junhan! Best, Guowei On Fri, Aug 19, 2022 at 6:01 AM Jing Ge wrote: > Congrats Junhan! > > Best regards, > Jing > > On Thu, Aug 18, 2022 at 12:05 PM Jark Wu wrote: > > > Congrats and welcome Junhan! > > > > Cheers, > > Jark > > > > > 2022年8月18日 17:59，Timo Walther 写道： > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Lijie Wang

Congratulations, Lijie. Welcome on board~! Best, Guowei On Wed, Aug 17, 2022 at 6:25 PM Zhu Zhu wrote: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Lijie Wang as > a new Flink committer. > > Lijie has been contributing to Flink project for more than 2 years. > He mainly

Re: [VOTE] FLIP-245: Source Supports Speculative Execution For Batch Job

+1 (binding) Best, Guowei On Tue, Jul 5, 2022 at 12:38 PM Jiangang Liu wrote: > +1 for the feature. > > Jing Zhang 于2022年7月5日周二 11:43写道： > > > Hi all, > > > > I'd like to start a vote for FLIP-245: Source Supports Speculative > > Execution For Batch Job[1] on the discussion thread [2]. > > >

Re: [DISCUSS] FLIP-245: Source Supports Speculative Execution For Batch Job

Hi, Jing Thanks a lot for writing this FLIP, which is very useful to Batch users. Currently I have only two small questions: 1. First of all, please complete the fault-tolerant processing flow in the FLIP. (Maybe you've already considered it, but it's better to explicitly give the specific

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

Congrats, Jingsong! Best, Guowei On Thu, Jun 16, 2022 at 9:49 AM Hangxiang Yu wrote: > Congrats, Jingsong! > > Best, > Hangxiang > > On Thu, Jun 16, 2022 at 9:46 AM Aitozi wrote: > > > Congrats, Jingsong! > > > > Best, > > Aitozi > > > > Zhuoluo Yang 于2022年6月16日周四 09:26写道： > > > > > Many

Re: [VOTE] FLIP-168: Speculative Execution for Batch Job

+1 (binding) Best, Guowei On Fri, May 27, 2022 at 12:41 AM Shqiprim Bunjaku wrote: > +1 (non-binding) > > Best Regards > Shqiprim > > On Thu, May 26, 2022 at 6:22 PM rui fan <1996fan...@gmail.com> wrote: > > > Hi > > > > +1(non-binding), it’s very useful for batch job stability. > > > > Best

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations！ Best, Guowei On Thu, May 5, 2022 at 9:01 PM Jiangang Liu wrote: > Congratulations! > > Best > Liu Jiangang > > Marios Trivyzas 于2022年5月5日周四 20:47写道： > > > Congrats Yang! > > > > On Thu, May 5, 2022, 15:29 Yuan Mei wrote: > > > > > Congrats and well Deserved, Yang! > > > > >

Re: [DISCUSS] FLIP-217 Support watermark alignment of source splits

Hi, We know that in the case of Bounded input Flink supports the Batch execution mode. Currently in Batch execution mode, flink is executed on a stage-by-stage basis. In this way, perhaps watermark alignment might not gain much. So my question is: Is watermark alignment the default behavior(for

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Hi, Yun Great job! Thank you very much for your efforts to release Flink-1.15 during this time. Thanks also to all the contributors who worked on this release! Best, Guowei On Thu, May 5, 2022 at 3:24 PM Peter Schrott wrote: > Great! > > Will install it on the cluster asap! :) > > One thing

Re: Failed Unit Test on Master Branch

Hi Haizhou I ran the test and there is no problem. And commit is "d940af688be90c92ce4f8b9ca883f6753c94aa0f" Best, Guowei On Fri, Apr 29, 2022 at 5:39 AM Haizhou Zhao wrote: > Hello Flink Community, > > I was encountering some unit test failure in the flink-avro sub-module when > I tried to

Re: Re: [DISCUSS] FLIP-168: Speculative execution for Batch Job

Hi, zhu Many thanks to zhuzhu for initiating the FLIP discussion. Overall I think it's ok, I just have 3 small questions 1. How to judge whether the Execution Vertex belongs to a slow task. The current calculation method is: the current timestamp minus the timestamp of the execution deployment.

[jira] [Created] (FLINK-27406) After canceling the job, it is falsely reported as a job failure.

Guowei Ma created FLINK-27406: - Summary: After canceling the job, it is falsely reported as a job failure. Key: FLINK-27406 URL: https://issues.apache.org/jira/browse/FLINK-27406 Project: Flink

Re: Re: [VOTE] Release 1.15.0, release candidate #4

+1 (binding) 1. Build from the source 2. Verify the checksums and signatures 3. Start a local standalone cluster 4. Submit a streaming example job and stop it on the ui. 5. Submit a job running with batch mode. Best, Guowei On Tue, Apr 26, 2022 at 10:56 AM Zhu Zhu wrote: > +1 (binding) > -

Re: [VOTE] Release 1.15.0, release candidate #3

+1(binding) - Verified the signature and checksum of the release binary - Run the SqlClient example - Run the WordCount example - Compile from the source and success Best, Guowei On Mon, Apr 18, 2022 at 11:13 AM Xintong Song wrote: > +1 (binding) > > - verified signature and checksum > -

Re: [ANNOUNCE] New scalafmt formatter has been merged

Hi, Francesco Thanks for your work! Best, Guowei On Wed, Apr 13, 2022 at 5:35 PM Dian Fu wrote: > Thanks a lot for this great work Francesco! > > Regards, > Dian > > On Wed, Apr 13, 2022 at 3:23 PM Marios Trivyzas wrote: > > > Thank you for this Francesco! > > > > It will really improve the

Re: [ANNOUNCE] New Apache Flink Committer - Martijn Visser

Congrats Martijn! Best, Guowei On Fri, Mar 11, 2022 at 10:36 PM Marios Trivyzas wrote: > Congrats Martijn!! > > Best, > Marios > > On Thu, Mar 10, 2022 at 4:50 PM yu'an huang wrote: > > > Congrats, Martijn! > > > > > > Best > > Yuan > > > > > > > On 3 Mar 2022, at 11:49 PM, Robert Metzger >

Re: Re: Change of focus

Thanks Till for everything you've done for the community! It has been a great honor working with you. Best, Guowei On Tue, Mar 1, 2022 at 9:26 PM Marios Trivyzas wrote: > Good luck in your future endeavours Till !! > > Best regards, > Marios > > On Tue, Mar 1, 2022 at 8:10 AM Steven Wu

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

Congratulations Best, Guowei On Thu, Feb 17, 2022 at 3:29 PM Yang Wang wrote: > Congratulations to all of you! > > Best, > Yang > > Lijie Wang 于2022年2月17日周四 14:20写道： > > > Congratulations to all of you! > > > > Best, > > Lijie > > > > Leonard Xu 于2022年2月17日周四 12:13写道： > > > > >

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

Congratulations to Feng and Zhipeng! Best, Guowei On Thu, Feb 17, 2022 at 3:30 PM Yang Wang wrote: > Congratulations! > > Best, > Yang > > Lijie Wang 于2022年2月17日周四 14:21写道： > > > Congratulations to all of you! > > > > Best, > > Lijie > > > > Zakelly Lan 于2022年2月17日周四 12:21写道： > > > > >

Re: Request for Flink 1.12.8 release

gt; Regards, > Suchithra > > -----Original Message- > From: Guowei Ma > Sent: Thursday, January 20, 2022 11:26 AM > To: dev > Subject: Re: Request for Flink 1.12.8 release > > Hi Suchithra > > I don't think there is a plan to release 1.12.7 for this. But I think y

Re: Request for Flink 1.12.8 release

Hi Suchithra I don't think there is a plan to release 1.12.7 for this. But I think you could build it from the source.[1] [1] https://github.com/apache/flink/tree/release-1.12#building-apache-flink-from-source Best, Guowei On Wed, Jan 19, 2022 at 7:11 PM V N, Suchithra (Nokia - IN/Bangalore)

Re: [VOTE] FLIP-199: Change some default config values of blocking shuffle for better usability

+1（binding） Best, Guowei On Wed, Jan 12, 2022 at 3:44 PM Jingsong Li wrote: > +1 Thanks Yingjie for driving. > > Best, > Jingsong Lee > > On Wed, Jan 12, 2022 at 3:16 PM 刘建刚 wrote: > > > > +1 for the proposal. In fact, we have used these params in our inner > flink > > version for good

Re: [VOTE] FLIP-191: Extend unified Sink interface to support small file compaction

+1(binding). Thank you for driving this Best, Guowei On Wed, Jan 5, 2022 at 5:15 AM Arvid Heise wrote: > +1 (binding). > > Thanks for driving! > > On Tue, Jan 4, 2022 at 10:31 AM Yun Gao > wrote: > > > +1 (binding). > > > > Very thanks for proposing the FLIP! > > > > Best, > > Yun > > > > > >

[ANNOUNCE] New Apache Flink Committer - Yingjie Cao

Hi everyone, On behalf of the PMC, I'm very happy to announce Yingjie Cao as a new Flink committer. Yingjie has submitted 88 PRs since he joined the Flink community for more than 2 years. In general, his main contributions are concentrated in Flink's Shuffle. Yingjie has done a lot of work in

Re: Re: [DISCUSS] Improve the name and structure of job vertex and operator name for job

+1 This would be very helpful for our debugging online job. Best, Guowei On Thu, Nov 11, 2021 at 8:03 PM Yuepeng Pan wrote: > +1. It's useful to understand the job topology. > Looking forward to this feature. > Best, > Yuepeng Pan. > > > > > > > At 2021-11-11 19:44:44, "Yangze Guo" wrote: >

Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler

Thanks for your excellent FLIP! +1 binding Lijie Wang 于2021年11月8日 周一下午2:53写道： > Hi all, > > I would like to start the vote for FLIP-187[1], which proposes to introduce > a new scheduler to Flink: adaptive batch job scheduler. The new scheduler > can automatically decide parallelisms of job

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

Hi, Very thanks Fabian for drafting this FLIP! It looks very good to me. I see currently most of us agree with option 2, but I personally feel that option 3 may be better :-) I have some small concerns for option 2 1. Developers understand that the cost is relatively high. The merging of small

Re: [Discuss] Planning Flink 1.15

Thanks for volunteering as our release managers Till, Yun and Joe! +1 for feature freeze on 2.6 ,which is more convenient for us to plan 1.15 related work. Best, Guowei On Thu, Oct 28, 2021 at 12:01 PM Xintong Song wrote: > Thanks for kicking this off, Joe. > > +1 for Till, Yun and Joe as

Re: [VOTE] FLIP-176: Unified Iteration to Support Algorithms (Flink ML)

+1 (binding) Best, Guowei On Thu, Oct 21, 2021 at 3:58 PM Yun Gao wrote: > > Hi all, > > We would like to start the vote for FLIP-176: Unified Iteration to Support > Algorithms (Flink ML) [1]. > This FLIP was discussed in this thread [2][3]. The FLIP-176 targets at > implementing the

Re: [NOTICE] CiBot improvements

Thanks for your effort! Best, Guowei On Mon, Oct 11, 2021 at 9:26 PM Stephan Ewen wrote: > Great initiative, thanks for doing this! > > On Mon, Oct 11, 2021 at 10:52 AM Till Rohrmann > wrote: > > > Thanks a lot for this effort Chesnay! The improvements sound really good. > > > > Cheers, > >

Re: Create a public open GitHub org for Flink ecosystem projects.

Hi, Becket Thank you very much for promoting this work. After 1.14 is released, we have plans to open source Remote Shuffle Service for Flink. If we have this, we can put it there. Best, Guowei On Thu, Sep 23, 2021 at 4:07 PM Martijn Visser wrote: > Hi all, > > Thanks Becket for the

Re: [DISCUSS] FLIP-177: Extend Sink API

> PutRecords call. Depending how often that happens, this could add up. > > Does that make sense? > > Cheers, Steffen > > > On 30.07.21, 05:51, "Guowei Ma" wrote: > > CAUTION: This email originated from outside of the organization. Do > not cl

Re: [VOTE] FLIP-177: Extend Sink API

+1(binding) Best, Guowei On Mon, Aug 2, 2021 at 4:04 PM Danny Cranmer wrote: > +1 (binding) > > On Mon, Aug 2, 2021 at 12:42 AM Thomas Weise wrote: > > > +1 (binding) > > > > > > On Fri, Jul 30, 2021 at 5:05 AM Arvid Heise wrote: > > > > > Hi all, > > > > > > I'd like to start a vote on

Re: [DISCUSS] FLIP-177: Extend Sink API

> > checkpoint lock). > > > > Having said that, I haven't spent too much time thinking about whether > it's > > better to enrich AsyncIO or provide the AsyncSink. If we can just as > > efficiently provide the same functionality using the existing/enhanced > &g

Re: [DISCUSS] FLIP-177: Extend Sink API

Now it sends the request out. At the same time, > the next 500 elements are collected. So the in-flight query size refers to > the number of parallel requets (500 elements each). > If we first batch 500*numberOfInFlightRequests, and then send out all > numberOfInFlightRequests at the same tim

Re: [DISCUSS] FLIP-177: Extend Sink API

e.org/confluence/display/FLINK/FLIP-171%3A+Async+Sink > [2] > https://github.com/sthm/flink/blob/51614dc9371d6e352db768a404ba3cafddad08f0/flink-connectors/flink-connector-kinesis-171/src/main/java/software/amazon/flink/connectors/AmazonKinesisDataStreamSink.java > > On Tue, Jul 20, 2021

Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

- > > > > >>>>> From:Piotr Nowojski > > > > >>>>> Send Time:2021 Jul. 16 (Fri.) 13:48 > > > > >>>>> To:dev > > > > >>>>> Cc:Yun Gao > > > &g

Re: [DISCUSS] FLIP-177: Extend Sink API

afddad08f0/flink-connectors/flink-connector-kinesis-171/src/main/java/software/amazon/flink/connectors/AmazonKinesisDataStreamSink.java > > On Tue, Jul 20, 2021 at 11:11 AM Guowei Ma wrote: > > > Hi, Avrid > > Thank you Avrid for perfecting Sink through this FLIP. I have two little > &g

Re: [DISCUSS] FLIP-177: Extend Sink API

Hi, Avrid Thank you Avrid for perfecting Sink through this FLIP. I have two little questions 1. What do you think of us directly providing an interface as follows? In this way, there may be no need to expose the Mailbox to the user. We can implement an `AsyncSinkWriterOperator` to control the

Re: [DISCUSS] FLIP-171: Async Sink

Hi, I'm very sorry to participate in this discussion so late. But I have a little question. I understand the goal of this FLIP is to make `Writer` support asynchronous. But my question is: why not let `Committer` support asynchronization? If only `Writer` supports asynchronization, ExactlyOnce is

Re: [VOTE] FLIP-184: Refine ShuffleMaster lifecycle management for pluggable shuffle service framework

+1(binding) Best, Guowei On Fri, Jul 16, 2021 at 5:36 PM Yingjie Cao wrote: > Hi all, > > I'd like to start a vote on FLIP-184 [1] which was > discussed in [2] [3]. The vote will be open for at least 72 hours > until 7.21 unless there is an objection. > > [1] > >

Re: [DISCUSS] Lifecycle of ShuffleMaster and its Relationship with JobMaster and PartitionTracker

Hi, Thank Yingjie for initiating this discussion. What I understand that the document[1] actually mainly discusses two issues: 1. ShuffleMaster should be at the cluster level instead of the job level 2. ShuffleMaster should notify PartitionTracker that some data has been lost Relatively speaking,

Re: [VOTE] FLIP-147: Support Checkpoint After Tasks Finished

+1 (binding) Best, Guowei On Fri, Jul 2, 2021 at 11:56 AM Leonard Xu wrote: > +1, > > This may help https://issues.apache.org/jira/browse/FLINK-22764 < > https://issues.apache.org/jira/browse/FLINK-22764> > > Best, > Leonard > > > 在 2021年7月2日，10:17，JING ZHANG 写道： > > > > +1 (binding) > > > >

Re: Got multiple issues when running the tutorial project "table-walkthrough" on IDEA

Hi, Lingfeng These job errors you posted happened when the job(`SpendReport`) was running on the IDE? According to my understanding, this document[1] & repository[2] mean that the example is to be run in docker, not in IDE. [1]

Re: [DISCUSS] Limit size of already processed files in File Source SplitEnumerator

It would really simplify a lot if the modification timestamp of each newly scanned file is increased. We only need to record the file list corresponding to the largest timestamp. Timestamp of each scanned file 1. It is smaller than the maximum timestamp, which means it has been processed;

[jira] [Created] (FLINK-22779) KafkaChangelogTableITCase.testKafkaDebeziumChangelogSource fail due to ConcurrentModificationException

Guowei Ma created FLINK-22779: - Summary: KafkaChangelogTableITCase.testKafkaDebeziumChangelogSource fail due to ConcurrentModificationException Key: FLINK-22779 URL: https://issues.apache.org/jira/browse/FLINK-22779

[jira] [Created] (FLINK-22775) CassandraConnectorITCase.testCassandraTableSink Fail

Guowei Ma created FLINK-22775: - Summary: CassandraConnectorITCase.testCassandraTableSink Fail Key: FLINK-22775 URL: https://issues.apache.org/jira/browse/FLINK-22775 Project: Flink Issue Type

[jira] [Created] (FLINK-22756) DispatcherTest.testJobStatusIsShownDuringTermination fail

Guowei Ma created FLINK-22756: - Summary: DispatcherTest.testJobStatusIsShownDuringTermination fail Key: FLINK-22756 URL: https://issues.apache.org/jira/browse/FLINK-22756 Project: Flink Issue

[jira] [Created] (FLINK-22755) SequenceStreamingFileSinkITCase.testWriteSequenceFile fail

Guowei Ma created FLINK-22755: - Summary: SequenceStreamingFileSinkITCase.testWriteSequenceFile fail Key: FLINK-22755 URL: https://issues.apache.org/jira/browse/FLINK-22755 Project: Flink Issue

[jira] [Created] (FLINK-22739) CassandraSinkBaseTest.testTimeoutExceptionOnInvoke fail due to TestTimedOutException

Guowei Ma created FLINK-22739: - Summary: CassandraSinkBaseTest.testTimeoutExceptionOnInvoke fail due to TestTimedOutException Key: FLINK-22739 URL: https://issues.apache.org/jira/browse/FLINK-22739

[jira] [Created] (FLINK-22738) org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 900 seconds due to block on downloading docker image

Guowei Ma created FLINK-22738: - Summary: org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 900 seconds due to block on downloading docker image Key: FLINK-22738 URL: https

[jira] [Created] (FLINK-22735) HiveTableSourceITCase.testStreamPartitionReadByCreateTime failed because of times out

Guowei Ma created FLINK-22735: - Summary: HiveTableSourceITCase.testStreamPartitionReadByCreateTime failed because of times out Key: FLINK-22735 URL: https://issues.apache.org/jira/browse/FLINK-22735

[jira] [Created] (FLINK-22720) UpsertKafkaTableITCase.testAggregate fail due to ConcurrentModificationException

Guowei Ma created FLINK-22720: - Summary: UpsertKafkaTableITCase.testAggregate fail due to ConcurrentModificationException Key: FLINK-22720 URL: https://issues.apache.org/jira/browse/FLINK-22720 Project

[jira] [Created] (FLINK-22710) ParquetProtoStreamingFileSinkITCase.testParquetProtoWriters failed

Guowei Ma created FLINK-22710: - Summary: ParquetProtoStreamingFileSinkITCase.testParquetProtoWriters failed Key: FLINK-22710 URL: https://issues.apache.org/jira/browse/FLINK-22710 Project: Flink

[jira] [Created] (FLINK-22705) SQL Client end-to-end test (Old planner) Elasticsearch (v7.5.1) failed due to fail to download the tar

Guowei Ma created FLINK-22705: - Summary: SQL Client end-to-end test (Old planner) Elasticsearch (v7.5.1) failed due to fail to download the tar Key: FLINK-22705 URL: https://issues.apache.org/jira/browse/FLINK-22705

[jira] [Created] (FLINK-22704) ZooKeeperHaServicesTest.testCleanupJobData failed

Guowei Ma created FLINK-22704: - Summary: ZooKeeperHaServicesTest.testCleanupJobData failed Key: FLINK-22704 URL: https://issues.apache.org/jira/browse/FLINK-22704 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22703) SavepointITCase.testTriggerSavepointAndResumeWithFileBasedCheckpoints failed

Guowei Ma created FLINK-22703: - Summary: SavepointITCase.testTriggerSavepointAndResumeWithFileBasedCheckpoints failed Key: FLINK-22703 URL: https://issues.apache.org/jira/browse/FLINK-22703 Project

[jira] [Created] (FLINK-22702) KafkaSourceITCase.testRedundantParallelism failed

Guowei Ma created FLINK-22702: - Summary: KafkaSourceITCase.testRedundantParallelism failed Key: FLINK-22702 URL: https://issues.apache.org/jira/browse/FLINK-22702 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22662) YARNHighAvailabilityITCase.testKillYarnSessionClusterEntrypoint fail

Guowei Ma created FLINK-22662: - Summary: YARNHighAvailabilityITCase.testKillYarnSessionClusterEntrypoint fail Key: FLINK-22662 URL: https://issues.apache.org/jira/browse/FLINK-22662 Project: Flink

[jira] [Created] (FLINK-22613) FlinkKinesisITCase.testStopWithSavepoint fails

Guowei Ma created FLINK-22613: - Summary: FlinkKinesisITCase.testStopWithSavepoint fails Key: FLINK-22613 URL: https://issues.apache.org/jira/browse/FLINK-22613 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22548) UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fail due to IllegalReferenceCountException

Guowei Ma created FLINK-22548: - Summary: UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fail due to IllegalReferenceCountException Key: FLINK-22548 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-22547) OperatorCoordinatorHolderTest. verifyCheckpointEventOrderWhenCheckpointFutureCompletesLate fail

Guowei Ma created FLINK-22547: - Summary: OperatorCoordinatorHolderTest. verifyCheckpointEventOrderWhenCheckpointFutureCompletesLate fail Key: FLINK-22547 URL: https://issues.apache.org/jira/browse/FLINK-22547

[jira] [Created] (FLINK-22546) testKafkaSourceSinkWithKeyAndFullValue failed

Guowei Ma created FLINK-22546: - Summary: testKafkaSourceSinkWithKeyAndFullValue failed Key: FLINK-22546 URL: https://issues.apache.org/jira/browse/FLINK-22546 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22545) JVM crashes when runing OperatorEventSendingCheckpointITCase.testOperatorEventAckLost

Guowei Ma created FLINK-22545: - Summary: JVM crashes when runing OperatorEventSendingCheckpointITCase.testOperatorEventAckLost Key: FLINK-22545 URL: https://issues.apache.org/jira/browse/FLINK-22545

[jira] [Created] (FLINK-22520) KafkaSourceLegacyITCase.testMultipleSourcesOnePartition hangs

Guowei Ma created FLINK-22520: - Summary: KafkaSourceLegacyITCase.testMultipleSourcesOnePartition hangs Key: FLINK-22520 URL: https://issues.apache.org/jira/browse/FLINK-22520 Project: Flink

Re: [VOTE] Release 1.13.0, release candidate #2

Hi, Matthias Thank you very much for your careful inspection. I check the flink-python_2.11-1.13.0.jar and we do not bundle org.conscrypt:conscrypt-openjdk-uber:2.5.1 to it. So I think we may not need to add this to the NOTICE file. (BTW The jar's scope is runtime) Best, Guowei On Thu, Apr 29,

[jira] [Created] (FLINK-22496) ClusterEntrypointTest.testCloseAsyncShouldBeExecutedInShutdownHook failed

Guowei Ma created FLINK-22496: - Summary: ClusterEntrypointTest.testCloseAsyncShouldBeExecutedInShutdownHook failed Key: FLINK-22496 URL: https://issues.apache.org/jira/browse/FLINK-22496 Project: Flink

[jira] [Created] (FLINK-22466) KafkaSourceLegacyITCase.testOneToOneSources fail because the OperatorEvent lost

Guowei Ma created FLINK-22466: - Summary: KafkaSourceLegacyITCase.testOneToOneSources fail because the OperatorEvent lost Key: FLINK-22466 URL: https://issues.apache.org/jira/browse/FLINK-22466 Project

[jira] [Created] (FLINK-22465) KafkaSourceITCase.testValueOnlyDeserializer hangs

Guowei Ma created FLINK-22465: - Summary: KafkaSourceITCase.testValueOnlyDeserializer hangs Key: FLINK-22465 URL: https://issues.apache.org/jira/browse/FLINK-22465 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22462) JdbcExactlyOnceSinkE2eTest.testInsert failed because of too many clients.

Guowei Ma created FLINK-22462: - Summary: JdbcExactlyOnceSinkE2eTest.testInsert failed because of too many clients. Key: FLINK-22462 URL: https://issues.apache.org/jira/browse/FLINK-22462 Project: Flink

[jira] [Created] (FLINK-22457) KafkaSourceLegacyITCase.testMultipleSourcesOnePartition fails because of timeout

Guowei Ma created FLINK-22457: - Summary: KafkaSourceLegacyITCase.testMultipleSourcesOnePartition fails because of timeout Key: FLINK-22457 URL: https://issues.apache.org/jira/browse/FLINK-22457 Project

[jira] [Created] (FLINK-22440) UpsertKafkaTableITCase fail due to create topic timeout

Guowei Ma created FLINK-22440: - Summary: UpsertKafkaTableITCase fail due to create topic timeout Key: FLINK-22440 URL: https://issues.apache.org/jira/browse/FLINK-22440 Project: Flink Issue Type

[jira] [Created] (FLINK-22439) UnalignedCheckpointITCase hangs

Guowei Ma created FLINK-22439: - Summary: UnalignedCheckpointITCase hangs Key: FLINK-22439 URL: https://issues.apache.org/jira/browse/FLINK-22439 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22420) UnalignedCheckpointITCase failed

Guowei Ma created FLINK-22420: - Summary: UnalignedCheckpointITCase failed Key: FLINK-22420 URL: https://issues.apache.org/jira/browse/FLINK-22420 Project: Flink Issue Type: Bug

Re: Re: Re: [ANNOUNCE] New Apache Flink Committer - Rui Li

Congratulations, Rui! Best, Guowei On Fri, Apr 23, 2021 at 10:38 AM Yun Tang wrote: > Congratulations, Rui! > > Best, > Yun Tang > > From: Xuannan Su > Sent: Friday, April 23, 2021 10:01 > To: dev@flink.apache.org ; matth...@ververica.com < >

[jira] [Created] (FLINK-22363) Python test pipeline failed because of failure of downloading deps.

Guowei Ma created FLINK-22363: - Summary: Python test pipeline failed because of failure of downloading deps. Key: FLINK-22363 URL: https://issues.apache.org/jira/browse/FLINK-22363 Project: Flink

[VOTE] Release 1.13.0, release candidate #1

Hi everyone, Currently there are still some on-going efforts for 1.13.0. However we think the current state is stable enough for the community to test. The earlier the test, the more time we can fix unexpected issues if there is any. We also cut out the release-1.13 branch, so any fix needs to

[jira] [Created] (FLINK-22333) Elasticsearch7DynamicSinkITCase.testWritingDocuments fail due to deploy task timeout.

Guowei Ma created FLINK-22333: - Summary: Elasticsearch7DynamicSinkITCase.testWritingDocuments fail due to deploy task timeout. Key: FLINK-22333 URL: https://issues.apache.org/jira/browse/FLINK-22333

[jira] [Created] (FLINK-22332) ConnectedComponentsWithObjectMapITCase.testJobWithoutObjectReuse due to NPE when calling "notifyDataAvailable"

Guowei Ma created FLINK-22332: - Summary: ConnectedComponentsWithObjectMapITCase.testJobWithoutObjectReuse due to NPE when calling "notifyDataAvailable" Key: FLINK-22332 URL: https://issues.apache.org/j

[jira] [Created] (FLINK-22312) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents due to the heartbeat exception with Yarn RM

Guowei Ma created FLINK-22312: - Summary: YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents due to the heartbeat exception with Yarn RM Key: FLINK-22312 URL: https://issues.apache.

  1   2   3   4   >