Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Zili Chen
Congrats Hequn! Best, tison. Jeff Zhang 于2019年8月7日周三 下午5:14写道: > Congrats Hequn! > > Paul Lam 于2019年8月7日周三 下午5:08写道: > >> Congrats Hequn! Well deserved! >> >> Best, >> Paul Lam >> >> 在 2019年8月7日,16:28,jincheng sun 写道: >> >> Hi everyone, >> >> I'm very happy to announce that Hequn accepted

Re: [DISCUSS] Flink project bylaws

2019-08-07 Thread Becket Qin
Thanks Stephan. I think we have resolved all the comments on the wiki page. There are two minor changes made to the bylaws since last week. 1. For 2/3 majority, the required attempts to reach out to binding voters is reduced from 3 to 2. This helps shorten the voting process a little bit. 2.

[jira] [Created] (FLINK-13613) Update migration tests for Flink 1.9

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13613: - Summary: Update migration tests for Flink 1.9 Key: FLINK-13613 URL: https://issues.apache.org/jira/browse/FLINK-13613 Project: Flink Issue Type: Task

[ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread jincheng sun
Hi everyone, I'm very happy to announce that Hequn accepted the offer of the Flink PMC to become a committer of the Flink project. Hequn has been contributing to Flink for many years, mainly working on SQL/Table API features. He's also frequently helping out on the user mailing lists and helping

[jira] [Created] (FLINK-13610) Refactor HiveTableSource Test use sql query and remove HiveInputFormatTest

2019-08-07 Thread Terry Wang (JIRA)
Terry Wang created FLINK-13610: -- Summary: Refactor HiveTableSource Test use sql query and remove HiveInputFormatTest Key: FLINK-13610 URL: https://issues.apache.org/jira/browse/FLINK-13610 Project:

[jira] [Created] (FLINK-13607) TPC-H end-to-end test (Blink planner) failed on Travis

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13607: - Summary: TPC-H end-to-end test (Blink planner) failed on Travis Key: FLINK-13607 URL: https://issues.apache.org/jira/browse/FLINK-13607 Project: Flink

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Paul Lam
Congrats Hequn! Well deserved! Best, Paul Lam > 在 2019年8月7日,16:28,jincheng sun 写道: > > Hi everyone, > > I'm very happy to announce that Hequn accepted the offer of the Flink PMC to > become a committer of the Flink project. > > Hequn has been contributing to Flink for many years, mainly

[jira] [Created] (FLINK-13612) 高并发初始化FlinkKafkaProducer011时StateDescriptor加载报错NPE

2019-08-07 Thread weiyunqing (JIRA)
weiyunqing created FLINK-13612: -- Summary: 高并发初始化FlinkKafkaProducer011时StateDescriptor加载报错NPE Key: FLINK-13612 URL: https://issues.apache.org/jira/browse/FLINK-13612 Project: Flink Issue Type:

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Till Rohrmann
Congrats Hequn and welcome onboard as a committer :-) Cheers, Till On Wed, Aug 7, 2019 at 11:30 AM Becket Qin wrote: > Congrats, Hequn! Well deserved! > > On Wed, Aug 7, 2019 at 11:16 AM Zili Chen wrote: > >> Congrats Hequn! >> >> Best, >> tison. >> >> >> Jeff Zhang 于2019年8月7日周三 下午5:14写道: >>

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Dian Fu
Congratulations, Hequn! Well deserved! > 在 2019年8月7日,下午5:13,Jeff Zhang 写道: > > Congrats Hequn! > > Paul Lam mailto:paullin3...@gmail.com>> 于2019年8月7日周三 > 下午5:08写道: > Congrats Hequn! Well deserved! > > Best, > Paul Lam > >> 在 2019年8月7日,16:28,jincheng sun > >

[jira] [Created] (FLINK-13605) AsyncDataStreamITCase. testUnorderedWait failed on Travis

2019-08-07 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-13605: -- Summary: AsyncDataStreamITCase. testUnorderedWait failed on Travis Key: FLINK-13605 URL: https://issues.apache.org/jira/browse/FLINK-13605 Project: Flink

[jira] [Created] (FLINK-13611) Introduce analyze statistic utility to generate table & column statistics

2019-08-07 Thread godfrey he (JIRA)
godfrey he created FLINK-13611: -- Summary: Introduce analyze statistic utility to generate table & column statistics Key: FLINK-13611 URL: https://issues.apache.org/jira/browse/FLINK-13611 Project: Flink

[jira] [Created] (FLINK-13609) StreamingFileSink - reset part counter on bucket change

2019-08-07 Thread Joao Boto (JIRA)
Joao Boto created FLINK-13609: - Summary: StreamingFileSink - reset part counter on bucket change Key: FLINK-13609 URL: https://issues.apache.org/jira/browse/FLINK-13609 Project: Flink Issue

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Jeff Zhang
Congrats Hequn! Paul Lam 于2019年8月7日周三 下午5:08写道: > Congrats Hequn! Well deserved! > > Best, > Paul Lam > > 在 2019年8月7日,16:28,jincheng sun 写道: > > Hi everyone, > > I'm very happy to announce that Hequn accepted the offer of the Flink PMC > to become a committer of the Flink project. > > Hequn

[jira] [Created] (FLINK-13608) Update upgrade compatibility table (docs/ops/upgrading.md) for 1.9.0

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13608: - Summary: Update upgrade compatibility table (docs/ops/upgrading.md) for 1.9.0 Key: FLINK-13608 URL: https://issues.apache.org/jira/browse/FLINK-13608 Project:

[jira] [Created] (FLINK-13606) PrometheusReporterEndToEndITCase.testReporter unstable on Travis

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13606: - Summary: PrometheusReporterEndToEndITCase.testReporter unstable on Travis Key: FLINK-13606 URL: https://issues.apache.org/jira/browse/FLINK-13606 Project: Flink

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Becket Qin
Congrats, Hequn! Well deserved! On Wed, Aug 7, 2019 at 11:16 AM Zili Chen wrote: > Congrats Hequn! > > Best, > tison. > > > Jeff Zhang 于2019年8月7日周三 下午5:14写道: > >> Congrats Hequn! >> >> Paul Lam 于2019年8月7日周三 下午5:08写道: >> >>> Congrats Hequn! Well deserved! >>> >>> Best, >>> Paul Lam >>> >>> 在

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Zhu Zhu
Congratulations to Hequn! Thanks, Zhu Zhu Zili Chen 于2019年8月7日周三 下午5:16写道: > Congrats Hequn! > > Best, > tison. > > > Jeff Zhang 于2019年8月7日周三 下午5:14写道: > >> Congrats Hequn! >> >> Paul Lam 于2019年8月7日周三 下午5:08写道: >> >>> Congrats Hequn! Well deserved! >>> >>> Best, >>> Paul Lam >>> >>> 在

Re: Suspicious watermark of operators after restore from checkpoint

2019-08-07 Thread Kostas Kloudas
Hi Jan, Two pointers that may help you explain the behavior are the following: 1) If you have a custom watermark generator, I do not think that Flink checks if it emits only monotonically increasing watermarks. This is the responsibility of the generator itself. This means that although you

Re: Suspicious watermark of operators after restore from checkpoint

2019-08-07 Thread Jan Lukavský
Hi Kostas, thanks for reaction, comments inline. On 8/7/19 1:59 PM, Kostas Kloudas wrote: Hi Jan, Two pointers that may help you explain the behavior are the following: 1) If you have a custom watermark generator, I do not think that Flink checks if it emits only monotonically increasing

[jira] [Created] (FLINK-13634) StreamingFileSink - allow bulkwriter to compress data

2019-08-07 Thread Joao Boto (JIRA)
Joao Boto created FLINK-13634: - Summary: StreamingFileSink - allow bulkwriter to compress data Key: FLINK-13634 URL: https://issues.apache.org/jira/browse/FLINK-13634 Project: Flink Issue Type:

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

2019-08-07 Thread Tzu-Li (Gordon) Tai
Hi all, According to the 1.9.x burndown board [1], we're approaching a releasable state for 1.9.0. Thanks to everyone who participated in the work for fixing the blockers so far, especially Till who has been coordinating a lot of the efforts. Below is a summary of the current state of the few

Re: Suspicious watermark of operators after restore from checkpoint

2019-08-07 Thread Jan Lukavský
Code would be a little complicated, because it is wrapped with several layers of other APIs (Beam being one of them, but there is also other layer). I can provide the job graph [1]  a screenshot of the two watermarks [2]. The watermarks are taken from the two operators on bottom left.

[jira] [Created] (FLINK-13619) Update FlinkKafkaProducerMigrationOperatorTest to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13619: - Summary: Update FlinkKafkaProducerMigrationOperatorTest to restore from 1.9 savepoint Key: FLINK-13619 URL: https://issues.apache.org/jira/browse/FLINK-13619

[jira] [Created] (FLINK-13614) Add MigrationVersion.v1_9

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13614: - Summary: Add MigrationVersion.v1_9 Key: FLINK-13614 URL: https://issues.apache.org/jira/browse/FLINK-13614 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-13615) Update CEPMigrationTest to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13615: - Summary: Update CEPMigrationTest to restore from 1.9 savepoint Key: FLINK-13615 URL: https://issues.apache.org/jira/browse/FLINK-13615 Project: Flink

[jira] [Created] (FLINK-13618) Update FlinkKafkaConsumerBaseMigrationTest to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13618: - Summary: Update FlinkKafkaConsumerBaseMigrationTest to restore from 1.9 savepoint Key: FLINK-13618 URL: https://issues.apache.org/jira/browse/FLINK-13618 Project:

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Biao Liu
Congrats Hequn! Thanks, Biao /'bɪ.aʊ/ On Wed, Aug 7, 2019 at 6:00 PM Zhu Zhu wrote: > Congratulations to Hequn! > > Thanks, > Zhu Zhu > > Zili Chen 于2019年8月7日周三 下午5:16写道: > >> Congrats Hequn! >> >> Best, >> tison. >> >> >> Jeff Zhang 于2019年8月7日周三 下午5:14写道: >> >>> Congrats Hequn! >>> >>>

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-08-07 Thread Robert Metzger
Hi all, I've now merged the guide to the Flink website: https://flink.apache.org/contributing/code-style-and-quality-preamble.html I'm looking forward to more pull requests enhancing the guide. On Tue, Jul 23, 2019 at 7:22 PM Hugo Louro wrote: > Sounds good @stephan! Thanks. > > On Tue, Jul

Re: Suspicious watermark of operators after restore from checkpoint

2019-08-07 Thread Kostas Kloudas
But are they chained together? Could you provide the code from your job, at least until operator A? On Wed, Aug 7, 2019 at 3:03 PM Jan Lukavský wrote: > Actually, operator A is intermediate, source is preceding it. > > On 8/7/19 2:44 PM, Kostas Kloudas wrote: > > Hi Jan, > > > > After looking

[jira] [Created] (FLINK-13622) Update WindowOperatorMigrationTest to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13622: - Summary: Update WindowOperatorMigrationTest to restore from 1.9 savepoint Key: FLINK-13622 URL: https://issues.apache.org/jira/browse/FLINK-13622 Project: Flink

[jira] [Created] (FLINK-13621) Update ContinuousFileProcessingMigrationTest to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13621: - Summary: Update ContinuousFileProcessingMigrationTest to restore from 1.9 savepoint Key: FLINK-13621 URL: https://issues.apache.org/jira/browse/FLINK-13621

[jira] [Created] (FLINK-13620) Update FlinkKafkaProducerMigrationTest to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13620: - Summary: Update FlinkKafkaProducerMigrationTest to restore from 1.9 savepoint Key: FLINK-13620 URL: https://issues.apache.org/jira/browse/FLINK-13620 Project:

[jira] [Created] (FLINK-13616) Update BucketingSinkMigrationTest to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13616: - Summary: Update BucketingSinkMigrationTest to restore from 1.9 savepoint Key: FLINK-13616 URL: https://issues.apache.org/jira/browse/FLINK-13616 Project: Flink

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread JingsongLee
Congrats Hequn! Best, Jingsong Lee -- From:Biao Liu Send Time:2019年8月7日(星期三) 12:05 To:Zhu Zhu Cc:Zili Chen ; Jeff Zhang ; Paul Lam ; jincheng sun ; dev ; user Subject:Re: [ANNOUNCE] Hequn becomes a Flink committer Congrats

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Fabian Hueske
Congratulations Hequn! Am Mi., 7. Aug. 2019 um 14:50 Uhr schrieb Robert Metzger < rmetz...@apache.org>: > Congratulations! > > On Wed, Aug 7, 2019 at 1:09 PM highfei2...@126.com > wrote: > > > Congrats Hequn! > > > > Best, > > Jeff Yang > > > > > > Original Message > >

[jira] [Created] (FLINK-13617) Update FlinkKafkaProducer011MigrationTest to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13617: - Summary: Update FlinkKafkaProducer011MigrationTest to restore from 1.9 savepoint Key: FLINK-13617 URL: https://issues.apache.org/jira/browse/FLINK-13617 Project:

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Kurt Young
Congrats Hequn! Best, Kurt On Wed, Aug 7, 2019 at 5:06 PM jincheng sun wrote: > Hi everyone, > > I'm very happy to announce that Hequn accepted the offer of the Flink PMC > to become a committer of the Flink project. > > Hequn has been contributing to Flink for many years, mainly working on >

[DISCUSS] Repository split

2019-08-07 Thread Chesnay Schepler
Hello everyone, The Flink project sees an ever-increasing amount of dev activity, both in terms of reworked and new features. This is of course an excellent situation to be in, but we are getting to a point where the associate downsides are becoming increasingly troublesome. The ever

[jira] [Created] (FLINK-13635) Unexpectedly interrupted in AsyncFunction#timeout

2019-08-07 Thread Biao Liu (JIRA)
Biao Liu created FLINK-13635: Summary: Unexpectedly interrupted in AsyncFunction#timeout Key: FLINK-13635 URL: https://issues.apache.org/jira/browse/FLINK-13635 Project: Flink Issue Type:

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Wei Zhong
Congratulations, Hequn! Best, Wei Zhong > 在 2019年8月7日,17:15,Zili Chen 写道: > > Congrats Hequn! > > Best, > tison. > > > Jeff Zhang mailto:zjf...@gmail.com>> 于2019年8月7日周三 下午5:14写道: > Congrats Hequn! > > Paul Lam mailto:paullin3...@gmail.com>> 于2019年8月7日周三 > 下午5:08写道: > Congrats Hequn! Well

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Robert Metzger
Congratulations! On Wed, Aug 7, 2019 at 1:09 PM highfei2...@126.com wrote: > Congrats Hequn! > > Best, > Jeff Yang > > > Original Message > Subject: Re: [ANNOUNCE] Hequn becomes a Flink committer > From: Piotr Nowojski > To: JingsongLee > CC: Biao Liu ,Zhu Zhu ,Zili Chen ,Jeff

[DISCUSS] FLIP-49: Unified Memory Configuration for TaskExecutors

2019-08-07 Thread Xintong Song
Hi everyone, We would like to start a discussion thread on "FLIP-49: Unified Memory Configuration for TaskExecutors"[1], where we describe how to improve TaskExecutor memory configurations. The FLIP document is mostly based on an early design "Memory Management and Configuration Reloaded"[2] by

[jira] [Created] (FLINK-13629) Update AbstractNonKeyedOperatorRestoreTestBase to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13629: - Summary: Update AbstractNonKeyedOperatorRestoreTestBase to restore from 1.9 savepoint Key: FLINK-13629 URL: https://issues.apache.org/jira/browse/FLINK-13629

[jira] [Created] (FLINK-13627) Update TypeSerializerSnapshotMigrationITCase to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13627: - Summary: Update TypeSerializerSnapshotMigrationITCase to restore from 1.9 savepoint Key: FLINK-13627 URL: https://issues.apache.org/jira/browse/FLINK-13627

[jira] [Created] (FLINK-13628) Update AbstractKeyedOperatorRestoreTestBase to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13628: - Summary: Update AbstractKeyedOperatorRestoreTestBase to restore from 1.9 savepoint Key: FLINK-13628 URL: https://issues.apache.org/jira/browse/FLINK-13628 Project:

[jira] [Created] (FLINK-13632) Update TypeSerializerUpgradeTestBase to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13632: - Summary: Update TypeSerializerUpgradeTestBase to restore from 1.9 savepoint Key: FLINK-13632 URL: https://issues.apache.org/jira/browse/FLINK-13632 Project: Flink

Re: Suspicious watermark of operators after restore from checkpoint

2019-08-07 Thread Kostas Kloudas
Hi Jan, I am not sure what is happening. Operator A does not seem to be chained to the source (which produces the watermarks) so the check about increasing watermarks should be also applied there. BTW, I assume that bottom left you mean the one that starts with "activeDevices:takePresent..." (Op.

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread vino yang
Congratulations! highfei2...@126.com 于2019年8月7日周三 下午7:09写道: > Congrats Hequn! > > Best, > Jeff Yang > > > Original Message > Subject: Re: [ANNOUNCE] Hequn becomes a Flink committer > From: Piotr Nowojski > To: JingsongLee > CC: Biao Liu ,Zhu Zhu ,Zili Chen ,Jeff Zhang ,Paul

[jira] [Created] (FLINK-13626) Update StatefulJobWBroadcastStateMigrationITCase to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13626: - Summary: Update StatefulJobWBroadcastStateMigrationITCase to restore from 1.9 savepoint Key: FLINK-13626 URL: https://issues.apache.org/jira/browse/FLINK-13626

[jira] [Created] (FLINK-13625) Update StatefulJobSavepointMigrationITCase to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13625: - Summary: Update StatefulJobSavepointMigrationITCase to restore from 1.9 savepoint Key: FLINK-13625 URL: https://issues.apache.org/jira/browse/FLINK-13625 Project:

[jira] [Created] (FLINK-13623) Update StatefulJobSavepointMigrationITCase to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13623: - Summary: Update StatefulJobSavepointMigrationITCase to restore from 1.9 savepoint Key: FLINK-13623 URL: https://issues.apache.org/jira/browse/FLINK-13623 Project:

[jira] [Created] (FLINK-13624) Update StatefulJobWBroadcastStateMigrationITCase to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13624: - Summary: Update StatefulJobWBroadcastStateMigrationITCase to restore from 1.9 savepoint Key: FLINK-13624 URL: https://issues.apache.org/jira/browse/FLINK-13624

Suspicious watermark of operators after restore from checkpoint

2019-08-07 Thread Jan Lukavský
Hi all, I have just come across a weird state of operators after restore from checkpoint. After the restore, two operators that are connected (i.e. operator A is input of operator B) ended up with watermark of operator A being less than watermark of operator B. I don't know how to explain

[jira] [Created] (FLINK-13633) Move submittedJobGraph and completedCheckpoint to cluster-id subdirectory of high-availability storage

2019-08-07 Thread Yang Wang (JIRA)
Yang Wang created FLINK-13633: - Summary: Move submittedJobGraph and completedCheckpoint to cluster-id subdirectory of high-availability storage Key: FLINK-13633 URL: https://issues.apache.org/jira/browse/FLINK-13633

[jira] [Created] (FLINK-13630) StreamTableEnvironment#toAppendStream without QueryConfig overrides values set on TableConfig

2019-08-07 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-13630: Summary: StreamTableEnvironment#toAppendStream without QueryConfig overrides values set on TableConfig Key: FLINK-13630 URL:

[jira] [Created] (FLINK-13631) Update FlinkKinesisConsumerMigrationTest to restore from 1.9 savepoint

2019-08-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-13631: - Summary: Update FlinkKinesisConsumerMigrationTest to restore from 1.9 savepoint Key: FLINK-13631 URL: https://issues.apache.org/jira/browse/FLINK-13631 Project:

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Piotr Nowojski
Congratulations :) > On 7 Aug 2019, at 12:09, JingsongLee wrote: > > Congrats Hequn! > > Best, > Jingsong Lee > > -- > From:Biao Liu > Send Time:2019年8月7日(星期三) 12:05 > To:Zhu Zhu > Cc:Zili Chen ; Jeff Zhang ; Paul Lam > ;

Re: Suspicious watermark of operators after restore from checkpoint

2019-08-07 Thread Kostas Kloudas
Hi Jan, After looking at the code, my point 1) is false for *intermediate* tasks and if you are using a watermark assigner. This means that in these cases, Flink checks that the "next" watermark is greater than the "previous" one. But if your operator A is a source and you emit watermarks from

Re: Suspicious watermark of operators after restore from checkpoint

2019-08-07 Thread Jan Lukavský
Actually, operator A is intermediate, source is preceding it. On 8/7/19 2:44 PM, Kostas Kloudas wrote: Hi Jan, After looking at the code, my point 1) is false for *intermediate* tasks and if you are using a watermark assigner. This means that in these cases, Flink checks that the "next"

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Terry Wang
Congratulations Hequn, well deserved! Best, Terry Wang > 在 2019年8月7日,下午9:16,Oytun Tez 写道: > > Congratulations Hequn! > > --- > Oytun Tez > > M O T A W O R D > The World's Fastest Human Translation Platform. > oy...@motaword.com — www.motaword.com >

Re: Suspicious watermark of operators after restore from checkpoint

2019-08-07 Thread Jan Lukavský
Hi Kostas, yes - operators A and B are as you said. The WebUI is what would explain in best, if it is anyhow possible, that it would display sort of stale information at one operator and updated on another. Jan On 8/7/19 3:59 PM, Kostas Kloudas wrote: Hi Jan, I am not sure what is

[jira] [Created] (FLINK-13637) Anchors not working in document(building.md, common.md, queryable_state.md)

2019-08-07 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-13637: --- Summary: Anchors not working in document(building.md, common.md, queryable_state.md) Key: FLINK-13637 URL: https://issues.apache.org/jira/browse/FLINK-13637 Project:

[jira] [Created] (FLINK-13638) Refactor RemoteChannelStateChecker#isProducerConsumerReadyOrAbortConsumption to return result action

2019-08-07 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-13638: --- Summary: Refactor RemoteChannelStateChecker#isProducerConsumerReadyOrAbortConsumption to return result action Key: FLINK-13638 URL:

[jira] [Created] (FLINK-13640) Consider TaskDeploymentDescriptorFactory to be Execution specific

2019-08-07 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-13640: --- Summary: Consider TaskDeploymentDescriptorFactory to be Execution specific Key: FLINK-13640 URL: https://issues.apache.org/jira/browse/FLINK-13640 Project:

[jira] [Created] (FLINK-13643) Document the workaround for users with a different minor Hive version

2019-08-07 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created FLINK-13643: --- Summary: Document the workaround for users with a different minor Hive version Key: FLINK-13643 URL: https://issues.apache.org/jira/browse/FLINK-13643 Project: Flink

RE: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread xingcanc
Congratulations, Hequn! From: Xintong Song Sent: Wednesday, August 07, 2019 10:41 AM To: dev@flink.apache.org Cc: user Subject: Re: [ANNOUNCE] Hequn becomes a Flink committer Congratulations~! Thank you~ Xintong Song On Wed, Aug 7, 2019 at 4:00 PM vino yang

[jira] [Created] (FLINK-13639) Consider refactoring of IntermediateResultPartitionID to consist of IntermediateDataSetID and partitionIndex

2019-08-07 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-13639: --- Summary: Consider refactoring of IntermediateResultPartitionID to consist of IntermediateDataSetID and partitionIndex Key: FLINK-13639 URL:

[jira] [Created] (FLINK-13641) Consider removing UnknownInputChannel in NettyShuffleEnvironment

2019-08-07 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-13641: --- Summary: Consider removing UnknownInputChannel in NettyShuffleEnvironment Key: FLINK-13641 URL: https://issues.apache.org/jira/browse/FLINK-13641 Project:

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

2019-08-07 Thread Konstantin Knauf
Hi everyone, in the context of FLIP-42 Fabian and myself were working on a docker-based playground as part of the "Getting Started" section of our documentation. The PR [1] was merged into master today. Besides documentation, this also adds an additional example to `flink-streaming-examples`. For

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Xintong Song
Congratulations~! Thank you~ Xintong Song On Wed, Aug 7, 2019 at 4:00 PM vino yang wrote: > Congratulations! > > highfei2...@126.com 于2019年8月7日周三 下午7:09写道: > > > Congrats Hequn! > > > > Best, > > Jeff Yang > > > > > > Original Message > > Subject: Re: [ANNOUNCE] Hequn

[jira] [Created] (FLINK-13642) Refactor ShuffleMaster to optionally provide preferred TM location for produced partitions

2019-08-07 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-13642: --- Summary: Refactor ShuffleMaster to optionally provide preferred TM location for produced partitions Key: FLINK-13642 URL: https://issues.apache.org/jira/browse/FLINK-13642

Re: Customize StreamingFileSink: Enable extending StreamingFileSink class

2019-08-07 Thread Fabian Hueske
Hi Kailash, Yes, I think creating another Jira and PR would be the right thing to do. Thank you, Fabian Am Fr., 2. Aug. 2019 um 10:29 Uhr schrieb Kailash Dayanand < kailash...@gmail.com>: > Hello, > > There were a few things which we missing in >

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Yun Tang
Congratulations Hequn. Best Yun Tang From: Rong Rong Sent: Thursday, August 8, 2019 0:41 Cc: dev ; user Subject: Re: [ANNOUNCE] Hequn becomes a Flink committer Congratulations Hequn, well deserved! -- Rong On Wed, Aug 7, 2019 at 8:30 AM

Re: Custom type serializer inside Flink state

2019-08-07 Thread Yun Tang
Hi Ying What version of Flink are you using and please more exception stack. Moreover, what is the relationship between `MyProtoClass2` and `MyProtoClass1`? As far as I know, registering the Message class should not be the proper solution. For the 2nd question, you could refer to FLINK-11333

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread zhijiang
Congratulations Hequn! Best, Zhijiang -- From:Xuefu Z Send Time:2019年8月7日(星期三) 20:35 To:dev Subject:Re: [ANNOUNCE] Hequn becomes a Flink committer Congratulations, Hequn! On Wed, Aug 7, 2019 at 11:08 AM Yun Tang wrote: >

Custom type serializer inside Flink state

2019-08-07 Thread Ying Xu
Hi Flink community: Our Flink application sends different types of protobuf messages on-the-wire. Since protobuf cannot be handled by Flink type serializer, we had to register custom Kyro serializer: env.getConfig().*registerTypeWithKryoSerializer*(MyProtoClass1.class,

Re: Custom type serializer inside Flink state

2019-08-07 Thread Ying Xu
Hi Yun: Thanks for the quick reply. Thanks for pointing to FLINK-11333 , will take a look. We are currently using Flink 1.8.0. To summarize the behavior: 1) In the first version of the Flink app, there is a protobuf class getting registered

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Xuefu Z
Congratulations, Hequn! On Wed, Aug 7, 2019 at 11:08 AM Yun Tang wrote: > Congratulations Hequn. > > Best > Yun Tang > > From: Rong Rong > Sent: Thursday, August 8, 2019 0:41 > Cc: dev ; user > Subject: Re: [ANNOUNCE] Hequn becomes a Flink committer > >

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

2019-08-07 Thread David Anderson
I've spent time exploring this playground and its accompanying documentation, and found it to be a big step forward in making it easy for folks to experience some of Flink's key features firsthand. From a training and educational perspective, I'd love to see this in 1.9. *David Anderson* |

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Hequn Cheng
Thanks everyone for the warm welcome! It's a great honor for me to be a committer. Looking forward to contributing more to the community. Best, Hequn On Thu, Aug 8, 2019 at 3:39 AM zhijiang wrote: > Congratulations Hequn! > > Best, > Zhijiang >

Re:Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Haibo Sun
Congratulations! Best, Haibo At 2019-08-08 02:08:21, "Yun Tang" wrote: >Congratulations Hequn. > >Best >Yun Tang > >From: Rong Rong >Sent: Thursday, August 8, 2019 0:41 >Cc: dev ; user >Subject: Re: [ANNOUNCE] Hequn becomes a Flink committer > >Congratulations

[jira] [Created] (FLINK-13644) Translate "State Backends" page into Chinese

2019-08-07 Thread fanrui (JIRA)
fanrui created FLINK-13644: -- Summary: Translate "State Backends" page into Chinese Key: FLINK-13644 URL: https://issues.apache.org/jira/browse/FLINK-13644 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-13645) Error in code-gen when using blink planner in scala shell

2019-08-07 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-13645: -- Summary: Error in code-gen when using blink planner in scala shell Key: FLINK-13645 URL: https://issues.apache.org/jira/browse/FLINK-13645 Project: Flink Issue