Re: [ANNOUNCE] Apache Flink 1.11.0 released

2020-07-07 Thread Benchao Li
Congratulations! Thanks Zhijiang & Piotr for the great work as release managers. Rui Li 于2020年7月8日周三 上午11:38写道: > Congratulations! Thanks Zhijiang & Piotr for the hard work. > > On Tue, Jul 7, 2020 at 10:06 PM Zhijiang > wrote: > >> The Apache Flink community is very happy to announce the

Re: [DISCUSS] FLIP-130: Support for Python DataStream API (Stateless Part)

2020-07-07 Thread Shuiqiang Chen
Sorry, the 3rd link is broken, please refer to this one: Support Python DataStream API Shuiqiang Chen 于2020年7月8日周三 上午11:13写道: > Hi everyone, > > As we all know, Flink provides three layered APIs: the

Re: [ANNOUNCE] Apache Flink 1.11.0 released

2020-07-07 Thread Rui Li
Congratulations! Thanks Zhijiang & Piotr for the hard work. On Tue, Jul 7, 2020 at 10:06 PM Zhijiang wrote: > The Apache Flink community is very happy to announce the release of > Apache Flink 1.11.0, which is the latest major release. > > Apache Flink® is an open-source stream processing

Re: Check pointing for simple pipeline

2020-07-07 Thread Yun Tang
Hi Prasanna Using incremental checkpoint is always better than not as this is faster and less memory consumed. However, incremental checkpoint is only supported by RocksDB state-backend. Best Yun Tang From: Prasanna kumar Sent: Tuesday, July 7, 2020 20:43 To:

Re: Re:[ANNOUNCE] Apache Flink 1.11.0 released

2020-07-07 Thread Yun Tang
Congratulations to every who involved and thanks for Zhijiang and Piotr's work as release manager. From: chaojianok Sent: Wednesday, July 8, 2020 10:51 To: Zhijiang Cc: dev ; u...@flink.apache.org ; announce Subject: Re:[ANNOUNCE] Apache Flink 1.11.0 released

[DISCUSS] FLIP-130: Support for Python DataStream API (Stateless Part)

2020-07-07 Thread Shuiqiang Chen
Hi everyone, As we all know, Flink provides three layered APIs: the ProcessFunctions, the DataStream API and the SQL & Table API. Each API offers a different trade-off between conciseness and expressiveness and targets different use cases[1]. Currently, the SQL & Table API has already been

Re: [ANNOUNCE] Apache Flink 1.11.0 released

2020-07-07 Thread Leonard Xu
Congratulations! Thanks Zhijiang and Piotr for the great work, and thanks everyone involved! Best, Leonard Xu

Re: [ANNOUNCE] Apache Flink 1.11.0 released

2020-07-07 Thread Jingsong Li
Congratulations! Thanks Zhijiang and Piotr as release managers, and thanks everyone. Best, Jingsong On Wed, Jul 8, 2020 at 10:51 AM chaojianok wrote: > Congratulations! > > Very happy to make some contributions to Flink! > > > > > > At 2020-07-07 22:06:05, "Zhijiang" wrote: > > The Apache

Re: [ANNOUNCE] Apache Flink 1.11.0 released

2020-07-07 Thread Yangze Guo
Thanks, Zhijiang and Piotr. Congrats to everyone involved! Best, Yangze Guo On Wed, Jul 8, 2020 at 10:19 AM Jark Wu wrote: > > Congratulations! > Thanks Zhijiang and Piotr for the great work as release manager, and thanks > everyone who makes the release possible! > > Best, > Jark > > On Wed, 8

Re: [ANNOUNCE] Apache Flink 1.11.0 released

2020-07-07 Thread Dian Fu
Thanks Piotr and Zhijiang for the great work and everyone who contributed to this release! Regards, Dian > 在 2020年7月8日,上午10:12,Paul Lam 写道: > > Finally! Thanks for Piotr and Zhijiang being the release managers, and > everyone that contributed to the release! > > Best, > Paul Lam > >>

Re: [ANNOUNCE] Apache Flink 1.11.0 released

2020-07-07 Thread Jark Wu
Congratulations! Thanks Zhijiang and Piotr for the great work as release manager, and thanks everyone who makes the release possible! Best, Jark On Wed, 8 Jul 2020 at 10:12, Paul Lam wrote: > Finally! Thanks for Piotr and Zhijiang being the release managers, and > everyone that contributed to

Re: [ANNOUNCE] Apache Flink 1.11.0 released

2020-07-07 Thread Paul Lam
Finally! Thanks for Piotr and Zhijiang being the release managers, and everyone that contributed to the release! Best, Paul Lam > 2020年7月7日 22:06,Zhijiang 写道: > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.11.0, which is the latest major release. >

[jira] [Created] (FLINK-18522) ZKCheckpointIDCounterMultiServersTest.testRecoveredAfterConnectionLoss failed with "Address already in use"

2020-07-07 Thread Dian Fu (Jira)
Dian Fu created FLINK-18522: --- Summary: ZKCheckpointIDCounterMultiServersTest.testRecoveredAfterConnectionLoss failed with "Address already in use" Key: FLINK-18522 URL:

Re: NullPointer Exception while trying to access or read ReadOnly ctx in processElement method in KeyedBroadCastProcessFunction in Apache Flink

2020-07-07 Thread bujjirahul45 .
Hi, Thanks for the reply incomingRule is nothing but incomingPattern it's a typo and yes i am using in my program, here is my scenario i have streaming of json events which need to be validated against a set of rules i have multiple streams from which i am consuming data let say if i have Source

[jira] [Created] (FLINK-18521) Add release script for creating snapshot branches

2020-07-07 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-18521: Summary: Add release script for creating snapshot branches Key: FLINK-18521 URL: https://issues.apache.org/jira/browse/FLINK-18521 Project: Flink

[jira] [Created] (FLINK-18520) New Table Function type inference fails

2020-07-07 Thread Benchao Li (Jira)
Benchao Li created FLINK-18520: -- Summary: New Table Function type inference fails Key: FLINK-18520 URL: https://issues.apache.org/jira/browse/FLINK-18520 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-18519) Propagate exception to client when execution fails for REST submission

2020-07-07 Thread Kostas Kloudas (Jira)
Kostas Kloudas created FLINK-18519: -- Summary: Propagate exception to client when execution fails for REST submission Key: FLINK-18519 URL: https://issues.apache.org/jira/browse/FLINK-18519 Project:

[ANNOUNCE] Apache Flink 1.11.0 released

2020-07-07 Thread Zhijiang
The Apache Flink community is very happy to announce the release of Apache Flink 1.11.0, which is the latest major release. Apache Flink(r) is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is

Re: [ANNOUNCE] New PMC member: Piotr Nowojski

2020-07-07 Thread Piotr Nowojski
Thanks :) wt., 7 lip 2020 o 15:20 Guowei Ma napisał(a): > Congratulations! > > Best, > Guowei > > > Fabian Hueske 于2020年7月7日周二 下午4:34写道: > >> Congrats Piotr! >> >> Cheers, Fabian >> >> Am Di., 7. Juli 2020 um 10:04 Uhr schrieb Marta Paes Moreira < >> ma...@ververica.com>: >> >> > Go Piotr!

Re: [DISCUSS] FLIP-128: Enhanced Fan Out for AWS Kinesis Consumers

2020-07-07 Thread Cranmer, Danny
Hello Thomas, Thank-you for your vote and feedback on the FLIP. Q: Do you see the polling (non-EFO) mode as a permanent option going forward? A: I will follow up on this, I have forwarded the question on. But generally speaking AWS do not usually deprecate APIs. KDS (Kinesis Data Streams) will

Re: [ANNOUNCE] New PMC member: Piotr Nowojski

2020-07-07 Thread Guowei Ma
Congratulations! Best, Guowei Fabian Hueske 于2020年7月7日周二 下午4:34写道: > Congrats Piotr! > > Cheers, Fabian > > Am Di., 7. Juli 2020 um 10:04 Uhr schrieb Marta Paes Moreira < > ma...@ververica.com>: > > > Go Piotr! Congrats! > > > > On Tue, Jul 7, 2020 at 7:15 AM Biao Liu wrote: > > > > >

Check pointing for simple pipeline

2020-07-07 Thread Prasanna kumar
Hi , I have pipeline. Source-> Map(JSON transform)-> Sink.. Both source and sink are Kafka. What is the best checkpoint ing mechanism? Is setting checkpoints incremental a good option? What should be careful of? I am running it on aws emr. Will checkpoint slow the speed? Thanks, Prasanna.

[jira] [Created] (FLINK-18518) Add Async RequestReply handler for the Python SDK

2020-07-07 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-18518: Summary: Add Async RequestReply handler for the Python SDK Key: FLINK-18518 URL: https://issues.apache.org/jira/browse/FLINK-18518 Project: Flink Issue

Re: NullPointer Exception while trying to access or read ReadOnly ctx in processElement method in KeyedBroadCastProcessFunction in Apache Flink

2020-07-07 Thread Dawid Wysakowicz
Could you please share with us the actual code that you are running. Possibly without any debug statements. As I said in my first reply, I can not rely relate the stack trace with the code you sent us. Moreover in the code you sent us I can not see a way it could throw an Exception at the line you

Re: [VOTE] FLIP-128: Enhanced Fan Out for AWS Kinesis Consumers

2020-07-07 Thread Cranmer, Danny
Thank-you to everyone that voted and contributed to the FLIP discussions. I am closing this voting thread, the FLIP has been accepted with a consensus: +1 (Binding): 3 (Tzu-Li (Gordon) Tai, Aljoscha Krettek, Thomas Weise) +0 (Binding): 0 +1 (Non-Binding): 1 (Konstantin Knauf) +0

[jira] [Created] (FLINK-18517) kubernetes session test failed with "java.net.SocketException: Broken pipe"

2020-07-07 Thread Dian Fu (Jira)
Dian Fu created FLINK-18517: --- Summary: kubernetes session test failed with "java.net.SocketException: Broken pipe" Key: FLINK-18517 URL: https://issues.apache.org/jira/browse/FLINK-18517 Project: Flink

[jira] [Created] (FLINK-18516) Improve error message for rank function in streaming mode

2020-07-07 Thread Rui Li (Jira)
Rui Li created FLINK-18516: -- Summary: Improve error message for rank function in streaming mode Key: FLINK-18516 URL: https://issues.apache.org/jira/browse/FLINK-18516 Project: Flink Issue Type:

Re: [ANNOUNCE] New PMC member: Piotr Nowojski

2020-07-07 Thread Fabian Hueske
Congrats Piotr! Cheers, Fabian Am Di., 7. Juli 2020 um 10:04 Uhr schrieb Marta Paes Moreira < ma...@ververica.com>: > Go Piotr! Congrats! > > On Tue, Jul 7, 2020 at 7:15 AM Biao Liu wrote: > > > Congrats Piotr! Well deserved! > > > > Thanks, > > Biao /'bɪ.aʊ/ > > > > > > > > On Tue, 7 Jul 2020

Re: [ANNOUNCE] New PMC member: Piotr Nowojski

2020-07-07 Thread Marta Paes Moreira
Go Piotr! Congrats! On Tue, Jul 7, 2020 at 7:15 AM Biao Liu wrote: > Congrats Piotr! Well deserved! > > Thanks, > Biao /'bɪ.aʊ/ > > > > On Tue, 7 Jul 2020 at 13:03, Congxian Qiu wrote: > > > Congratulations Piotr! > > > > Best, > > Congxian > > > > > > Zhijiang 于2020年7月7日周二 下午12:25写道: > > > >

[jira] [Created] (FLINK-18515) [Kinesis][EFO] FanOutRecordPublisher and full EFO support

2020-07-07 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-18515: - Summary: [Kinesis][EFO] FanOutRecordPublisher and full EFO support Key: FLINK-18515 URL: https://issues.apache.org/jira/browse/FLINK-18515 Project: Flink

[jira] [Created] (FLINK-18514) Building fails with JDK 14 installed

2020-07-07 Thread Niels Basjes (Jira)
Niels Basjes created FLINK-18514: Summary: Building fails with JDK 14 installed Key: FLINK-18514 URL: https://issues.apache.org/jira/browse/FLINK-18514 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-18513) [Kinesis][EFO] Add AWS SDK v2.x dependency and FanOutKinesisProxy

2020-07-07 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-18513: - Summary: [Kinesis][EFO] Add AWS SDK v2.x dependency and FanOutKinesisProxy Key: FLINK-18513 URL: https://issues.apache.org/jira/browse/FLINK-18513 Project: Flink

[jira] [Created] (FLINK-18512) [KINESIS][EFO] Introduce RecordPublisher Interface

2020-07-07 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-18512: - Summary: [KINESIS][EFO] Introduce RecordPublisher Interface Key: FLINK-18512 URL: https://issues.apache.org/jira/browse/FLINK-18512 Project: Flink Issue

[jira] [Created] (FLINK-18510) Job Listener接口不生效

2020-07-07 Thread Edsion_Lin (Jira)
Edsion_Lin created FLINK-18510: -- Summary: Job Listener接口不生效 Key: FLINK-18510 URL: https://issues.apache.org/jira/browse/FLINK-18510 Project: Flink Issue Type: Bug Components: API /

[jira] [Created] (FLINK-18511) Unsupported call: TUMBLE_END(TIME(0), INTERVAL SECOND(3) NOT NULL)

2020-07-07 Thread mzz (Jira)
mzz created FLINK-18511: --- Summary: Unsupported call: TUMBLE_END(TIME(0), INTERVAL SECOND(3) NOT NULL) Key: FLINK-18511 URL: https://issues.apache.org/jira/browse/FLINK-18511 Project: Flink Issue

Re: [ANNOUNCE] New PMC member: Piotr Nowojski

2020-07-07 Thread Biao Liu
Congrats Piotr! Well deserved! Thanks, Biao /'bɪ.aʊ/ On Tue, 7 Jul 2020 at 13:03, Congxian Qiu wrote: > Congratulations Piotr! > > Best, > Congxian > > > Zhijiang 于2020年7月7日周二 下午12:25写道: > > > Congratulations Piotr! > > > > Best, > > Zhijiang > > > > > >