Re: FlinkML on slack

2017-06-19 Thread Shaoxuan Wang
Hi Stavros, Can I get an invitation for the slack channel. Thanks, Shaoxuan On Thu, Jun 8, 2017 at 3:56 AM, Stavros Kontopoulos < st.kontopou...@gmail.com> wrote: > Hi all, > > We took the initiative to create the organization for FlinkML on slack > (thnx Eron). > There is now a channel for

Re: Incompatible Apache Http lib in Flink kinesis connector

2017-06-19 Thread Tzu-Li (Gordon) Tai
Hi Bowen, Thanks for the info. I checked the 1.3.0 release jars, and they do not have unshaded httpcomponent dependencies, so that shouldn’t be the problem. Looking back into the stack trace you posted, the conflict seems to be a different problem. The conflict seems to be with clashes with

Re: Incompatible Apache Http lib in Flink kinesis connector

2017-06-19 Thread Tzu-Li (Gordon) Tai
Hi, We’ve seen this issue before [1]. The usual reason is that the httpcomponent dependencies weren’t properly shaded in the flink-dist jar. Having them properly shaded should solve the issue. cc Bowen: Are you building Flink yourself? If yes, what Maven version are you using? If you’re using

Re: Incompatible Apache Http lib in Flink kinesis connector

2017-06-19 Thread Ted Yu
I logged FLINK-6951, referencing this thread. We can continue discussion there. Thanks On Mon, Jun 19, 2017 at 9:06 PM, Bowen Li wrote: > Thanks, Ted! woo, this is unexpected. https://ci.apache. > org/projects/flink/flink-docs-release-1.3/setup/aws.html is out of

[jira] [Created] (FLINK-6951) Incompatible versions of httpcomponents jars for Flink kinesis connector

2017-06-19 Thread Ted Yu (JIRA)
Ted Yu created FLINK-6951: - Summary: Incompatible versions of httpcomponents jars for Flink kinesis connector Key: FLINK-6951 URL: https://issues.apache.org/jira/browse/FLINK-6951 Project: Flink

Re: Incompatible Apache Http lib in Flink kinesis connector

2017-06-19 Thread Bowen Li
Thanks, Ted! woo, this is unexpected. https://ci.apache. org/projects/flink/flink-docs-release-1.3/setup/aws.html is out of date. I bet anyone using Kinesis with Flink will run into this issue. I can try to build Flink myself and resolve this problem. But talking about a feasible permanent

Re: Incompatible Apache Http lib in Flink kinesis connector

2017-06-19 Thread Ted Yu
Here is the dependency in the flink-connector-kinesis module: [INFO] +- com.amazonaws:aws-java-sdk-kinesis:jar:1.10.71:compile [INFO] | \- com.amazonaws:aws-java-sdk-core:jar:1.10.71:compile [INFO] | +- org.apache.httpcomponents:httpclient:jar:4.3.6:compile [INFO] | +-

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-19 Thread SHI Xiaogang
Congrats Dawid. Great thanks for your contribution! Xiaogang 2017-06-19 18:52 GMT+08:00 Dawid Wysakowicz : > Thank you all for the warm welcome. I will do my best to be as helpful as > possible. >

Incompatible Apache Http lib in Flink kinesis connector

2017-06-19 Thread Bowen Li
Hi guys, I'm trying to enable Flink's checkpoint on our Flink app. I got the following Apache http jar compatibility error, and cannot figure out how to resolve it. Here's the stacktrace: ``` 2017-06-19 15:07:39,828 INFO org.apache.flink.runtime.taskmanager.Task

Re: [DISCUSS] Release Apache Flink 1.3.1

2017-06-19 Thread Fabian Hueske
If somebody has some spare time, it would be great to get a review for a fix for the DelimitedInputFormat (FLINK-6652 / PR #4088). 2017-06-19 17:00 GMT+02:00 jincheng sun : > Thanks @Timo! > > 2017-06-19 22:02 GMT+08:00 Timo Walther : > > > I'm

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-19 Thread Matthias J. Sax
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! - -Matthias On 6/19/17 3:52 AM, Dawid Wysakowicz wrote: > Thank you all for the warm welcome. I will do my best to be as > helpful as possible. > -BEGIN PGP SIGNATURE- Comment: GPGTools - https://gpgtools.org

Re: [DISCUSS] Release Apache Flink 1.3.1

2017-06-19 Thread Timo Walther
I'm working on https://issues.apache.org/jira/browse/FLINK-6896 and https://issues.apache.org/jira/browse/FLINK-6881. I try to open a PR for both today. Timo Am 19.06.17 um 14:54 schrieb Robert Metzger: Fabian and SunJincheng, it looks like we are cancelling the 1.3.1 RC1. So there is the

Re: [CANCELLED] [VOTE] Release Apache Flink 1.3.1

2017-06-19 Thread jincheng sun
Thanks @ Robert! @Fabian @Jack do you think the PRs are good to merged. I think we should try to merge these two PRs today. Best, SunJincheng 2017-06-19 20:56 GMT+08:00 Robert Metzger : > Thanks everybody for the testing of the RC1! > > I'm hereby cancelling the first RC

Re: [DISCUSS] Release Apache Flink 1.3.1

2017-06-19 Thread Robert Metzger
Fabian and SunJincheng, it looks like we are cancelling the 1.3.1 RC1. So there is the opportunity to get the two mentioned JIRAs in. On Wed, Jun 14, 2017 at 4:16 PM, Robert Metzger wrote: > I've closed my emails, so I didn't see your messages anymore Fabian. > The RC1 for

[jira] [Created] (FLINK-6949) Make custom resource files to be shipped to YARN cluster

2017-06-19 Thread Mikhail Pryakhin (JIRA)
Mikhail Pryakhin created FLINK-6949: --- Summary: Make custom resource files to be shipped to YARN cluster Key: FLINK-6949 URL: https://issues.apache.org/jira/browse/FLINK-6949 Project: Flink

Re: [VOTE] Release Apache Flink 1.3.1

2017-06-19 Thread Robert Metzger
If we really have to introduce a special path in the serializer config for 1.3.1 to 1.3.2, then I would indeed suggest to cancel the RC1. If only this one commit is different between RC1 and RC2, we can do a reduced voting period for RC2. On Mon, Jun 19, 2017 at 2:02 PM, Till Rohrmann

Re: [VOTE] Release Apache Flink 1.3.1

2017-06-19 Thread Tzu-Li (Gordon) Tai
No, I meant that if we include FLINK-6921 / FLINK-6948 in 1.3.1, we also still need to bump the version due to changes in FLINK-6948. So, that the version needs to be bumped would not be a reason to block 1.3.1 on it, because we have to do it either way. On 19 June 2017 at 7:33:25 PM, Till

Re: [VOTE] Release Apache Flink 1.3.1

2017-06-19 Thread Till Rohrmann
Do you mean that we have to bump the version also without including FLINK-6921 and FLINK-6948? Wouldn't that be a release blocker then? I think that we actually introduced FLINK-6921 with [1]. Thus, the `ArrayIndexOutOfBoundsException` is specific to this release. However, I agree that the

Re: [VOTE] Release Apache Flink 1.3.1

2017-06-19 Thread Tzu-Li (Gordon) Tai
The ScalaEnumSerializerConfigSnapshot would need a version bump regardless of whether or not the fixes are included in 1.3.1. In other words, we still need to bump the version if we include it for 1.3.1. I’m not against including FLINK-6921 and FLINK-6948 in for 1.3.1, but then as usual the

Re: [VOTE] Release Apache Flink 1.3.1

2017-06-19 Thread Till Rohrmann
I think the EnumValueSerializer [1, 2] is broken in the current RC. This basically means that Flink programs won’t properly notice that state migration is required and or fail with obscure exceptions at migration check or runtime. This definitely will be enough reason for another bug fix release

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-19 Thread Dawid Wysakowicz
Thank you all for the warm welcome. I will do my best to be as helpful as possible.

[jira] [Created] (FLINK-6948) EnumValueSerializer cannot handle removed enum values

2017-06-19 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6948: Summary: EnumValueSerializer cannot handle removed enum values Key: FLINK-6948 URL: https://issues.apache.org/jira/browse/FLINK-6948 Project: Flink Issue

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-19 Thread Greg Hogan
Welcome and congrats Dawid! > On Jun 19, 2017, at 4:40 AM, Till Rohrmann wrote: > > Hi everybody, > > On behalf of the PMC I am delighted to announce Dawid Wysakowicz as a new > Flink committer! > > Dawid has been a community member for a very long time and among other

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-19 Thread Zhuoluo Yang
Congrats! Great job! Thanks, Zhuoluo  > 在 2017年6月19日,下午5:05,Jark Wu 写道: > > Congratulations and welcome Dawid! > > > Cheers, > Jark > > 2017-06-19 16:59 GMT+08:00 jincheng sun : > >> Congratulations Dawid! >> >> It's nice to see community

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-19 Thread Jark Wu
Congratulations and welcome Dawid! Cheers, Jark 2017-06-19 16:59 GMT+08:00 jincheng sun : > Congratulations Dawid! > > It's nice to see community teams getting stronger! > > Cheers, > SunJincheng > > 2017-06-19 16:46 GMT+08:00 Fabian Hueske : > > >

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-19 Thread jincheng sun
Congratulations Dawid! It's nice to see community teams getting stronger! Cheers, SunJincheng 2017-06-19 16:46 GMT+08:00 Fabian Hueske : > Congratulations Dawid! > It's great to have you on board. > > Cheers, Fabian > > 2017-06-19 10:40 GMT+02:00 Till Rohrmann

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-19 Thread yuzhihong
Congratulations,  Dawid! Sent from my Verizon, Samsung Galaxy smartphone Original message From: Till Rohrmann Date: 6/19/17 1:40 AM (GMT-08:00) To: dev@flink.apache.org Subject: [ANNOUNCE] New committer: Dawid Wysakowicz Hi everybody, On behalf of

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-19 Thread Kostas Kloudas
Congratulations Dawid! Nice to have you in the team as a committer this time! Kostas > On Jun 19, 2017, at 10:40 AM, Till Rohrmann wrote: > > Hi everybody, > > On behalf of the PMC I am delighted to announce Dawid Wysakowicz as a new > Flink committer! > > Dawid has

[ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-19 Thread Till Rohrmann
Hi everybody, On behalf of the PMC I am delighted to announce Dawid Wysakowicz as a new Flink committer! Dawid has been a community member for a very long time and among other things he helped shaping Flink's CEP library into what it is today. Welcome Dawid and congratulations again for

[jira] [Created] (FLINK-6946) Same access to time in process functions for all-windows as keyed windows

2017-06-19 Thread William Saar (JIRA)
William Saar created FLINK-6946: --- Summary: Same access to time in process functions for all-windows as keyed windows Key: FLINK-6946 URL: https://issues.apache.org/jira/browse/FLINK-6946 Project: Flink

[jira] [Created] (FLINK-6945) TaskCancelAsyncProducerConsumerITCase.testCancelAsyncProducerAndConsumer instable test case

2017-06-19 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6945: Summary: TaskCancelAsyncProducerConsumerITCase.testCancelAsyncProducerAndConsumer instable test case Key: FLINK-6945 URL: https://issues.apache.org/jira/browse/FLINK-6945

[jira] [Created] (FLINK-6944) Introduce DefaultTypeSerializerConfigSnapshot as a base implementation for serializer compatibility checks

2017-06-19 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-6944: -- Summary: Introduce DefaultTypeSerializerConfigSnapshot as a base implementation for serializer compatibility checks Key: FLINK-6944 URL:

[jira] [Created] (FLINK-6943) Improve exceptions within TypeExtractionUtils#getSingleAbstractMethod

2017-06-19 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-6943: --- Summary: Improve exceptions within TypeExtractionUtils#getSingleAbstractMethod Key: FLINK-6943 URL: https://issues.apache.org/jira/browse/FLINK-6943 Project: