[jira] [Created] (FLINK-3899) Document window processing with Reduce/FoldFunction + WindowFunction

Fabian Hueske created FLINK-3899: Summary: Document window processing with Reduce/FoldFunction + WindowFunction Key: FLINK-3899 URL: https://issues.apache.org/jira/browse/FLINK-3899 Project: Flink

Re: Dataset split/demultiplex

Hello, You can split a DataSet into two DataSets with two filters: val xs: DataSet[A] = ... val split1: DataSet[A] = xs.filter(f1) val split2: DataSet[A] = xs.filter(f2) where f1 and f2 are true for those elements that should go into the first and second DataSets respectively. So far, the

Re: [PROPOSAL] Structure the Flink Open Source Development

tl;dr: +1 I also like the proposal a lot. Our community is growing at a quite fast pace and we need to have some structure in place to still keep track of everything going on. I'm happy to see that the proposal mentions cleaning up our JIRA. This is something that has been annoying me for quite

[jira] [Created] (FLINK-3900) Set nullCheck=true as default in TableConfig

Flavio Pompermaier created FLINK-3900: - Summary: Set nullCheck=true as default in TableConfig Key: FLINK-3900 URL: https://issues.apache.org/jira/browse/FLINK-3900 Project: Flink Issue

[jira] [Created] (FLINK-3902) Discarded FileSystem checkpoints are lingering around

Ufuk Celebi created FLINK-3902: -- Summary: Discarded FileSystem checkpoints are lingering around Key: FLINK-3902 URL: https://issues.apache.org/jira/browse/FLINK-3902 Project: Flink Issue Type:

Re: Dataset split/demultiplex

Hi, I agree that this would be very nice. Unfortunately Flink does only allow one output from an operation right now. Maybe we can extends this somehow in the future. Cheers, Aljoscha On Thu, 12 May 2016 at 17:27 CPC wrote: > Hi Gabor, > > Yes functionally this helps. But in

Re: [PROPOSAL] Structure the Flink Open Source Development

All maintainer candidates are only proposals so far. No indication of lead or anything so far. Let's first see if we agree on the structure proposed here, and if we take the components as suggested here or if we refine the list. Am 12.05.2016 17:45 schrieb "Robert Metzger" :

Re: [PROPOSAL] Structure the Flink Open Source Development

+1 The ideas seem good and the proposed number of components seems reasonable. With this, we should also then cleanup the JIRA to make it actually usable. On Thu, 12 May 2016 at 18:09 Stephan Ewen wrote: > All maintainer candidates are only proposals so far. No indication of

Re: Dataset split/demultiplex

Hi Gabor, Yes functionally this helps. But in this case i am processing an element twice and sending whole data to two different operator . What i am trying to achieve is like datastream split like functionality or a little bit more: In filter like scenario i want to do below pseudo operation:

Re: How to specify dependencies for an application that needs to use modified version of Flink

Since FLINK-1827 was merged you could also skip test compilation with -Dmaven.test.skip=true if you don't want to waste time and resources :) On 12 May 2016 10:06, "Jark" wrote: > Sorry for mistyped the command. You can enter into > flink/flink-streaming-java and run `mvn clean

Re: [PROPOSAL] Structure the Flink Open Source Development

Hello, There are at least three Gábors in the Flink community, :) so assuming that the Gábor in the list of maintainers of the DataSet API is referring to me, I'll be happy to do it. :) Best, Gábor G. 2016-05-10 11:24 GMT+02:00 Stephan Ewen : > Hi everyone! > > We propose

Re: How to specify dependencies for an application that needs to use modified version of Flink

Hi Saiph, You can enter flink directory and run `mvn clean install -DskipTest=true` to install all the modules (including flunk-streaming-java) into your local .m2 repository . After that, change your app dependencies version to the version of your flink, such as “1.1-SNAPSHOT”. At last,

Re: How to specify dependencies for an application that needs to use modified version of Flink

Sorry for mistyped the command. You can enter into flink/flink-streaming-java and run `mvn clean package install -DskipTests=true` . It will install only flink-streaming-java module. > 在 2016年5月12日，上午10:02，Jark 写道： > > Hi Saiph, >You can enter flink directory and run

Re: [PROPOSAL] Structure the Flink Open Source Development

+1 for the proposal @ggevay: I do think that it refers to you. :) On Thu, May 12, 2016 at 10:40 AM, Gábor Gévay wrote: > Hello, > > There are at least three Gábors in the Flink community, :) so > assuming that the Gábor in the list of maintainers of the DataSet API > is

Re: Intellij code style

Please create a JIRA issue for this and send the PR with JIRA issue number. Regards, Chiwan Park > On May 12, 2016, at 7:15 PM, Flavio Pompermaier wrote: > > Do I need to open also a Jira or just the PR? > > On Thu, May 12, 2016 at 12:03 PM, Stephan Ewen

Re: [PROPOSAL] Structure the Flink Open Source Development

Yes, Gabor Gevay, that did refer to you! Sorry for the ambiguity... On Thu, May 12, 2016 at 10:46 AM, Márton Balassi wrote: > +1 for the proposal > @ggevay: I do think that it refers to you. :) > > On Thu, May 12, 2016 at 10:40 AM, Gábor Gévay

Re: Intellij code style

Do I need to open also a Jira or just the PR? On Thu, May 12, 2016 at 12:03 PM, Stephan Ewen wrote: > Yes, please open a pull request for that. > > On Thu, May 12, 2016 at 11:40 AM, Flavio Pompermaier > > wrote: > > > If you're interested to I created

Re: Intellij code style

Yes, please open a pull request for that. On Thu, May 12, 2016 at 11:40 AM, Flavio Pompermaier wrote: > If you're interested to I created an Eclipse version that should follows > Flink coding rules..should I create a new JIRA for it? > > On Thu, May 5, 2016 at 6:02 PM,

Re: Intellij code style

If you're interested to I created an Eclipse version that should follows Flink coding rules..should I create a new JIRA for it? On Thu, May 5, 2016 at 6:02 PM, Dawid Wysakowicz wrote: > I opened JIRA: https://issues.apache.org/jira/browse/FLINK-3870. and > created

Re: [PROPOSAL] Structure the Flink Open Source Development

+1 from my side. Happy to be the maintainer for Storm-Compatibiltiy (at least I guess it's me, even the correct spelling would be with two 't' :P) -Matthias On 05/12/2016 12:56 PM, Till Rohrmann wrote: > +1 for the proposal > On May 12, 2016 12:13 PM, "Stephan Ewen" wrote: >

Re: [PROPOSAL] Structure the Flink Open Source Development

+1 for the proposal On May 12, 2016 12:13 PM, "Stephan Ewen" wrote: > Yes, Gabor Gevay, that did refer to you! > > Sorry for the ambiguity... > > On Thu, May 12, 2016 at 10:46 AM, Márton Balassi > > wrote: > > > +1 for the proposal > > @ggevay: I do

Re: [PROPOSAL] Structure the Flink Open Source Development

Big +1 from my side, I think this will help the community grow and prosper big time! On Thu, May 12, 2016 at 1:27 PM, Matthias J. Sax wrote: > +1 from my side. > > Happy to be the maintainer for Storm-Compatibiltiy (at least I guess > it's me, even the correct spelling would

Re: [PROPOSAL] Structure the Flink Open Source Development

Yes, Matthias, that was supposed to be you. Sorry from another guy who frequently has his name misspelled ;-) On Thu, May 12, 2016 at 1:27 PM, Matthias J. Sax wrote: > +1 from my side. > > Happy to be the maintainer for Storm-Compatibiltiy (at least I guess > it's me, even the

Re: [PROPOSAL] Structure the Flink Open Source Development

Hey Stephan! Thanks to you and the others who started this. I really like the proposal and I'm happy to see my name on some components. So, +1. I'd say let's wait until the end of the week/beginning of next week to see if there is any disagreement with the propsal in the community (doesn't look

Re: [PROPOSAL] Structure the Flink Open Source Development

+1 for the initiative. With a better process we will improve the quality of the Flink development and give us more time to focus. Could we have another category "Infrastructure"? This would concern things like CI, nightly deployment of snapshots/documentation, ASF Infra communication. Robert and