Re: [DISCUSS] TravisCI auto cancellation

2017-06-07 Thread Robert Metzger
I think auto cancellation is also enabled for branch builds. I think this is pretty bad to find out which commit introduced a build instability. I'll contact INFRA to check this again. On Wed, Mar 29, 2017 at 3:33 PM, Greg Hogan wrote: > Wow, that was a quick response that this feature was alre

Re: [DISCUSS] Release Apache Flink 1.3.1

2017-06-07 Thread Robert Metzger
’ve included https://issues.apache.org/jira/browse/FLINK-6804 as > a 1.3.1 blocker. > > > On 2 June 2017 at 5:27:18 PM, Nico Kruber (n...@data-artisans.com) wrote: > > while fixing build issues - what about FLINK-6654? > > On Friday, 2 June 2017 11:05:34 CEST Robert Metzger w

Re: [DISCUSS] Release Apache Flink 1.3.1

2017-06-02 Thread Robert Metzger
HA even if NoRestartStrategy is set) also be included? > > > On 2 June 2017 at 11:21:33 AM, Robert Metzger (rmetz...@apache.org) wrote: > > I agree with both! > > I've attached a label to all JIRAs for the 1.3.1 release. Once this list > has 0 open issues, I'll create 1.3.1:

[jira] [Created] (FLINK-6815) Javadocs don't work anymore in Flink 1.4-SNAPSHOT

2017-06-02 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6815: - Summary: Javadocs don't work anymore in Flink 1.4-SNAPSHOT Key: FLINK-6815 URL: https://issues.apache.org/jira/browse/FLINK-6815 Project: Flink Issue

Re: [DISCUSS] Release Apache Flink 1.3.1

2017-06-02 Thread Robert Metzger
d give a good error message when the state migration fails as > described in FLINK-6742. > > > On 02.06.2017 11:05, Robert Metzger wrote: > >> Hi devs, >> >> I would like to release Apache Flink 1.3.1 with the following fixes: >> >> - FLINK-6812 Elasticse

Re: [DISCUSS] Planning Release 1.4

2017-06-02 Thread Robert Metzger
es which > had been reviewed but were still queued. There did not look to be much new > development merged to master between the freezes. > > Greg > > > > On Jun 1, 2017, at 11:26 AM, Robert Metzger wrote: > > > > Hi all, > > > > Flink 1.2 was rele

[DISCUSS] Release Apache Flink 1.3.1

2017-06-02 Thread Robert Metzger
Hi devs, I would like to release Apache Flink 1.3.1 with the following fixes: - FLINK-6812 Elasticsearch 5 release artifacts not published to Maven central - FLINK-6783 Wrongly extracted TypeInformations for WindowedStream::aggregate - FLINK-6780 ExternalTableSource should add time attributes in

[DISCUSS] Planning Release 1.4

2017-06-01 Thread Robert Metzger
Hi all, Flink 1.2 was released on February 2, Flink 1.3 on June 1, which means we've managed to release Flink 1.3 in almost exactly 4 months! For the 1.4 release, I've put the following deadlines into the wiki [1]: *Next scheduled major release*: 1.4.0 *Feature freeze (branch forking)*: 4. Sept

[ANNOUNCE] Apache Flink 1.3.0 released

2017-06-01 Thread Robert Metzger
The Apache Flink community is pleased to announce the release of Apache Flink 1.3.0. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is available for download at: https://fl

[jira] [Created] (FLINK-6798) Remove/update documentation about network buffer tuning

2017-06-01 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6798: - Summary: Remove/update documentation about network buffer tuning Key: FLINK-6798 URL: https://issues.apache.org/jira/browse/FLINK-6798 Project: Flink

Re: Willing to contribute to Flink!

2017-06-01 Thread Robert Metzger
Hi, you don't need to file an ICLA. Can you please subscribe to the dev@flink.apache.org mailing list by sending an empty email to dev-subscr...@flink.apache.org? So far, your messages were manually accepted. On Thu, Jun 1, 2017 at 2:27 PM, jinchul wrote: > Hello, > > Thanks for your kind answe

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-06-01 Thread Robert Metzger
Hi Timo, I agree that not having the documentation available for the new features is not good. I'll do a pass over all the open documentation PRs and try to merge as many as possible. If I have the feeling, that we have enough docs, I'll release 1.3.0. For the table API, I can put a note into the

[RESULT][VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-31 Thread Robert Metzger
Thanks a lot for all your responses on the point Till raised. It seems that we have an agreement to release this RC as Flink 1.3.0. I'll include a note into the release announcement regarding the state descriptor issue. Thanks also for all the release testing and the votes. +1 votes: - Chesnay -

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-30 Thread Robert Metzger
The vote time is over, but I'll keep it open for a bit longer until we've decided regarding Till's issue. On Tue, May 30, 2017 at 6:10 PM, Robert Metzger wrote: > Hi Till, > good catch! That is definitively a severe issue. Probably it didn't > surface yet, because

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-30 Thread Robert Metzger
signatures > > - verified source and binary checksums > > - verified LICENSEs > > - verified NOTICEs > > - built from source > > > > Greg > > > > > > > On May 26, 2017, at 12:58 PM, Robert Metzger > > wrote: > > > > >

[ANNOUNCE] Flink Forward Berlin (11-13 Sep 2017) Call for Submissions is open now

2017-05-30 Thread Robert Metzger
Dear Flink Community, The Call for Submissions for Flink Forward Berlin 2017 is open now! Since we believe in collaboration, participation and exchange of ideas, we are inviting the Flink community to submit a session. Share your knowledge, applications, use cases and best practices and shape the

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-30 Thread Robert Metzger
ends on our > > assumptions about externalized checkpoints. > > > > What do you think? > > > > Cheers, > > Gyula > > > > Robert Metzger ezt írta (időpont: 2017. máj. 29., > H, > > 15:59): > > > > > +1 to release: > &g

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-29 Thread Robert Metzger
o canceling with savepoint/resuming from savepoint > o without/with rescaling > * SideOutputs work > * Metrics are properly transmitted & displayed in the webUI > > > On 28.05.2017 20:33, Robert Metzger wrote: > >> @Shaoxuan, I don't think missing documentati

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-28 Thread Robert Metzger
on tableAPI and SQL, and the docs are kind >>> of >>> lagging. We are trying the efforts to update the doc as much as possible >>> before the release is officially published, but I am hoping this is not a >>> blocker for the release. >>> >>> Sh

[CANCELLED][VOTE] Release Apache Flink 1.3.0 (RC2)

2017-05-26 Thread Robert Metzger
On Fri, May 26, 2017 at 3:59 PM, Robert Metzger wrote: > Thanks a lot. > > JIRA also shows me 0 open blockers :) > I'll then kick off the RC3 creation process. > > On Fri, May 26, 2017 at 10:50 AM, Tzu-Li (Gordon) Tai > wrote: > >> The two blockers FLINK-6

[VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-26 Thread Robert Metzger
Hi all, this is the second VOTEing release candidate for Flink 1.3.0 The commit to be voted on: 760eea8a (*http://git-wip-us.apache.org/repos/asf/flink/commit/760eea8a *)

Re: [VOTE] Release Apache Flink 1.3.0 (RC2)

2017-05-26 Thread Robert Metzger
Thanks a lot. JIRA also shows me 0 open blockers :) I'll then kick off the RC3 creation process. On Fri, May 26, 2017 at 10:50 AM, Tzu-Li (Gordon) Tai wrote: > The two blockers FLINK-6646 and FLINK-6714 have been merged. > > > On 26 May 2017 at 1:45:55 AM, Robert Metzger (rm

Re: [VOTE] Release Apache Flink 1.3.0 (RC2)

2017-05-25 Thread Robert Metzger
his RC and create a new one > containing a fix for the problem. Moreover, this is not only a problem of > the session mode but also for the per job cluster mode. Users simply didn't > run into the problem, because apparently their JM recovery didn't take > longer than 60s. > >

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-24 Thread Robert Metzger
usion in the class path, > which > >> isn't working. > >> > >> PR is open, but i wouldn't consider this a release-blocker. > >> https://github.com/apache/flink/pull/3979 > >> > >> On 24.05.2017 15:45, Kostas Kloudas wrote: > >&g

[VOTE] Release Apache Flink 1.3.0 (RC2)

2017-05-24 Thread Robert Metzger
Hi all, this is the first VOTEing release candidate for Flink 1.3.0 The commit to be voted on: e0a886e9 (*http://git-wip-us.apache.org/repos/asf/flink/commit/e0a886e9 *) B

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-24 Thread Robert Metzger
1:05 schrieb Chesnay Schepler : > > > > It appears that rescaling is broken, I've filed > https://issues.apache.org/jira/browse/FLINK-6690 for that. > > > > needless to say, this is a release blocker. > > > > On 23.05.2017 20:55, Robert Metzger wrote: > >&

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-23 Thread Robert Metzger
ker: https://issues.apache.org/jira/browse/FLINK-6685 which needs addressing first. Let me know if you want me to publish the new RC2. Otherwise, I'll re-do it with the fix included. On Tue, May 23, 2017 at 10:35 AM, Robert Metzger wrote: > I've started building the RC. > > On

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-23 Thread Robert Metzger
I've started building the RC. On Mon, May 22, 2017 at 6:01 PM, Robert Metzger wrote: > Gordon's PR has been merged. I forgot one blocking issue. Till created a > PR for it: https://issues.apache.org/jira/browse/FLINK-6328 > Once travis has passed, I'll merge that one an

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-22 Thread Robert Metzger
Gordon's PR has been merged. I forgot one blocking issue. Till created a PR for it: https://issues.apache.org/jira/browse/FLINK-6328 Once travis has passed, I'll merge that one and then do the RC. On Mon, May 22, 2017 at 10:36 AM, Robert Metzger wrote: > Thanks a lot for doing the

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-22 Thread Robert Metzger
; wrote: > > > Whoops, this is the PR for enabling the test: > > https://github.com/apache/flink/pull/3844 > > > > > > On 19.05.2017 12:14, Robert Metzger wrote: > > > >> Thank you for all your input. > >> > >> @Chesnay, in your email yo

[jira] [Created] (FLINK-6646) YARN session doesn't work with HA

2017-05-19 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6646: - Summary: YARN session doesn't work with HA Key: FLINK-6646 URL: https://issues.apache.org/jira/browse/FLINK-6646 Project: Flink Issue Type

[jira] [Created] (FLINK-6643) Flink restarts job in HA even if NoRestartStrategy is set

2017-05-19 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6643: - Summary: Flink restarts job in HA even if NoRestartStrategy is set Key: FLINK-6643 URL: https://issues.apache.org/jira/browse/FLINK-6643 Project: Flink

[jira] [Created] (FLINK-6641) HA recovery on YARN fails due to missing files in HDFS

2017-05-19 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6641: - Summary: HA recovery on YARN fails due to missing files in HDFS Key: FLINK-6641 URL: https://issues.apache.org/jira/browse/FLINK-6641 Project: Flink Issue

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-19 Thread Robert Metzger
>> > >>>>>>> On Thu, May 18, 2017 at 11:13 AM, Chesnay Schepler < > >>>>>>> ches...@apache.org> > >>>>>>> wrote: > >>>>>>> > >>>>>>> This PR reduces logging noise a bit: (got +1 to

Re: [DISCUSS] Reorganize Table API / SQL documentation

2017-05-18 Thread Robert Metzger
Thank you Fabian for working on the proposal. On Thu, May 18, 2017 at 3:51 PM, Fabian Hueske wrote: > Thanks for starting this discussion Robert. > > I think with the next release the Table API / SQL should be moved up in the > Application Development menu. > I also though about restructuring th

[DISCUSS] Reorganize Table API / SQL documentation

2017-05-18 Thread Robert Metzger
Hi, I'm wondering whether we should make the Table API a bit more prominent in our documentation by upgrading it from below "Libraries" to the same level as "DataSet" and "DataStream". This would also allow us to split it from one large page into smaller sub-pages. I think it would be nice to do

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-18 Thread Robert Metzger
? Otherwise, I would soon create the first voting RC. On Wed, May 17, 2017 at 8:49 PM, Eron Wright wrote: > Robert, please add FLINK-6606 to the list of JIRAs that you're tracking, > thanks. > > On Tue, May 16, 2017 at 8:30 AM, Robert Metzger > wrote: > > > I totally f

Re: Official Flink Docker images

2017-05-16 Thread Robert Metzger
rote: > > > Sure we would do it. I will sync with Patrick to do this quickly. > > > > > > On May 5, 2017 3:45 PM, "Robert Metzger" wrote: > > >> > > >> Thanks a lot for your efforts! > > >> > > >> Maybe we ca

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-16 Thread Robert Metzger
I'll write a dedicated email to user@ and dev@ :) On Tue, May 16, 2017 at 9:26 AM, Robert Metzger wrote: > Thanks for the pointer. I'll keep an eye on the JIRA. > > I've gone through the JIRAs tagged with 1.3.0 yesterday to create a list > of new features in 1.3. Feel

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-16 Thread Robert Metzger
e.org/jira/browse/FLINK-6537 > > Gyula > > Robert Metzger ezt írta (időpont: 2017. máj. 15., H, > 19:41): > > > Hi Devs, > > > > This is the second non-voting RC. The last RC had some big issues, making > > it hard to start Flink locally. I hope this RC pro

[DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-15 Thread Robert Metzger
Hi Devs, This is the second non-voting RC. The last RC had some big issues, making it hard to start Flink locally. I hope this RC proves to be more stable. I hope to create the first voting RC by end of this week. - The release

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-15 Thread Robert Metzger
shading issues make it virtually > unusable... > > On Fri, May 12, 2017 at 3:45 PM, Robert Metzger > wrote: > > > I'm considering to do another non voting RC1 on Monday with the > incremental > > checkpointing and maven fixes in (and of course as many other thin

[jira] [Created] (FLINK-6580) Flink on YARN doesnt start with default parameters

2017-05-15 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6580: - Summary: Flink on YARN doesnt start with default parameters Key: FLINK-6580 URL: https://issues.apache.org/jira/browse/FLINK-6580 Project: Flink Issue

[jira] [Created] (FLINK-6570) QueryableStateClient constructor in documentation doesn't match actual signature

2017-05-12 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6570: - Summary: QueryableStateClient constructor in documentation doesn't match actual signature Key: FLINK-6570 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-6569) flink-table KafkaJsonTableSource example doesn't work

2017-05-12 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6569: - Summary: flink-table KafkaJsonTableSource example doesn't work Key: FLINK-6569 URL: https://issues.apache.org/jira/browse/FLINK-6569 Project: Flink

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-12 Thread Robert Metzger
dditional bug fixes. > > > > On May 11, 2017, at 10:19 AM, Robert Metzger > wrote: > > > > It seems that we found quite a large number of critical issues in the > first > > RC. > > > > - FLINK-6537 Umbrella issue for fixes to incremental snapshots (St

[jira] [Created] (FLINK-6568) flink-table doesn't work without flink-streaming-scala dependency

2017-05-12 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6568: - Summary: flink-table doesn't work without flink-streaming-scala dependency Key: FLINK-6568 URL: https://issues.apache.org/jira/browse/FLINK-6568 Project:

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-11 Thread Robert Metzger
t;> org.apache.hadoop.security.UserGroupInformation > > > > >>>>>> at > > > > >>>>>> > > > > >>>>> > > > > >>>> org.apache.flink.runtime.security.modules.HadoopModule. > > > &

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-09 Thread Robert Metzger
E are okay > >>>>> > >>>>> - In the shaded JAR files, we are not bundling the license and > >>>>> notice files of the dependencies we include in the shaded jars. > >>>>> => Not a problem for Guava (Apache Licensed

[DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-08 Thread Robert Metzger
Hi Devs, I've created a first non-voting release candidate for Flink 1.3.0. Please use this RC to test as much as you can and provide feedback to the Flink community. The more we find and fix now, the better Flink 1.3.0 wil be :) I've CC'ed the user@ mailing list to get more people to test it. DO

Re: [DISCUSS] Feature Freeze

2017-05-08 Thread Robert Metzger
works. On Mon, May 8, 2017 at 9:56 AM, Kostas Kloudas wrote: > Hi Robert, > > Thanks for starting the process! > > My only remark is that given that the master is unstable, does it make > sense to create an RC0? > > Kostas > > > On May 8, 2017, at 8:52 AM, Robert

Re: [DISCUSS] Feature Freeze

2017-05-07 Thread Robert Metzger
Great! It also looks like the other big features made it also into master this weekend. I'll now create the feature branch and create the testing RC0. On Sat, May 6, 2017 at 12:04 PM, Fabian Hueske wrote: > I merged the last to major features for the Table API / SQL (time > indicators and retra

Re: Official Flink Docker images

2017-05-05 Thread Robert Metzger
Thanks a lot for your efforts! Maybe we can even put a small blog post on the Flink post once its available on docker hub. On Fri, Apr 28, 2017 at 11:00 AM, Ismaël Mejía wrote: > Hello, > > I am absolutely happy to see that this is finally happening! > We have a really neat image right now and

Re: [DISCUSS] Feature Freeze

2017-05-05 Thread Robert Metzger
> > -Original Message- > From: Robert Metzger [mailto:rmetz...@apache.org] > Sent: Friday, May 05, 2017 10:43 AM > To: dev@flink.apache.org > Subject: Re: [DISCUSS] Feature Freeze > > I've checked the release status again, and it seems that some more issues > m

Re: [DISCUSS] Feature Freeze

2017-05-05 Thread Robert Metzger
tures to be added for 1.3 > >> is the NOT pattern for the CEP library. > >> > >> There is an open PR here: https://github.com/apache/flink/pull/3798 < > >> https://github.com/apache/flink/pull/3798> > >> which is not far from getting in. > >>

Re: [DISCUSS] What is a "Blocker" in our JIRA?

2017-05-05 Thread Robert Metzger
hem. > >> > >> There are important parts of Flink which are not (sufficiently or at > all) > >> documented > >> and this can result in confusion / load in the mailing list / wrong user > >> assumptions. > >> > >> Regards, > >> Kostas

[DISCUSS] What is a "Blocker" in our JIRA?

2017-05-04 Thread Robert Metzger
Hi Flink Devs, while checking our JIRA for the 1.3 release, I found that some issues of type "New Feature" have the priority "Blocker". With the time-based release model, I don't think its possible to mark a new feature as a blocker. Only a bug that leads to wrong results, system failure or compl

Re: [DISCUSS] Feature Freeze

2017-05-02 Thread Robert Metzger
ures available in Flink 1.3: > > >>>>>>>> > > >>>>>>>> * Support for complex schema: FLINK-6033, FLINK-6377 > > >>>>>>>> * Various improvements on SQL over group windows: FLINK-6335, > > >>>

Re: [RESULT] [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-25 Thread Robert Metzger
Good point. I've included it into the pull request. On Tue, Apr 25, 2017 at 11:16 AM, Ted Yu wrote: > Should FLINK-6353 <https://issues.apache.org/jira/browse/FLINK-6353> be > mentioned in the announcement ? > > Cheers > > On Tue, Apr 25, 2017 at 2:09 AM, Robert

Re: [RESULT] [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-25 Thread Robert Metzger
I've uploaded the artifacts to the apache mirrors and released the maven stuff to central. While the artifacts are syncing, please review the release announcement: https://github.com/apache/flink-web/pull/54 On Tue, Apr 25, 2017 at 10:29 AM, Robert Metzger wrote: > Okay, I'll the

[RESULT] [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-25 Thread Robert Metzger
> >> wrote: > >> > >>> It means that users cannot restore from 1.2.0 to 1.2.0, 1.2.0 to > 1.2.1, or > >>> 1.2.1 to 1.2.1. However, this only happens when using the > >>> CheckpointedRestoring interface, which you have to do when you w

Re: [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-23 Thread Robert Metzger
gt; > Hash files look good > > No 3rd party exes in source artifact > > Source compiled and pass tests > > Local run work > > Run simple job on YARN > > > > +1 > > > > - Henry > > > > On Wed, Apr 12, 2017 at 4:06 PM, Robert Metzger > wrot

Re: [DISCUSS] Planning Release 1.3

2017-04-21 Thread Robert Metzger
Quick reminder: *The feature freeze is 1 week from now (May 1)* On Mon, Mar 6, 2017 at 1:03 PM, Stephan Ewen wrote: > Looks good to me! > > > On Mon, Mar 6, 2017 at 10:55 AM, Robert Metzger > wrote: > > > That's the right attitude :) > > > > Since one m

[VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-12 Thread Robert Metzger
Dear Flink community, Please vote on releasing the following candidate as Apache Flink version 1.2 .1. The commit to be voted on: 76eba4e0 (*http://git-wip-us.apache.org/repos/asf/flink/commit/76eba4e0

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-04-10 Thread Robert Metzger
I've now started building the next release candidate. On Sun, Apr 9, 2017 at 12:37 PM, Robert Metzger wrote: > Hi Gyula, > > I'm trying to push Stefan R. to get the RocksDB fixes in asap. > > On Sat, Apr 8, 2017 at 5:17 PM, Gyula Fóra wrote: > >> Hi All, &

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-04-09 Thread Robert Metzger
; > > > > >>> > > >>> wrote: > > >>>> > > >>>> I have created a custom build of RocksDB 4.11.2 that fixes a > > significant > > >>> > > >>> performance problem with append operat

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-04-04 Thread Robert Metzger
rallelism() methods can't cope with default parallelism > >>>>>> - https://issues.apache.org/jira/browse/FLINK-6209: > >>>>>> StreamPlanEnvironment always has a parallelism of 1 > >>>>>> > >>>>>> IMHO, the opti

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-31 Thread Robert Metzger
ache.org/jira/browse/FLINK-6188 > > On Fri, Mar 31, 2017, at 19:10, Robert Metzger wrote: > > I think reverting FLINK-6188 for the 1.2 branch might be a good idea. > > FLINK-6188 introduced two new bugs, so undoing the FLINK-6188 fix will > > lead > > only to one known b

Re: [DISCUSS] Project build time and possible restructuring

2017-03-31 Thread Robert Metzger
? > > Has anyone looked into why we see many jobs timeout right at 50 minutes? > Passing job take well under 50 minutes and the 5 minute watchdog timeout is > not being triggered. Just pulling up a recent build: > https://travis-ci.org/apache/flink/builds/217034084 > > Greg &g

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-31 Thread Robert Metzger
slinding window assigners > >> contain > >> > > a pretty obvious bug about offsets. > >> > > > >> > > https://issues.apache.org/jira/browse/FLINK-6214 > >> > > > >> > > I think we should also fix this for 1.2.1. What

Re: [DISCUSS] Project build time and possible restructuring

2017-03-31 Thread Robert Metzger
ot; to 120 minutes. Also, we can set the settings to use the "sudo enabled infrastructure", with 7.5 Gb of main memory guaranteed. I'll do a push to a separate branch to see how well it works :) On Tue, Mar 28, 2017 at 4:36 PM, Robert Metzger wrote: > I think your selection of m

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-29 Thread Robert Metzger
gt; > > >>> I think that’s blocking for 1.2.1. > > >>> > > >>>> On 24 Mar 2017, at 18:57, Ufuk Celebi wrote: > > >>>> > > >>>> RC1 doesn't contain Stefan's backport for the Asynchronous sn

Re: [DISCUSS] Project build time and possible restructuring

2017-03-28 Thread Robert Metzger
//gist.github.com/greghogan/f38a8efe6b6dd5a162a6b43335ac4897> >>>> >>>> Accounting for the merging of the batch and streaming connector modules, >>>> and assuming that the project structure has not changed much over the >>>> past >>>> 15 mo

[CANCEL][VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-27 Thread Robert Metzger
> RC1 doesn't contain Stefan's backport for the Asynchronous snapshots >>>>> for heap-based keyed state that has been merged. Should we create RC2 >>>>> with that fix since the voting period only starts on Monday? I think >>>>> it wo

[ANNOUNCE] Flink Forward San Francisco 10-11 Apr 2017 community discount codes

2017-03-24 Thread Robert Metzger
Dear Flink community, I would like to bring Flink Forward San Francisco to your attention. After hosting Flink Forward for two years in Berlin, Germany, we decided to bring it to the US west coast as well. Check out this very nice video summary from last year's conference in Berlin: https://www.y

[VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-24 Thread Robert Metzger
Dear Flink community, Please vote on releasing the following candidate as Apache Flink version 1.2 .1. The commit to be voted on: *732e55bd* (*http://git-wip-us.apache.org/repos/asf/flink/commit/732e55bd *) Branch: release-1.2.1-rc1

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-24 Thread Robert Metzger
.2.1 tomorrow. > > Also, we’re still lacking a release manager for 1.2.1. Is anyone > interested in volunteering for this release? > If nobody steps up for it before tomorrow, I can also do it. > > Cheers, > Gordon > > On March 18, 2017 at 12:52:48 AM, Robert Metzger (rme

[jira] [Created] (FLINK-6181) Zookeeper scripts use invalid regex

2017-03-24 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6181: - Summary: Zookeeper scripts use invalid regex Key: FLINK-6181 URL: https://issues.apache.org/jira/browse/FLINK-6181 Project: Flink Issue Type: Bug

Re: Flink AUR package is available

2017-03-23 Thread Robert Metzger
Amazing, thanks a lot! On Thu, Mar 23, 2017 at 10:36 AM, Tao Meng wrote: > Hi all, > > For arch linux users, I have created flink AUR package. > We can use the package manager to install flink and use the systemd > manager flink as service. > If you have any questions or suggestions please fee

Re: [POLL] Who still uses Java 7 with Flink ?

2017-03-23 Thread Robert Metzger
ch current, old-tech > compatible version at a reasonably limited scope. Building backward > compatibility is too much for an open sourced project > > > > On Wed, Mar 15, 2017 at 7:10 AM, Robert Metzger > wrote: > >> I've put it also on our Twitter account: >> h

Re: [VOTE] Release Apache Flink 1.1.5 (RC1)

2017-03-21 Thread Robert Metzger
+1 - start-local.sh + some example jobs work (logs are fine, web interface works, scripts are fine) - files in the staging repo look good (quickstart is correct) (except java8 module is missing, but see comment below) Side note: The flink-java8 module is not in the staging repository. I first co

[ANNOUNCE] New committer: Theodore Vasiloudis

2017-03-21 Thread Robert Metzger
Hi everybody, On behalf of the PMC I am delighted to announce Theodore Vasiloudis as a new Flink committer! Theo has been a community member for a very long time and he is one of the main drivers of the currently ongoing ML discussions in Flink. Welcome Theo and congratulations again for becomi

Re: [DISCUSS] Project build time and possible restructuring

2017-03-20 Thread Robert Metzger
this would not solve > all problems but many of it. > > What do you think about this? > > > > Am 20/03/17 um 14:02 schrieb Robert Metzger: > > Aljoscha, do you know how to configure jenkins? >> Is Apache INFRA doing that, or are the beam people doing that themselves? &

Re: [DISCUSS] Project build time and possible restructuring

2017-03-20 Thread Robert Metzger
apache.org/job >> /beam_PostCommit_Java_RunnableOnService_Flink/lastUnstableBuild/>. There >> you can see which tests failed and you can easily drill down. >> >> Best, >> Aljoscha >> >> On 20 Mar 2017, at 11:46, Robert Metzger wrote: >>> >>

Re: [DISCUSS] Project build time and possible restructuring

2017-03-20 Thread Robert Metzger
gt; > > since "2016-01-01" > > 272 of 2561 commits were mixed > > > > Greg > > > > > > > On Mar 15, 2017, at 1:13 PM, Stephan Ewen wrote: > > > > > > @Robert - I think once we know that a separate git repo works well, and

[jira] [Created] (FLINK-6125) Commons httpclient is not shaded anymore in Flink 1.2

2017-03-20 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6125: - Summary: Commons httpclient is not shaded anymore in Flink 1.2 Key: FLINK-6125 URL: https://issues.apache.org/jira/browse/FLINK-6125 Project: Flink Issue

Re: Bumping API stability check version

2017-03-17 Thread Robert Metzger
; Do you think these configuration changes can be scripted as part of the > release process? > > Greg > > > > On Mar 16, 2017, at 12:29 PM, Robert Metzger > wrote: > > > > Hi Greg, > > > > I was not able to update the version to 1.2.0 when updating

Re: [DISCUSS] Could we Improve tests time and stability?

2017-03-17 Thread Robert Metzger
> Total 26187 sec |23726 sec > -- > Acceleration|9.40% > > I think almost 10% is good enough. > > -Original Message- > From: Robert Metzger [mailto:rmetz...@apache.org] > Sent: Thursday, March 16,

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-17 Thread Robert Metzger
ote: > > > Update for 1.1.5: > > > The last fixes for 1.1.5 are in! I will create the RC today and start > > the vote. > > > > > > Cheers, > > > Gordon > > > > > > > > > On March 17, 2017 at 1:14:53 AM, Robert Metzg

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-16 Thread Robert Metzger
The cassandra connector is probably not usable in Flink 1.2.0. I would like to include a fix in 1.2.1: https://issues.apache.org/jira/browse/FLINK-6084 Please let me know if this fix becomes a blocker for the 1.2.1 release. If so, I can validate the fix myself to speed up things. On Thu, Mar 16,

[jira] [Created] (FLINK-6084) Cassandra connector does not declare all dependencies

2017-03-16 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6084: - Summary: Cassandra connector does not declare all dependencies Key: FLINK-6084 URL: https://issues.apache.org/jira/browse/FLINK-6084 Project: Flink Issue

Re: Bumping API stability check version

2017-03-16 Thread Robert Metzger
Hi Greg, I was not able to update the version to 1.2.0 when updating to 1.3-SNAPSHOT, because 1.2.0 was not released at that point in time :) But I agree that we should update that version once the release is out. I forgot to do it. I'm not sure if I completely understand "breakBuildOnModificatio

Re: [DISCUSS] Could we Improve tests time and stability?

2017-03-16 Thread Robert Metzger
Hi Dmytro, I'm happy to hear that you are trying to help us improving the test time situation :) We have another discussion here on the dev@ list to split the project into two git repositories to resolve the problem. I agree that your proposed changes could improve the build times, but I'm not su

[jira] [Created] (FLINK-6065) Make TransportClient for ES5 pluggable

2017-03-15 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6065: - Summary: Make TransportClient for ES5 pluggable Key: FLINK-6065 URL: https://issues.apache.org/jira/browse/FLINK-6065 Project: Flink Issue Type

Re: [DISCUSS] Project build time and possible restructuring

2017-03-15 Thread Robert Metzger
after having > it built as a dependency for flink-libraries? This seems wrong to me. > > Cheers, > Till > > On Wed, Mar 15, 2017 at 4:23 PM, Robert Metzger > wrote: > > > Thank you. Running on AWS is a good idea! > > Let me know if you (or anybody else) wants to

Re: [DISCUSS] Project build time and possible restructuring

2017-03-15 Thread Robert Metzger
s. > > Should we maintain separate repos for flink-contrib and flink-libraries? > Are you intending that we move flink-table out of flink-libraries (and > perhaps flink-statebackend-rocksdb out of flink-contrib)? > > Greg > > > > On Mar 15, 2017, at 9:55 AM, Robert Metzger

Re: [POLL] Who still uses Java 7 with Flink ?

2017-03-15 Thread Robert Metzger
I've put it also on our Twitter account: https://twitter.com/ApacheFlink/status/842015062667755521 On Wed, Mar 15, 2017 at 2:19 PM, Martin Neumann wrote: > I think this easier done in a straw poll than in an email conversation. > I created one at: http://www.strawpoll.me/12535073 > (Note that yo

Re: [DISCUSS] Project build time and possible restructuring

2017-03-15 Thread Robert Metzger
lly easier for libraries to get actively developed. The main > > > concern is setting up the build infrastructure to aggregate docs from > > > multiple repositories and making them publicly available. > > > > > > Since I started this thread and I would really

Re: [DISCUSS] Official policy for release maintenance

2017-03-14 Thread Robert Metzger
and link from the downloads page or the other way around? I don't know > what's better. > > > On Tue, Mar 14, 2017 at 2:52 PM, Robert Metzger > wrote: > > I'll update the Wikipedia article and include the details into our wiki. > > > > In addition

Re: [DISCUSS] Official policy for release maintenance

2017-03-14 Thread Robert Metzger
I'll update the Wikipedia article and include the details into our wiki. In addition, what do you think about adding the "update guarantees" on the download or FAQ page? On Tue, Mar 14, 2017 at 1:18 PM, Ufuk Celebi wrote: > Hey Ismael, > > thanks for bringing this up. I think it's a very import

<    5   6   7   8   9   10   11   12   13   14   >