[jira] [Created] (FLINK-5036) Perform the grouping of keys in restoring instead of checkpointing

2016-11-08 Thread Xiaogang Shi (JIRA)
Xiaogang Shi created FLINK-5036: --- Summary: Perform the grouping of keys in restoring instead of checkpointing Key: FLINK-5036 URL: https://issues.apache.org/jira/browse/FLINK-5036 Project: Flink

Re: [DISCUSS] Proposed updates to Flink project site

2016-11-08 Thread Tzu-Li (Gordon) Tai
Hi Mike, I really like the idea! Especially that you pointed out we need a substantial rework on the introduction page to let users that are new to modern streaming frameworks understand the space first. With this content as a prelude, once the detailed Flink contents kick in, it will

Re: [DISCUSS] Add Side Input/Broadcast Set For Streaming API

2016-11-08 Thread 吕文龙
Hi, all, we are also trying to find one way to do state initialization for stateful job, which has some external data stored in external storage. Side Input is a great feature meeting the requirement. I am looking forward to a full proposal including runtime implementations. 2016-11-01 21:52

Re: [DISCUSS] Proposed updates to Flink project site

2016-11-08 Thread Maximilian Michels
Hi Mike, Thanks for the proposal. It's a great idea to restructure the Flink web site. We have been adding more and more content to the site but it lacks structure. Especially new users would benefit from changes which make the web site more discoverable. >From the pdf, it looks like the main

Re: Left outer join

2016-11-08 Thread Fabian Hueske
This should work as well: input .leftOuterJoin(metrics) .where("*") .equalTo(0) { (left,right) => ... } 2016-11-08 23:10 GMT+01:00 Till Rohrmann : > Hi Thomas, > > either you map your input data set into a tuple input.map(x => Tuple1(x)) > or you specify a key

Re: Left outer join

2016-11-08 Thread Till Rohrmann
Hi Thomas, either you map your input data set into a tuple input.map(x => Tuple1(x)) or you specify a key selector leftOuterJoin(metrics).where(x => x).equalTo(0). I think the user ML u...@flink.apache.org would be a better place to ask Flink usage related questions. The dev ML is mainly used

Left outer join

2016-11-08 Thread Thomas FOURNIER
Hello, I'm facing an issue with leftOuterJoin: - input is a DataSet[String] - metrics is a DataSet[(String,Long)] I'm doing a leftOuterJoin like this: input .leftOuterJoin(metrics) .where(0) .equalTo(0) { (left,right) => ... } But I encounter the following error: Specifying keys via

Re: [DISCUSS] Releasing Flink 1.1.4

2016-11-08 Thread Stephan Ewen
I opened a pull request for the backport of [FLINK-4904] https://github.com/apache/flink/pull/2773 On Tue, Nov 8, 2016 at 2:00 PM, Stephan Ewen wrote: > The issue FLINK-4904 (Add a limit for how much data may be spilled in >

[jira] [Created] (FLINK-5035) Don't Write TypeSerializer to Heap State Snapshot

2016-11-08 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-5035: --- Summary: Don't Write TypeSerializer to Heap State Snapshot Key: FLINK-5035 URL: https://issues.apache.org/jira/browse/FLINK-5035 Project: Flink Issue

[jira] [Created] (FLINK-5034) Don't Write StateDescriptor to RocksDB Snapshot

2016-11-08 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-5034: --- Summary: Don't Write StateDescriptor to RocksDB Snapshot Key: FLINK-5034 URL: https://issues.apache.org/jira/browse/FLINK-5034 Project: Flink Issue

Re: Could Not Submit Job DataStream Because No Connection to a JobManager

2016-11-08 Thread daviD
Ah! Thanks Till. Now I am better informed :) -daviD On Tuesday, November 8, 2016 2:14 AM, Till Rohrmann wrote: Hi David, the dev ML is intended for technical discussions about Flink. Problems related to the usage of Flink should go to the

[jira] [Created] (FLINK-5033) CEP operators don't properly advance time

2016-11-08 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-5033: Summary: CEP operators don't properly advance time Key: FLINK-5033 URL: https://issues.apache.org/jira/browse/FLINK-5033 Project: Flink Issue Type: Bug

Re: Could Not Submit Job DataStream Because No Connection to a JobManager

2016-11-08 Thread Till Rohrmann
Hi David, the dev ML is intended for technical discussions about Flink. Problems related to the usage of Flink should go to the u...@flink.apache.org. Be aware that the ML does not allow attachments. Thus, we don't see your JobManager log. Cheers, Till On Mon, Nov 7, 2016 at 8:53 PM, daviD

Re: [DISCUSS] Proposed updates to Flink project site

2016-11-08 Thread Till Rohrmann
I agree with Aljoscha and Ufuk. Making the Flink website more accessible for newcomers would be a big gain :-) +1 for the changes. Cheers, Till On Tue, Nov 8, 2016 at 9:43 AM, Ufuk Celebi wrote: > I really like your proposal. +1. > > I did some of the previous site updates,

Re: [DISCUSS] Proposed updates to Flink project site

2016-11-08 Thread Ufuk Celebi
I really like your proposal. +1. I did some of the previous site updates, but never actually had the time to really think it through like you did. All main changes (start page, intro to Flink, and moving the quick starts) look very cool and well thought out. Looking forward to the initial PR.