Re: FLIP-6 and FLIP-12

2016-10-26 Thread David Wang
+1 sounds great! Thanks, David 2016-10-26 20:07 GMT+08:00 Till Rohrmann : > +1 for the changes and thanks for updating the Flips. > > Cheers, > Till > > On Wed, Oct 26, 2016 at 1:05 PM, Stephan Ewen wrote: > > > Hi all! > > > > I updated the wiki with

[jira] [Created] (FLINK-4938) Unnecessary update() call for Views to be removed in ViewUpdater#run()

2016-10-26 Thread Ted Yu (JIRA)
Ted Yu created FLINK-4938: - Summary: Unnecessary update() call for Views to be removed in ViewUpdater#run() Key: FLINK-4938 URL: https://issues.apache.org/jira/browse/FLINK-4938 Project: Flink

Re: [Discuss] FLIP-13 Side Outputs in Flink

2016-10-26 Thread CPC
Is it just related to stream api? This feature could be really useful for etl scenarios with dataset api as well. On Oct 26, 2016 22:29, "Fabian Hueske" wrote: > Hi Chen, > > thanks for this interesting proposal. I think side output would be a very > valuable feature to have!

[jira] [Created] (FLINK-4937) Add incremental group window aggregation for streaming Table API

2016-10-26 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-4937: Summary: Add incremental group window aggregation for streaming Table API Key: FLINK-4937 URL: https://issues.apache.org/jira/browse/FLINK-4937 Project: Flink

Re: [DISCUSS] Releasing Flink 1.1.4

2016-10-26 Thread dan bress
+1 for this release, also +1 to Chesnay's suggesting for including this: [FLINK-4875] [metrics] Use correct operator name Dan On Wed, Oct 26, 2016 at 5:06 AM Till Rohrmann wrote: > I'll work on FLINK-3347. Additionally I would like to get in > > -

Re: [Discuss] FLIP-13 Side Outputs in Flink

2016-10-26 Thread Fabian Hueske
Hi Chen, thanks for this interesting proposal. I think side output would be a very valuable feature to have! I went of the FLIP and have a few questions. - Will multiple side outputs of the same type be supported? - If I got it right, the FLIP proposes to change the signatures of many

[jira] [Created] (FLINK-4936) Operator names for Gelly inputs

2016-10-26 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-4936: - Summary: Operator names for Gelly inputs Key: FLINK-4936 URL: https://issues.apache.org/jira/browse/FLINK-4936 Project: Flink Issue Type: Improvement

[DISCUSS] Make FieldAccessor logic consistent with remaining API

2016-10-26 Thread Fabian Hueske
Hi everybody, while reviewing PR #2094 [1] I noticed that the field reference syntax for FieldAccessors is not compatible with the syntax supported for key definitions (ExpressionKeys) used in groupBy(), keyBy(), join().where().equalTo(), etc. FieldAccessors are only used for build-in

Re: Flink 1.2-SNAPSHOT Bucketing Sink problem

2016-10-26 Thread Fabian Hueske
This feature will be included in the upcoming 1.2.0 release. The discussion about the next minor release has already started [1]. According to the current schedule we are targeting a first release end of November which means we might have a release by mid December. Cheers, Fabian [1]

Re: 答复: RE:[DISCUSS] FLIP-11: Table API Stream Aggregations

2016-10-26 Thread Stephan Ewen
Hi all! I think that in order to get a better hold on how we what to build the Table API, we need to *decide what the role of the Table API should be*. We touched on that a few times, but I think we still have different ideas about that. To get there, let me take back a step and look at the

Ynt: Flink 1.2-SNAPSHOT Bucketing Sink problem

2016-10-26 Thread Ozan DENİZ
Hi Fabian, Thank you for quick response. We will check the versions of the flink in cluster and maven. By the way, the BucketingSink function is really good at sinking to hdfs (Especially for event time file naming). However, currently in version 1.1.3, the RollingSink function is used. Is

Re: Flink 1.2-SNAPSHOT Bucketing Sink problem

2016-10-26 Thread Fabian Hueske
Hi Ozan, a NoSuchMethodError indicates a version mismatch. Since you are using a SNAPSHOT build it is likely that dependencies changed when you recompiled Flink or your job. You should make sure that you are using the same version (on SNAPSHOT the same commit) for jobs and cluster. Best, Fabian

[jira] [Created] (FLINK-4935) Submit job with savepoint via REST API

2016-10-26 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-4935: -- Summary: Submit job with savepoint via REST API Key: FLINK-4935 URL: https://issues.apache.org/jira/browse/FLINK-4935 Project: Flink Issue Type: Improvement

Flink 1.2-SNAPSHOT Bucketing Sink problem

2016-10-26 Thread Ozan DENİZ
Hi everyone, We are currently using BucketingSink (Flink 1.2-SNAPSHOT) function for sink operation. The BucketingSink function was working correctly. However today, when I put the job on cluster I got this error; java.lang.NoSuchMethodError:

Re: [DISCUSS] FLIP-13: Consistent Processing with Loops

2016-10-26 Thread Paris Carbone
Hey all, Now that many of you have already scanned the document (judging from the views) maybe it is time to give back some feedback! Did you like it? Would you suggest an improvement? I would suggest not to leave this in the void. It has to do with important properties that the system

[jira] [Created] (FLINK-4934) Triadic Census

2016-10-26 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-4934: - Summary: Triadic Census Key: FLINK-4934 URL: https://issues.apache.org/jira/browse/FLINK-4934 Project: Flink Issue Type: New Feature Components: Gelly

Re: [DISCUSS] Schedule and Scope for Flink 1.2

2016-10-26 Thread Till Rohrmann
+1 for the features to include. What is the state of the Trigger DSL? How much is left to be done before merging? Cheers, Till On Tue, Oct 25, 2016 at 4:32 PM, Aljoscha Krettek wrote: > +1 the schedule proposed so far. > > Do we also want to get in the "Trigger DSL" that

Re: FLIP-6 and FLIP-12

2016-10-26 Thread Till Rohrmann
+1 for the changes and thanks for updating the Flips. Cheers, Till On Wed, Oct 26, 2016 at 1:05 PM, Stephan Ewen wrote: > Hi all! > > I updated the wiki with the following: > > FLIP-12 (async I/O) should go into Flink 1.2. A pull request is there, > reviews have started. > >

Re: [DISCUSS] Releasing Flink 1.1.4

2016-10-26 Thread Till Rohrmann
I'll work on FLINK-3347. Additionally I would like to get in - https://issues.apache.org/jira/browse/FLINK-4932: Don't let ExecutionGraph fail when in state Restarting - https://issues.apache.org/jira/browse/FLINK-4933: ExecutionGraph.scheduleOrUpdateConsumers can fail the ExecutionGraph Cheers,

[jira] [Created] (FLINK-4933) ExecutionGraph.scheduleOrUpdateConsumers can fail the ExecutionGraph

2016-10-26 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4933: Summary: ExecutionGraph.scheduleOrUpdateConsumers can fail the ExecutionGraph Key: FLINK-4933 URL: https://issues.apache.org/jira/browse/FLINK-4933 Project: Flink

Re: [DISCUSS] Releasing Flink 1.1.4

2016-10-26 Thread Stefan Richter
I think changes in behaviour should be limited to the case of streams that obtained from FileSystem within a task's main thread (or any of its child threads) and are also still used after that task finished. > Am 26.10.2016 um 13:02 schrieb Stephan Ewen : > > Concerning

[jira] [Created] (FLINK-4932) Don't let ExecutionGraph fail when in state Restarting

2016-10-26 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4932: Summary: Don't let ExecutionGraph fail when in state Restarting Key: FLINK-4932 URL: https://issues.apache.org/jira/browse/FLINK-4932 Project: Flink Issue

[jira] [Created] (FLINK-4929) Implement YARN TaskManager Runner

2016-10-26 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4929: --- Summary: Implement YARN TaskManager Runner Key: FLINK-4929 URL: https://issues.apache.org/jira/browse/FLINK-4929 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4928) Implement YARN Application Master Runner

2016-10-26 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4928: --- Summary: Implement YARN Application Master Runner Key: FLINK-4928 URL: https://issues.apache.org/jira/browse/FLINK-4928 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4927) Implement YARN Resource Manager

2016-10-26 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4927: --- Summary: Implement YARN Resource Manager Key: FLINK-4927 URL: https://issues.apache.org/jira/browse/FLINK-4927 Project: Flink Issue Type: Sub-task

Re: SVMITSuite Testing

2016-10-26 Thread Theodore Vasiloudis
Hello Jesse, Could you tell us how you try to run the tests? As Gabor said if you are using IDEA the easiest way to run a specific test is to open the test file, right click somewhere in the code and select "Run SVMITSuite" Regards, Theodore On Oct 25, 2016 9:54 PM, "Jesse Bannon"

Re: [DISCUSS] Releasing Flink 1.1.4

2016-10-26 Thread Stephan Ewen
Concerning backporting the "I/O streams safety net" - we need to make sure that this does not change any behavior that users may implicitly expect. On Wed, Oct 26, 2016 at 11:21 AM, Maximilian Michels wrote: > +1 for a 1.1.4 release > > We could backport putting user jars into

Re: [DISCUSS] Releasing Flink 1.1.4

2016-10-26 Thread Maximilian Michels
+1 for a 1.1.4 release We could backport putting user jars into the system class loader for per-job Yarn clusters: https://github.com/apache/flink/pull/2692 Arguably, this is somewhat a new feature but it gets rid of duplicate class loading issues users experienced in practice. We already have

Re: SVMITSuite Testing

2016-10-26 Thread Gábor Hermann
Hi Jesse, Have you tried running the test in an IDE (e.g. Intellij IDEA)? AFAIK they have support for ScalaTest. When running a Maven build, it seems to skip integration tests (ones marked with "IT") intentionally. I assume it would take much time to run those tests. You can run them by

Re: [DISCUSS] Releasing Flink 1.1.4

2016-10-26 Thread Stefan Richter
+1 I think it could make sense to backport my safety net PR https://github.com/apache/flink/pull/2691for 1.1.4. The changes are pretty much isolated and it could help a lot about resource leaks and task cancelation times. Best, Stefan > Am

RE: DataStream#explain

2016-10-26 Thread Anton Solovev
Sorry, wrong issue number Question is about https://issues.apache.org/jira/browse/FLINK-4623 And in subject should be StreamExecutionEnvironment#explain actually -Original Message- From: Anton Solovev [mailto:anton_solo...@epam.com] Sent: Wednesday, October 26, 2016 12:30 PM To:

DataStream#explain

2016-10-26 Thread Anton Solovev
Hello, I have started doing https://issues.apache.org/jira/browse/FLINK-4743 What should explain of DataStream look like? Best regards, Anton