[jira] [Created] (FLINK-6420) Cleaner CEP API to specify conditions between events

2017-04-28 Thread Elias Levy (JIRA)
Elias Levy created FLINK-6420: - Summary: Cleaner CEP API to specify conditions between events Key: FLINK-6420 URL: https://issues.apache.org/jira/browse/FLINK-6420 Project: Flink Issue Type:

[jira] [Created] (FLINK-6419) Better support for CEP quantified conditions in PatternSelect.select

2017-04-28 Thread Elias Levy (JIRA)
Elias Levy created FLINK-6419: - Summary: Better support for CEP quantified conditions in PatternSelect.select Key: FLINK-6419 URL: https://issues.apache.org/jira/browse/FLINK-6419 Project: Flink

Re: Idempotent Job Submission

2017-04-28 Thread Till Rohrmann
Hi James, I think if you keep the JobGraph around and don’t generate it by re-executing the user code, then you will have the same JobID when re-submitting this JobGraph. This should allow you to do idempotent job submissions. However, if you use Flink’s high availability mode, then you should

Re: [DISCUSS] Feature Freeze

2017-04-28 Thread Chesnay Schepler
FLINK-5892 has been merged. For FLINK-4545 (replacing numNetworkBuffer parameter) a PR is also still open and could use a second pair of eyes. On 28.04.2017 17:03, Kurt Young wrote: Hi Flavio, I have also fix the issue in 1.2 branch, but the next release will be 1.2.2 Best, Kurt On Fri,

[jira] [Created] (FLINK-6417) Wildcard support for read text file

2017-04-28 Thread Artiom Darie (JIRA)
Artiom Darie created FLINK-6417: --- Summary: Wildcard support for read text file Key: FLINK-6417 URL: https://issues.apache.org/jira/browse/FLINK-6417 Project: Flink Issue Type: New Feature

Re: [DISCUSS] Feature Freeze

2017-04-28 Thread Kurt Young
Hi Flavio, I have also fix the issue in 1.2 branch, but the next release will be 1.2.2 Best, Kurt On Fri, Apr 28, 2017 at 11:01 PM, Ted Yu wrote: > Flavio: > Have you seen this (w.r.t. 1.2.1) ? > > http://search-hadoop.com/m/Flink/VkLeQejxLg24Lk0D1?subj=+ >

Re: [DISCUSS] Feature Freeze

2017-04-28 Thread Ted Yu
Flavio: Have you seen this (w.r.t. 1.2.1) ? http://search-hadoop.com/m/Flink/VkLeQejxLg24Lk0D1?subj=+RESULT+VOTE+Release+Apache+Flink+1+2+1+RC2+ On Fri, Apr 28, 2017 at 5:07 AM, Flavio Pompermaier wrote: > Any chance to cherry-pick this also into 1.2.1? We're usign Flink

[jira] [Created] (FLINK-6415) Make sure Flink artifacts have no specific logger dependency

2017-04-28 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-6415: --- Summary: Make sure Flink artifacts have no specific logger dependency Key: FLINK-6415 URL: https://issues.apache.org/jira/browse/FLINK-6415 Project: Flink

[jira] [Created] (FLINK-6414) Use scala.binary.version in place of change-scala-version.sh

2017-04-28 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-6414: - Summary: Use scala.binary.version in place of change-scala-version.sh Key: FLINK-6414 URL: https://issues.apache.org/jira/browse/FLINK-6414 Project: Flink Issue

[jira] [Created] (FLINK-6413) Add stream operator callback to notify about consumed network buffer

2017-04-28 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-6413: --- Summary: Add stream operator callback to notify about consumed network buffer Key: FLINK-6413 URL: https://issues.apache.org/jira/browse/FLINK-6413 Project:

Re: [DISCUSS] Feature Freeze

2017-04-28 Thread Flavio Pompermaier
Any chance to cherry-pick this also into 1.2.1? We're usign Flink 1.2.0 in production and maybe an upgrade to 1.2.1 would be a safer option in the short term.. Best, Flavio On Fri, Apr 28, 2017 at 2:00 PM, Aljoscha Krettek wrote: > Ah, I see. The fix for that has been

Re: [DISCUSS] Feature Freeze

2017-04-28 Thread Aljoscha Krettek
Ah, I see. The fix for that has been merged into master so it will be release in Flink 1.3. > On 28. Apr 2017, at 13:50, Flavio Pompermaier wrote: > > Sorry, you're right Aljosha..the issue number is correct, the link is > wrong! The correct one is

Re: [DISCUSS] Feature Freeze

2017-04-28 Thread Flavio Pompermaier
Sorry, you're right Aljosha..the issue number is correct, the link is wrong! The correct one is https://issues.apache.org/jira/browse/FLINK-6398 On Fri, Apr 28, 2017 at 11:48 AM, Aljoscha Krettek wrote: > I think there might be a typo. We haven’t yet reached issue number

[jira] [Created] (FLINK-6412) Stream has already been closed durign job cancel

2017-04-28 Thread Andrey (JIRA)
Andrey created FLINK-6412: - Summary: Stream has already been closed durign job cancel Key: FLINK-6412 URL: https://issues.apache.org/jira/browse/FLINK-6412 Project: Flink Issue Type: Bug Affects

[jira] [Created] (FLINK-6411) YarnApplicationMasterRunner should not interfere with RunningJobsRegistry

2017-04-28 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6411: Summary: YarnApplicationMasterRunner should not interfere with RunningJobsRegistry Key: FLINK-6411 URL: https://issues.apache.org/jira/browse/FLINK-6411 Project:

Re: question about rowtime processfunction - are watermarks needed?

2017-04-28 Thread Fabian Hueske
I woundn't say that the batch / stream unification doesn't hold. If you make the watermark lag enough (i.e., you do not have any late data) you get exact results, however, not very timely. Watermarks basically trade completeness of the result for result latency. With support for late updates, you

Re: [DISCUSS] Feature Freeze

2017-04-28 Thread Aljoscha Krettek
I think there might be a typo. We haven’t yet reached issue number 6389, if I’m not mistaken. The latest as I’m writing this is 6410. > On 28. Apr 2017, at 10:00, Flavio Pompermaier wrote: > > If it's not a problem it will be great for us to include also FLINK-6398 >

[jira] [Created] (FLINK-6410) build fails after changing Scala to 2.11

2017-04-28 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-6410: --- Summary: build fails after changing Scala to 2.11 Key: FLINK-6410 URL: https://issues.apache.org/jira/browse/FLINK-6410 Project: Flink Issue Type: Bug

RE: question about rowtime processfunction - are watermarks needed?

2017-04-28 Thread Radu Tudoran
Hi, Thanks again Fabian for the explanation. Considering what you said - is there anymore a duality with the batch case? As the stream cases are non-deterministic I would say the duality in the sense that a query on the stream should return the same as the query on the batched data does not

[jira] [Created] (FLINK-6409) TUMBLE/HOP/SESSION_START/END do not resolve time field correctly

2017-04-28 Thread Timo Walther (JIRA)
Timo Walther created FLINK-6409: --- Summary: TUMBLE/HOP/SESSION_START/END do not resolve time field correctly Key: FLINK-6409 URL: https://issues.apache.org/jira/browse/FLINK-6409 Project: Flink

Re: Official Flink Docker images

2017-04-28 Thread Ismaël Mejía
Hello, I am absolutely happy to see that this is finally happening! We have a really neat image right now and it is great that it will be soon so easy to use. One extra thing to mention is that Flink will have now two docker images, one based on debian and the other one based on Alpine as most

[jira] [Created] (FLINK-6408) Repeated loading of configuration files in hadoop filesystem code paths

2017-04-28 Thread Stephen Gran (JIRA)
Stephen Gran created FLINK-6408: --- Summary: Repeated loading of configuration files in hadoop filesystem code paths Key: FLINK-6408 URL: https://issues.apache.org/jira/browse/FLINK-6408 Project: Flink

Re: [DISCUSS] Feature Freeze

2017-04-28 Thread Flavio Pompermaier
If it's not a problem it will be great for us to include also FLINK-6398 if it's not a big deal Best, Flavio On Fri, Apr 28, 2017 at 3:32 AM, Zhuoluo Yang wrote: > Hi Devs, > > Thanks for the release plan. > >

Re: question about rowtime processfunction - are watermarks needed?

2017-04-28 Thread Fabian Hueske
Hi Radu, yes that might happen in a parallel setup and depends on the "speed" of the parallel threads. An operator does only increment its own event-time clock to the minimum of the last watermark received from each input channel. If one input channel is "slow", the event-time of an operator

[jira] [Created] (FLINK-6407) Upgrade AVRO dependency version to 1.8.x

2017-04-28 Thread Miguel (JIRA)
Miguel created FLINK-6407: - Summary: Upgrade AVRO dependency version to 1.8.x Key: FLINK-6407 URL: https://issues.apache.org/jira/browse/FLINK-6407 Project: Flink Issue Type: Wish

[jira] [Created] (FLINK-6406) Cleanup useless import

2017-04-28 Thread sunjincheng (JIRA)
sunjincheng created FLINK-6406: -- Summary: Cleanup useless import Key: FLINK-6406 URL: https://issues.apache.org/jira/browse/FLINK-6406 Project: Flink Issue Type: Improvement