[GitHub] flink pull request: [FLINK-2324] [streaming] Partitioned state che...

2015-07-29 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/937#issuecomment-125872157 Merging your PR fixed the exactly-once guarantees @StephanEwen , great! I also added an extra test for Partitioned states. Do you think it is okay to leave

[jira] [Commented] (FLINK-2324) Rework partitioned state storage

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645645#comment-14645645 ] ASF GitHub Bot commented on FLINK-2324: --- Github user gyfora commented on the pull re

[jira] [Commented] (FLINK-1901) Create sample operator for Dataset

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645658#comment-14645658 ] ASF GitHub Bot commented on FLINK-1901: --- GitHub user ChengXiangLi opened a pull requ

[GitHub] flink pull request: [FLINK-1901] [core] Create sample operator for...

2015-07-29 Thread ChengXiangLi
GitHub user ChengXiangLi opened a pull request: https://github.com/apache/flink/pull/949 [FLINK-1901] [core] Create sample operator for Dataset. This PR includes: 1. 4 random sampler implementation for different sample strategies. 2. sample operator for DataSet Java API.

[jira] [Closed] (FLINK-2418) Add an end-to-end streaming fault tolerance test for the Checkpointed interface

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2418. --- > Add an end-to-end streaming fault tolerance test for the Checkpointed > interface > --

[jira] [Resolved] (FLINK-2418) Add an end-to-end streaming fault tolerance test for the Checkpointed interface

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2418. - Resolution: Fixed Fixed via a0556efb233f15c6985d17886372a8b4b00392b2 > Add an end-to-end streami

[jira] [Closed] (FLINK-2421) StreamRecordSerializer incorrectly duplicates and misses tests

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2421. --- > StreamRecordSerializer incorrectly duplicates and misses tests > ---

[jira] [Closed] (FLINK-2420) OutputFlush thread in stream writers does not propagate exceptions

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2420. --- > OutputFlush thread in stream writers does not propagate exceptions > ---

[jira] [Resolved] (FLINK-2420) OutputFlush thread in stream writers does not propagate exceptions

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2420. - Resolution: Fixed Fixed via 8ba321332b994579f387add8bd0855bd29cb33ec > OutputFlush thread in stre

[jira] [Resolved] (FLINK-2421) StreamRecordSerializer incorrectly duplicates and misses tests

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2421. - Resolution: Fixed Fixed via 2d237e18a2f7cf21721340933c505bb518c4fc66 > StreamRecordSerializer inc

[jira] [Closed] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2406. --- > Abstract BarrierBuffer to an exchangeable BarrierHandler > -

[jira] [Resolved] (FLINK-2402) Add a non-blocking BarrierTracker

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2402. - Resolution: Implemented Implemented in 8f87b7164b644ea8f1708f7eb76567e58341b224 > Add a non-block

[jira] [Closed] (FLINK-2402) Add a non-blocking BarrierTracker

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2402. --- > Add a non-blocking BarrierTracker > - > > Key: FLINK-240

[jira] [Resolved] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2406. - Resolution: Fixed Fixed via 0579f90bab165a7df336163eb9d6337267020029 > Abstract BarrierBuffer to

[GitHub] flink pull request: [FLINK-2399] Version checks for Job Manager an...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/945#issuecomment-125886476 Using `getClass().getPackage().getImplementationVersion()` would be a decent first approach then, I guess. The critical part seems to be the Client-to-JobManager comm

[jira] [Commented] (FLINK-2399) Fail when actor versions don't match

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645737#comment-14645737 ] ASF GitHub Bot commented on FLINK-2399: --- Github user StephanEwen commented on the pu

[jira] [Commented] (FLINK-2424) InstantiationUtil.serializeObject(Object) does not close output stream

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645740#comment-14645740 ] Stephan Ewen commented on FLINK-2424: - oha, good one! > InstantiationUtil.serializeOb

[GitHub] flink pull request: [FLINK-2406] [FLINK-2402] Abstract the Barrier...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/938#issuecomment-125887226 It failed when at the end of the program, queued channel data was present at the end of the job. This happens only with slow consumers. Apparently, the local machines

[jira] [Commented] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645744#comment-14645744 ] ASF GitHub Bot commented on FLINK-2406: --- Github user StephanEwen commented on the pu

[jira] [Commented] (FLINK-2391) Storm-compatibility:method FlinkTopologyBuilder.createTopology() throws java.lang.NullPointerException

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645748#comment-14645748 ] ASF GitHub Bot commented on FLINK-2391: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-2391]Fix Storm-compatibility FlinkTopol...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/940#issuecomment-125887557 Will merge this... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[jira] [Commented] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645749#comment-14645749 ] ASF GitHub Bot commented on FLINK-2406: --- Github user uce commented on the pull reque

[GitHub] flink pull request: [FLINK-2406] [FLINK-2402] Abstract the Barrier...

2015-07-29 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/938#issuecomment-125887588 I really love Travis :heart: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] flink pull request: [FLINK-2406] [FLINK-2402] Abstract the Barrier...

2015-07-29 Thread StephanEwen
Github user StephanEwen closed the pull request at: https://github.com/apache/flink/pull/938 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645761#comment-14645761 ] ASF GitHub Bot commented on FLINK-2406: --- Github user StephanEwen closed the pull req

[jira] [Commented] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645760#comment-14645760 ] ASF GitHub Bot commented on FLINK-2406: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-2406] [FLINK-2402] Abstract the Barrier...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/938#issuecomment-125889092 Manually merged in 8f87b7164b644ea8f1708f7eb76567e58341b224 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] flink pull request: [FLINK-2231] Create a Serializer for Scala Enu...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/935#discussion_r35741171 --- Diff: flink-scala/src/main/scala/org/apache/flink/api/scala/typeutils/EnumValueSerializer.scala --- @@ -0,0 +1,61 @@ +/* + * Licensed to the A

[jira] [Commented] (FLINK-2231) Create a Serializer for Scala Enumerations

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645766#comment-14645766 ] ASF GitHub Bot commented on FLINK-2231: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-2231] Create a Serializer for Scala Enu...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/935#issuecomment-125890350 Other than the one comment, this looks good. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[jira] [Commented] (FLINK-2231) Create a Serializer for Scala Enumerations

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645773#comment-14645773 ] ASF GitHub Bot commented on FLINK-2231: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-2419] Add test for sinks after keyBy an...

2015-07-29 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/947#issuecomment-125894533 If you give a +1 @rmetzger I will merge this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[jira] [Commented] (FLINK-2419) DataStream sinks lose key information

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645779#comment-14645779 ] ASF GitHub Bot commented on FLINK-2419: --- Github user gyfora commented on the pull re

[GitHub] flink pull request: [FLINK-1901] [core] Create sample operator for...

2015-07-29 Thread ChengXiangLi
Github user ChengXiangLi commented on the pull request: https://github.com/apache/flink/pull/949#issuecomment-125898830 Previously, i plan to leave the sample scala API to an separate PR as i not very familiar with scala, but the failed test shows that Flink has a test to make sure sc

[jira] [Commented] (FLINK-1901) Create sample operator for Dataset

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645803#comment-14645803 ] ASF GitHub Bot commented on FLINK-1901: --- Github user ChengXiangLi commented on the p

[jira] [Created] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2425: --- Summary: Give access to TaskManager config and hostname in the Runtime Environment Key: FLINK-2425 URL: https://issues.apache.org/jira/browse/FLINK-2425 Project: Flink

[jira] [Created] (FLINK-2426) Create a read-only variant of the Configuration

2015-07-29 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2426: --- Summary: Create a read-only variant of the Configuration Key: FLINK-2426 URL: https://issues.apache.org/jira/browse/FLINK-2426 Project: Flink Issue Type: Sub-t

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645817#comment-14645817 ] Robert Metzger commented on FLINK-2425: --- +1 That is something that users have reques

[GitHub] flink pull request: [FLINK-2387] add streaming test case for live ...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/926#issuecomment-125902465 How does this PR relate to the recent improvements on the stability of the live accumulator tests? --- If your project is set up for it, you can reply to this email

[jira] [Commented] (FLINK-2387) Add test for live accumulators in Streaming

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645821#comment-14645821 ] ASF GitHub Bot commented on FLINK-2387: --- Github user StephanEwen commented on the pu

[jira] [Commented] (FLINK-2240) Use BloomFilter to minimize probe side records which are spilled to disk in Hybrid-Hash-Join

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645822#comment-14645822 ] ASF GitHub Bot commented on FLINK-2240: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-2240] Use BloomFilter to filter probe r...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/888#issuecomment-125903682 Okay, it took me a while, but I actually walked through this and would like to merge it soon. To make this functionality configurable, I opened an issue to give ru

[jira] [Created] (FLINK-2427) Allow the BarrierBuffer to maintain multiple queues of blocked inputs

2015-07-29 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2427: --- Summary: Allow the BarrierBuffer to maintain multiple queues of blocked inputs Key: FLINK-2427 URL: https://issues.apache.org/jira/browse/FLINK-2427 Project: Flink

[GitHub] flink pull request: [FLINK-2240] Use BloomFilter to filter probe r...

2015-07-29 Thread ChengXiangLi
Github user ChengXiangLi commented on the pull request: https://github.com/apache/flink/pull/888#issuecomment-125914138 Thanks to point that out, Stephan, i didn't notice the configuration issue before. --- If your project is set up for it, you can reply to this email and have your r

[jira] [Commented] (FLINK-2240) Use BloomFilter to minimize probe side records which are spilled to disk in Hybrid-Hash-Join

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645842#comment-14645842 ] ASF GitHub Bot commented on FLINK-2240: --- Github user ChengXiangLi commented on the p

[jira] [Commented] (FLINK-2152) Provide zipWithIndex utility in flink-contrib

2015-07-29 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645895#comment-14645895 ] Robert Metzger commented on FLINK-2152: --- Yes, we either have to use a concurrent lis

[jira] [Commented] (FLINK-2152) Provide zipWithIndex utility in flink-contrib

2015-07-29 Thread Andra Lungu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645904#comment-14645904 ] Andra Lungu commented on FLINK-2152: Hey, Since this is Johannes Günther's finding, I

[jira] [Assigned] (FLINK-2407) Add an API switch to select between "exactly once" and "at least once" fault tolerance

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen reassigned FLINK-2407: --- Assignee: Stephan Ewen > Add an API switch to select between "exactly once" and "at least onc

[GitHub] flink pull request: [FLINK-2391]Fix Storm-compatibility FlinkTopol...

2015-07-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/940 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (FLINK-2391) Storm-compatibility:method FlinkTopologyBuilder.createTopology() throws java.lang.NullPointerException

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645954#comment-14645954 ] ASF GitHub Bot commented on FLINK-2391: --- Github user asfgit closed the pull request

[GitHub] flink pull request: Updated method documentation in joinDataSet.sc...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/909#issuecomment-125933965 Merging this... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[jira] [Closed] (FLINK-2391) Storm-compatibility:method FlinkTopologyBuilder.createTopology() throws java.lang.NullPointerException

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2391. --- > Storm-compatibility:method FlinkTopologyBuilder.createTopology() throws > java.lang.NullPointerExceptio

[jira] [Resolved] (FLINK-2391) Storm-compatibility:method FlinkTopologyBuilder.createTopology() throws java.lang.NullPointerException

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2391. - Resolution: Fixed Fixed in ada9037bef760d46a4c3be2177e04bd72e620dad Thank you for the patch! > S

[GitHub] flink pull request: Updated method documentation in joinDataSet.sc...

2015-07-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/909 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] flink pull request: Updated method documentation in joinDataSet.sc...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/909#issuecomment-125934297 Manually merged. Thank you for the patch! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] flink pull request: [FLINK-2231] Create a Serializer for Scala Enu...

2015-07-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/935 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (FLINK-2231) Create a Serializer for Scala Enumerations

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645974#comment-14645974 ] ASF GitHub Bot commented on FLINK-2231: --- Github user asfgit closed the pull request

[GitHub] flink pull request: [FLINK-2231] Create a Serializer for Scala Enu...

2015-07-29 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/935#issuecomment-125936680 Merged, thanks for your work. :smile: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[jira] [Commented] (FLINK-2231) Create a Serializer for Scala Enumerations

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645977#comment-14645977 ] ASF GitHub Bot commented on FLINK-2231: --- Github user aljoscha commented on the pull

[jira] [Closed] (FLINK-2231) Create a Serializer for Scala Enumerations

2015-07-29 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-2231. --- Resolution: Fixed Fix Version/s: 0.10 Implemented in https://github.com/apache/flink/c

[jira] [Assigned] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Sachin Goel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sachin Goel reassigned FLINK-2425: -- Assignee: Sachin Goel > Give access to TaskManager config and hostname in the Runtime Environme

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645984#comment-14645984 ] Stephan Ewen commented on FLINK-2425: - Could you describe in a few lines how you mean

[jira] [Created] (FLINK-2428) Clean up unused properties in StreamConfig

2015-07-29 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2428: --- Summary: Clean up unused properties in StreamConfig Key: FLINK-2428 URL: https://issues.apache.org/jira/browse/FLINK-2428 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Sachin Goel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645993#comment-14645993 ] Sachin Goel commented on FLINK-2425: The readonly configuration will take the actual c

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645997#comment-14645997 ] Stephan Ewen commented on FLINK-2425: - Ah, I think you are in the wrong issue ;-) That

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Sachin Goel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646003#comment-14646003 ] Sachin Goel commented on FLINK-2425: Yes. But this will certainly use the readonly con

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646019#comment-14646019 ] Stephan Ewen commented on FLINK-2425: - The TaskManager configuration object needs only

[GitHub] flink pull request: Cascading changes for compatibility

2015-07-29 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/flink/pull/950 Cascading changes for compatibility @fhueske and me are working on getting Cascading to run on top of Flink. These two commits introduce changes that were necessary to make the translation possible.

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Sachin Goel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646023#comment-14646023 ] Sachin Goel commented on FLINK-2425: Should I provide access to configuration via Runt

[jira] [Created] (FLINK-2429) Remove the "enableCheckpointing()" without interval variant

2015-07-29 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2429: --- Summary: Remove the "enableCheckpointing()" without interval variant Key: FLINK-2429 URL: https://issues.apache.org/jira/browse/FLINK-2429 Project: Flink Issu

[jira] [Updated] (FLINK-2429) Remove the "enableCheckpointing()" without interval variant

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-2429: Issue Type: Wish (was: Bug) > Remove the "enableCheckpointing()" without interval variant > ---

[jira] [Updated] (FLINK-2429) Remove the "enableCheckpointing()" without interval variant

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-2429: Description: I think it is not very obvious what the default checkpointing interval is. Also, when s

[jira] [Updated] (FLINK-2429) Remove the "enableCheckpointing()" without interval variant

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-2429: Priority: Minor (was: Major) > Remove the "enableCheckpointing()" without interval variant > --

[jira] [Updated] (FLINK-2429) Remove the "enableCheckpointing()" without interval variant

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-2429: Description: It is not very obvious what the default checkpointing interval. Also, when somebody act

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646029#comment-14646029 ] Stephan Ewen commented on FLINK-2425: - How about opening a pull request for the Runtim

[jira] [Commented] (FLINK-2387) Add test for live accumulators in Streaming

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646039#comment-14646039 ] ASF GitHub Bot commented on FLINK-2387: --- Github user mxm commented on the pull reque

[GitHub] flink pull request: [FLINK-2387] add streaming test case for live ...

2015-07-29 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/926#issuecomment-125955678 Sorry for the plain description. This pull request adds a test for the streaming part of the live accumulators, i.e. it makes sure that user-defined and Flink internal accumu

[GitHub] flink pull request: [FLINK-2407] [streaming] Add an API switch to ...

2015-07-29 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/951 [FLINK-2407] [streaming] Add an API switch to choose between "exactly once" and "at least once". Adds a switch to choose between **exactly once** and **at least once** checkpointing mode.

[jira] [Commented] (FLINK-2407) Add an API switch to select between "exactly once" and "at least once" fault tolerance

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646072#comment-14646072 ] ASF GitHub Bot commented on FLINK-2407: --- GitHub user StephanEwen opened a pull reque

[GitHub] flink pull request: Cascading changes for compatibility

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/950#issuecomment-125962637 For robustness, can you restore the thread context classloader to the original one in a finally clause? Otherwise +1 --- If your project is set up for it, y

[jira] [Commented] (FLINK-2387) Add test for live accumulators in Streaming

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646081#comment-14646081 ] ASF GitHub Bot commented on FLINK-2387: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-2387] add streaming test case for live ...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/926#issuecomment-125963497 Looks good --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request: [FLINK-1927][py] Operator distribution rework

2015-07-29 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/931#discussion_r35763245 --- Diff: flink-staging/flink-language-binding/flink-python/src/main/java/org/apache/flink/languagebinding/api/java/python/streaming/PythonStreamer.java --- @@ -1

[jira] [Commented] (FLINK-1927) [Py] Rework operator distribution

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646088#comment-14646088 ] ASF GitHub Bot commented on FLINK-1927: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-1927) [Py] Rework operator distribution

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646216#comment-14646216 ] ASF GitHub Bot commented on FLINK-1927: --- Github user mxm commented on the pull reque

[GitHub] flink pull request: [FLINK-1927][py] Operator distribution rework

2015-07-29 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/931#issuecomment-125979125 Thanks for the pull request @zentol! +1 for removing the dill library. As far as I can see, we handle all the serialization ourselves now. We only used the Dill libra

[GitHub] flink pull request: [FLINK-1927][py] Operator distribution rework

2015-07-29 Thread zentol
Github user zentol commented on the pull request: https://github.com/apache/flink/pull/931#issuecomment-125983186 Thanks for the review @mxm . I've addressed the cosmetic issue you mentioned, and added a small fix for a separate issue as well (error reporting was partially bro

[jira] [Commented] (FLINK-1927) [Py] Rework operator distribution

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646239#comment-14646239 ] ASF GitHub Bot commented on FLINK-1927: --- Github user zentol commented on the pull re

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646251#comment-14646251 ] ASF GitHub Bot commented on FLINK-2425: --- GitHub user sachingoel0101 opened a pull re

[GitHub] flink pull request: [FLINK-2425]Provide access to task manager con...

2015-07-29 Thread sachingoel0101
GitHub user sachingoel0101 opened a pull request: https://github.com/apache/flink/pull/952 [FLINK-2425]Provide access to task manager configuration from RuntimeEnvironment Also fixes [FLINK-2426]: Define an UnmodifiableConfiguration class which doesn't allow modifications to the un

[GitHub] flink pull request: Cascading changes for compatibility

2015-07-29 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/950#issuecomment-125988920 Yes, I've updated the pull request. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] flink pull request: [FLINK-2399] Version checks for Job Manager an...

2015-07-29 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/945#issuecomment-125991194 1. Added version checks between JobClient and JobManager. 2. Versions are accessed from the Configuration class now, since flink-core gets built first and vers

[jira] [Commented] (FLINK-2399) Fail when actor versions don't match

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646279#comment-14646279 ] ASF GitHub Bot commented on FLINK-2399: --- Github user sachingoel0101 commented on the

[GitHub] flink pull request: [FLINK-2407] [streaming] Add an API switch to ...

2015-07-29 Thread gyfora
Github user gyfora commented on a diff in the pull request: https://github.com/apache/flink/pull/951#discussion_r35778711 --- Diff: flink-staging/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGenerator.java --- @@ -269,10

[jira] [Commented] (FLINK-2407) Add an API switch to select between "exactly once" and "at least once" fault tolerance

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646336#comment-14646336 ] ASF GitHub Bot commented on FLINK-2407: --- Github user gyfora commented on a diff in t

[GitHub] flink pull request: [FLINK-2407] [streaming] Add an API switch to ...

2015-07-29 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/951#issuecomment-126005919 Aside from my minor comment, this looks very good :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[jira] [Commented] (FLINK-2407) Add an API switch to select between "exactly once" and "at least once" fault tolerance

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646341#comment-14646341 ] ASF GitHub Bot commented on FLINK-2407: --- Github user gyfora commented on the pull re

[GitHub] flink pull request: [FLINK-2407] [streaming] Add an API switch to ...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/951#issuecomment-126007290 Yeah, I thought about an "off handler". Turns out that the BarrierTracker is almost like an "off handler" when no barriers arrive. --- If your project is set up for

[jira] [Commented] (FLINK-2407) Add an API switch to select between "exactly once" and "at least once" fault tolerance

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646350#comment-14646350 ] ASF GitHub Bot commented on FLINK-2407: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-2407] [streaming] Add an API switch to ...

2015-07-29 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/951#issuecomment-126008434 Yes, I double checked and you are right. This is practically as lightweight as it gets. :) +1 to merge --- If your project is set up for it, you can reply to thi

  1   2   >