[GitHub] flink pull request: [FLINK-2425]Provide access to task manager con...

2015-07-29 Thread sachingoel0101
GitHub user sachingoel0101 opened a pull request: https://github.com/apache/flink/pull/952 [FLINK-2425]Provide access to task manager configuration from RuntimeEnvironment Also fixes [FLINK-2426]: Define an UnmodifiableConfiguration class which doesn't allow modifications to the

[jira] [Resolved] (FLINK-2424) InstantiationUtil.serializeObject(Object) does not close output stream

2015-07-29 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi resolved FLINK-2424. Resolution: Fixed Fixed via 7bd57d7 (0.10), c756fe8 (0.9.1).

[jira] [Commented] (FLINK-2407) Add an API switch to select between exactly once and at least once fault tolerance

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646383#comment-14646383 ] ASF GitHub Bot commented on FLINK-2407: --- Github user StephanEwen commented on the

[jira] [Closed] (FLINK-2407) Add an API switch to select between exactly once and at least once fault tolerance

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2407. --- Add an API switch to select between exactly once and at least once fault tolerance

[jira] [Resolved] (FLINK-2407) Add an API switch to select between exactly once and at least once fault tolerance

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2407. - Resolution: Fixed Fixed in b211a62111aa3c558586874d0ec5b168e6bb31f1 Add an API switch to select

[jira] [Commented] (FLINK-2399) Fail when actor versions don't match

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646279#comment-14646279 ] ASF GitHub Bot commented on FLINK-2399: --- Github user sachingoel0101 commented on the

[jira] [Commented] (FLINK-2407) Add an API switch to select between exactly once and at least once fault tolerance

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646350#comment-14646350 ] ASF GitHub Bot commented on FLINK-2407: --- Github user StephanEwen commented on the

[GitHub] flink pull request: [FLINK-2407] [streaming] Add an API switch to ...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/951#issuecomment-126007290 Yeah, I thought about an off handler. Turns out that the BarrierTracker is almost like an off handler when no barriers arrive. --- If your project is set up for it,

[jira] [Commented] (FLINK-2324) Rework partitioned state storage

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646391#comment-14646391 ] ASF GitHub Bot commented on FLINK-2324: --- Github user gyfora commented on the pull

[jira] [Deleted] (FLINK-2430) Potential race condition when restart all is called for a Twill runnable

2015-07-29 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra deleted FLINK-2430: - Potential race condition when restart all is called for a Twill runnable

[GitHub] flink pull request: [FLINK-2324] [streaming] Partitioned state che...

2015-07-29 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/937#issuecomment-126015036 Any concerns against merging this? @senorcarbone? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] flink pull request: FLINK-2322 Unclosed stream may leak resource

2015-07-29 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/flink/pull/928#issuecomment-126021923 Anything I can do to move this forward ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] flink pull request: [FLINK-2407] [streaming] Add an API switch to ...

2015-07-29 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/951#issuecomment-126005919 Aside from my minor comment, this looks very good :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[jira] [Commented] (FLINK-2407) Add an API switch to select between exactly once and at least once fault tolerance

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646341#comment-14646341 ] ASF GitHub Bot commented on FLINK-2407: --- Github user gyfora commented on the pull

[jira] [Closed] (FLINK-2430) Potential race condition when restart all is called for a Twill runnable

2015-07-29 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra closed FLINK-2430. Resolution: Invalid Pop sorry wrong project =( Potential race condition when restart all is

[GitHub] flink pull request: [FLINK-2407] [streaming] Add an API switch to ...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/951#issuecomment-126014037 Manually merged in b211a62111aa3c558586874d0ec5b168e6bb31f1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646251#comment-14646251 ] ASF GitHub Bot commented on FLINK-2425: --- GitHub user sachingoel0101 opened a pull

[jira] [Created] (FLINK-2430) Potential race condition when restart all is called for a Twill runnable

2015-07-29 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-2430: Summary: Potential race condition when restart all is called for a Twill runnable Key: FLINK-2430 URL: https://issues.apache.org/jira/browse/FLINK-2430 Project:

[GitHub] flink pull request: Cascading changes for compatibility

2015-07-29 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/950#issuecomment-125988920 Yes, I've updated the pull request. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[jira] [Commented] (FLINK-2407) Add an API switch to select between exactly once and at least once fault tolerance

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646336#comment-14646336 ] ASF GitHub Bot commented on FLINK-2407: --- Github user gyfora commented on a diff in

[GitHub] flink pull request: [FLINK-2407] [streaming] Add an API switch to ...

2015-07-29 Thread gyfora
Github user gyfora commented on a diff in the pull request: https://github.com/apache/flink/pull/951#discussion_r35778711 --- Diff: flink-staging/flink-streaming/flink-streaming-core/src/main/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGenerator.java --- @@ -269,10

[jira] [Commented] (FLINK-2407) Add an API switch to select between exactly once and at least once fault tolerance

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646384#comment-14646384 ] ASF GitHub Bot commented on FLINK-2407: --- Github user StephanEwen closed the pull

[GitHub] flink pull request: [FLINK-2407] [streaming] Add an API switch to ...

2015-07-29 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/951#issuecomment-126008434 Yes, I double checked and you are right. This is practically as lightweight as it gets. :) +1 to merge --- If your project is set up for it, you can reply to

[jira] [Commented] (FLINK-2407) Add an API switch to select between exactly once and at least once fault tolerance

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646357#comment-14646357 ] ASF GitHub Bot commented on FLINK-2407: --- Github user gyfora commented on the pull

[jira] [Commented] (FLINK-2322) Unclosed stream may leak resource

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646439#comment-14646439 ] ASF GitHub Bot commented on FLINK-2322: --- Github user tedyu commented on the pull

[GitHub] flink pull request: [FLINK-2419] Add test for sinks after keyBy an...

2015-07-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/947 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-2324) Rework partitioned state storage

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646641#comment-14646641 ] ASF GitHub Bot commented on FLINK-2324: --- Github user aljoscha commented on the pull

[GitHub] flink pull request: [FLINK-2324] [streaming] Partitioned state che...

2015-07-29 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/937#issuecomment-126070524 I was too busy but I would like to take a quick look. I will look at it tomorrow morning. --- If your project is set up for it, you can reply to this email and have

[GitHub] flink pull request: [FLINK-2205] Fix confusing entries in JM UI Jo...

2015-07-29 Thread ebautistabar
Github user ebautistabar commented on the pull request: https://github.com/apache/flink/pull/927#issuecomment-126099697 As the new UI didn't show job configurations yet, I have created another PR to deal with it, which also includes the display changes requested in FLINK-2205. ---

[jira] [Commented] (FLINK-2205) Confusing entries in JM Webfrontend Job Configuration section

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646789#comment-14646789 ] ASF GitHub Bot commented on FLINK-2205: --- Github user ebautistabar commented on the

[jira] [Created] (FLINK-2431) [py] refactor PlanBinder/OperationInfo

2015-07-29 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-2431: --- Summary: [py] refactor PlanBinder/OperationInfo Key: FLINK-2431 URL: https://issues.apache.org/jira/browse/FLINK-2431 Project: Flink Issue Type:

[GitHub] flink pull request: [FLINK-2357] [web dashboard] Shows job configu...

2015-07-29 Thread ebautistabar
GitHub user ebautistabar opened a pull request: https://github.com/apache/flink/pull/953 [FLINK-2357] [web dashboard] Shows job configuration in new dashboard I wanted to change the configuration display, as in #927, but it wasn't implemented in the new UI. So I decided to create

[jira] [Commented] (FLINK-2357) New JobManager Runtime Web Frontend

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646778#comment-14646778 ] ASF GitHub Bot commented on FLINK-2357: --- GitHub user ebautistabar opened a pull

[jira] [Commented] (FLINK-2419) DataStream sinks lose key information

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646592#comment-14646592 ] ASF GitHub Bot commented on FLINK-2419: --- Github user senorcarbone commented on the

[GitHub] flink pull request: Framesize fix

2015-07-29 Thread kl0u
Github user kl0u commented on the pull request: https://github.com/apache/flink/pull/934#issuecomment-126076384 Hi @mxm , Thanks a lot for the comments! I integrated most of them. Please have a look and let me know what you think. For the merging of the the

[GitHub] flink pull request: [FLINK-2419] Add test for sinks after keyBy an...

2015-07-29 Thread senorcarbone
Github user senorcarbone commented on the pull request: https://github.com/apache/flink/pull/947#issuecomment-126054868 :+1: from me. looks that it does the job --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] flink pull request: [FLINK-2324] [streaming] Partitioned state che...

2015-07-29 Thread senorcarbone
Github user senorcarbone commented on the pull request: https://github.com/apache/flink/pull/937#issuecomment-126067262 That would be good ^^ then it's :+1: from me, at least for now. It's generally good performance-wise to have less serialised states. This means that we will

[jira] [Commented] (FLINK-2324) Rework partitioned state storage

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646634#comment-14646634 ] ASF GitHub Bot commented on FLINK-2324: --- Github user senorcarbone commented on the

[jira] [Closed] (FLINK-2419) DataStream sinks lose key information

2015-07-29 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-2419. - Resolution: Fixed DataStream sinks lose key information -

[jira] [Commented] (FLINK-2324) Rework partitioned state storage

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646619#comment-14646619 ] ASF GitHub Bot commented on FLINK-2324: --- Github user gyfora commented on the pull

[GitHub] flink pull request: [FLINK-2324] [streaming] Partitioned state che...

2015-07-29 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/937#issuecomment-126062430 I will actually add one more test to verify the correct behaviour of all the wrapper statehandle classes. --- If your project is set up for it, you can reply to this

[jira] [Created] (FLINK-2433) Jekyll on windows for building local documentation

2015-07-29 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2433: -- Summary: Jekyll on windows for building local documentation Key: FLINK-2433 URL: https://issues.apache.org/jira/browse/FLINK-2433 Project: Flink Issue Type:

[jira] [Commented] (FLINK-1919) Add HCatOutputFormat for Tuple data types

2015-07-29 Thread James Cao (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647061#comment-14647061 ] James Cao commented on FLINK-1919: -- Hello, is there any one working on this issue now? If

[GitHub] flink pull request: [FLINK-2433][docs]Add script to build local do...

2015-07-29 Thread sachingoel0101
GitHub user sachingoel0101 opened a pull request: https://github.com/apache/flink/pull/954 [FLINK-2433][docs]Add script to build local documentation on windows You can merge this pull request into a Git repository by running: $ git pull https://github.com/sachingoel0101/flink

[jira] [Commented] (FLINK-2433) Jekyll on windows for building local documentation

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647149#comment-14647149 ] ASF GitHub Bot commented on FLINK-2433: --- GitHub user sachingoel0101 opened a pull

[jira] [Commented] (FLINK-2324) Rework partitioned state storage

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645645#comment-14645645 ] ASF GitHub Bot commented on FLINK-2324: --- Github user gyfora commented on the pull

[GitHub] flink pull request: [FLINK-2324] [streaming] Partitioned state che...

2015-07-29 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/937#issuecomment-125872157 Merging your PR fixed the exactly-once guarantees @StephanEwen , great! I also added an extra test for Partitioned states. Do you think it is okay to

[jira] [Closed] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2406. --- Abstract BarrierBuffer to an exchangeable BarrierHandler

[jira] [Resolved] (FLINK-2402) Add a non-blocking BarrierTracker

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2402. - Resolution: Implemented Implemented in 8f87b7164b644ea8f1708f7eb76567e58341b224 Add a

[jira] [Closed] (FLINK-2402) Add a non-blocking BarrierTracker

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2402. --- Add a non-blocking BarrierTracker - Key: FLINK-2402

[jira] [Resolved] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2406. - Resolution: Fixed Fixed via 0579f90bab165a7df336163eb9d6337267020029 Abstract BarrierBuffer to

[jira] [Commented] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645744#comment-14645744 ] ASF GitHub Bot commented on FLINK-2406: --- Github user StephanEwen commented on the

[GitHub] flink pull request: [FLINK-2406] [FLINK-2402] Abstract the Barrier...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/938#issuecomment-125889092 Manually merged in 8f87b7164b644ea8f1708f7eb76567e58341b224 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Commented] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645761#comment-14645761 ] ASF GitHub Bot commented on FLINK-2406: --- Github user StephanEwen closed the pull

[GitHub] flink pull request: [FLINK-2231] Create a Serializer for Scala Enu...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/935#issuecomment-125890350 Other than the one comment, this looks good. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Commented] (FLINK-1901) Create sample operator for Dataset

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645658#comment-14645658 ] ASF GitHub Bot commented on FLINK-1901: --- GitHub user ChengXiangLi opened a pull

[GitHub] flink pull request: [FLINK-1901] [core] Create sample operator for...

2015-07-29 Thread ChengXiangLi
GitHub user ChengXiangLi opened a pull request: https://github.com/apache/flink/pull/949 [FLINK-1901] [core] Create sample operator for Dataset. This PR includes: 1. 4 random sampler implementation for different sample strategies. 2. sample operator for DataSet Java API.

[GitHub] flink pull request: [FLINK-2399] Version checks for Job Manager an...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/945#issuecomment-125886476 Using `getClass().getPackage().getImplementationVersion()` would be a decent first approach then, I guess. The critical part seems to be the Client-to-JobManager

[GitHub] flink pull request: [FLINK-2406] [FLINK-2402] Abstract the Barrier...

2015-07-29 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/938#issuecomment-125887588 I really love Travis :heart: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink pull request: [FLINK-2406] [FLINK-2402] Abstract the Barrier...

2015-07-29 Thread StephanEwen
Github user StephanEwen closed the pull request at: https://github.com/apache/flink/pull/938 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (FLINK-2418) Add an end-to-end streaming fault tolerance test for the Checkpointed interface

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2418. - Resolution: Fixed Fixed via a0556efb233f15c6985d17886372a8b4b00392b2 Add an end-to-end

[GitHub] flink pull request: [FLINK-2406] [FLINK-2402] Abstract the Barrier...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/938#issuecomment-125887226 It failed when at the end of the program, queued channel data was present at the end of the job. This happens only with slow consumers. Apparently, the local

[jira] [Commented] (FLINK-2231) Create a Serializer for Scala Enumerations

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645773#comment-14645773 ] ASF GitHub Bot commented on FLINK-2231: --- Github user StephanEwen commented on the

[jira] [Closed] (FLINK-2418) Add an end-to-end streaming fault tolerance test for the Checkpointed interface

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2418. --- Add an end-to-end streaming fault tolerance test for the Checkpointed interface

[jira] [Commented] (FLINK-2399) Fail when actor versions don't match

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645737#comment-14645737 ] ASF GitHub Bot commented on FLINK-2399: --- Github user StephanEwen commented on the

[GitHub] flink pull request: [FLINK-2391]Fix Storm-compatibility FlinkTopol...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/940#issuecomment-125887557 Will merge this... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[jira] [Commented] (FLINK-2406) Abstract BarrierBuffer to an exchangeable BarrierHandler

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645749#comment-14645749 ] ASF GitHub Bot commented on FLINK-2406: --- Github user uce commented on the pull

[jira] [Commented] (FLINK-2391) Storm-compatibility:method FlinkTopologyBuilder.createTopology() throws java.lang.NullPointerException

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645748#comment-14645748 ] ASF GitHub Bot commented on FLINK-2391: --- Github user StephanEwen commented on the

[jira] [Commented] (FLINK-2231) Create a Serializer for Scala Enumerations

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645766#comment-14645766 ] ASF GitHub Bot commented on FLINK-2231: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-2231] Create a Serializer for Scala Enu...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/935#discussion_r35741171 --- Diff: flink-scala/src/main/scala/org/apache/flink/api/scala/typeutils/EnumValueSerializer.scala --- @@ -0,0 +1,61 @@ +/* + * Licensed to the

[jira] [Resolved] (FLINK-2420) OutputFlush thread in stream writers does not propagate exceptions

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2420. - Resolution: Fixed Fixed via 8ba321332b994579f387add8bd0855bd29cb33ec OutputFlush thread in

[jira] [Resolved] (FLINK-2421) StreamRecordSerializer incorrectly duplicates and misses tests

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2421. - Resolution: Fixed Fixed via 2d237e18a2f7cf21721340933c505bb518c4fc66 StreamRecordSerializer

[jira] [Closed] (FLINK-2421) StreamRecordSerializer incorrectly duplicates and misses tests

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2421. --- StreamRecordSerializer incorrectly duplicates and misses tests

[jira] [Closed] (FLINK-2420) OutputFlush thread in stream writers does not propagate exceptions

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2420. --- OutputFlush thread in stream writers does not propagate exceptions

[jira] [Commented] (FLINK-2424) InstantiationUtil.serializeObject(Object) does not close output stream

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645740#comment-14645740 ] Stephan Ewen commented on FLINK-2424: - oha, good one!

[GitHub] flink pull request: [FLINK-2419] Add test for sinks after keyBy an...

2015-07-29 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/947#issuecomment-125894533 If you give a +1 @rmetzger I will merge this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Commented] (FLINK-2419) DataStream sinks lose key information

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645779#comment-14645779 ] ASF GitHub Bot commented on FLINK-2419: --- Github user gyfora commented on the pull

[jira] [Commented] (FLINK-1901) Create sample operator for Dataset

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645803#comment-14645803 ] ASF GitHub Bot commented on FLINK-1901: --- Github user ChengXiangLi commented on the

[GitHub] flink pull request: [FLINK-2240] Use BloomFilter to filter probe r...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/888#issuecomment-125903682 Okay, it took me a while, but I actually walked through this and would like to merge it soon. To make this functionality configurable, I opened an issue to give

[jira] [Commented] (FLINK-2240) Use BloomFilter to minimize probe side records which are spilled to disk in Hybrid-Hash-Join

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645822#comment-14645822 ] ASF GitHub Bot commented on FLINK-2240: --- Github user StephanEwen commented on the

[GitHub] flink pull request: [FLINK-2240] Use BloomFilter to filter probe r...

2015-07-29 Thread ChengXiangLi
Github user ChengXiangLi commented on the pull request: https://github.com/apache/flink/pull/888#issuecomment-125914138 Thanks to point that out, Stephan, i didn't notice the configuration issue before. --- If your project is set up for it, you can reply to this email and have your

[jira] [Commented] (FLINK-2240) Use BloomFilter to minimize probe side records which are spilled to disk in Hybrid-Hash-Join

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645842#comment-14645842 ] ASF GitHub Bot commented on FLINK-2240: --- Github user ChengXiangLi commented on the

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645817#comment-14645817 ] Robert Metzger commented on FLINK-2425: --- +1 That is something that users have

[jira] [Created] (FLINK-2427) Allow the BarrierBuffer to maintain multiple queues of blocked inputs

2015-07-29 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2427: --- Summary: Allow the BarrierBuffer to maintain multiple queues of blocked inputs Key: FLINK-2427 URL: https://issues.apache.org/jira/browse/FLINK-2427 Project: Flink

[jira] [Commented] (FLINK-2152) Provide zipWithIndex utility in flink-contrib

2015-07-29 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645895#comment-14645895 ] Robert Metzger commented on FLINK-2152: --- Yes, we either have to use a concurrent

[GitHub] flink pull request: [FLINK-1901] [core] Create sample operator for...

2015-07-29 Thread ChengXiangLi
Github user ChengXiangLi commented on the pull request: https://github.com/apache/flink/pull/949#issuecomment-125898830 Previously, i plan to leave the sample scala API to an separate PR as i not very familiar with scala, but the failed test shows that Flink has a test to make sure

[jira] [Commented] (FLINK-2387) Add test for live accumulators in Streaming

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645821#comment-14645821 ] ASF GitHub Bot commented on FLINK-2387: --- Github user StephanEwen commented on the

[GitHub] flink pull request: [FLINK-2387] add streaming test case for live ...

2015-07-29 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/926#issuecomment-125902465 How does this PR relate to the recent improvements on the stability of the live accumulator tests? --- If your project is set up for it, you can reply to this email

[jira] [Commented] (FLINK-2152) Provide zipWithIndex utility in flink-contrib

2015-07-29 Thread Andra Lungu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645904#comment-14645904 ] Andra Lungu commented on FLINK-2152: Hey, Since this is Johannes Günther's finding, I

[GitHub] flink pull request: [FLINK-2231] Create a Serializer for Scala Enu...

2015-07-29 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/935#issuecomment-125936680 Merged, thanks for your work. :smile: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] flink pull request: [FLINK-2231] Create a Serializer for Scala Enu...

2015-07-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/935 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-2231) Create a Serializer for Scala Enumerations

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645974#comment-14645974 ] ASF GitHub Bot commented on FLINK-2231: --- Github user asfgit closed the pull request

[jira] [Created] (FLINK-2428) Clean up unused properties in StreamConfig

2015-07-29 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2428: --- Summary: Clean up unused properties in StreamConfig Key: FLINK-2428 URL: https://issues.apache.org/jira/browse/FLINK-2428 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Sachin Goel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646003#comment-14646003 ] Sachin Goel commented on FLINK-2425: Yes. But this will certainly use the readonly

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Sachin Goel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646023#comment-14646023 ] Sachin Goel commented on FLINK-2425: Should I provide access to configuration via

[jira] [Commented] (FLINK-2391) Storm-compatibility:method FlinkTopologyBuilder.createTopology() throws java.lang.NullPointerException

2015-07-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645954#comment-14645954 ] ASF GitHub Bot commented on FLINK-2391: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-2425) Give access to TaskManager config and hostname in the Runtime Environment

2015-07-29 Thread Sachin Goel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14645993#comment-14645993 ] Sachin Goel commented on FLINK-2425: The readonly configuration will take the actual

[GitHub] flink pull request: Cascading changes for compatibility

2015-07-29 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/flink/pull/950 Cascading changes for compatibility @fhueske and me are working on getting Cascading to run on top of Flink. These two commits introduce changes that were necessary to make the translation possible.

[jira] [Updated] (FLINK-2429) Remove the enableCheckpointing() without interval variant

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-2429: Description: I think it is not very obvious what the default checkpointing interval is. Also, when

[jira] [Updated] (FLINK-2429) Remove the enableCheckpointing() without interval variant

2015-07-29 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-2429: Issue Type: Wish (was: Bug) Remove the enableCheckpointing() without interval variant

  1   2   >