[jira] [Commented] (FLINK-1674) Add test with nested avro type

2015-09-03 Thread Vimal (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14730347#comment-14730347 ] Vimal commented on FLINK-1674: -- hi, can you assign this issue to me, i submitted the above pu

[jira] [Commented] (FLINK-1674) Add test with nested avro type

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729909#comment-14729909 ] ASF GitHub Bot commented on FLINK-1674: --- GitHub user vimalk78 opened a pull request:

[GitHub] flink pull request: [FLINK-1674] Add test with nested avro type

2015-09-03 Thread vimalk78
GitHub user vimalk78 opened a pull request: https://github.com/apache/flink/pull/1091 [FLINK-1674] Add test with nested avro type Modified User definition in user.avsc to include a nested definition. Modified the corresponding test cases to reflect the changed User definition

[GitHub] flink pull request: Implementation of distributed copying utility ...

2015-09-03 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1090#issuecomment-137533466 @detonator413 Good point with the dynamic assignment. What do sou think, would `flink-contrib` or `flink-examples` be a better place? Is it rather a nice too

[GitHub] flink pull request: Implementation of distributed copying utility ...

2015-09-03 Thread detonator413
Github user detonator413 commented on the pull request: https://github.com/apache/flink/pull/1090#issuecomment-137516063 It could be faster because of dynamic assignment of files to copy as opposed to the default method of distcp where set of files are preassigned to mappers in advanc

[jira] [Commented] (FLINK-2613) Print usage information for Scala Shell

2015-09-03 Thread Nikolaas Steenbergen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729346#comment-14729346 ] Nikolaas Steenbergen commented on FLINK-2613: - actually it does this as well a

[GitHub] flink pull request: Implementation of distributed copying utility ...

2015-09-03 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1090#issuecomment-137499875 Thanks for pointing me to the `distcp` page. So far, I was agnostic of this tool :) The performance difference between Hadoop and Flink should not be too different because t

[jira] [Commented] (FLINK-2617) ConcurrentModificationException when using HCatRecordReader to access a hive table

2015-09-03 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729302#comment-14729302 ] Stephan Ewen commented on FLINK-2617: - I agree, this is critical. The reason for this

[jira] [Commented] (FLINK-2617) ConcurrentModificationException when using HCatRecordReader to access a hive table

2015-09-03 Thread Arnaud Linz (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729289#comment-14729289 ] Arnaud Linz commented on FLINK-2617: (I think that the subject is in fact critical bec

[jira] [Commented] (FLINK-2613) Print usage information for Scala Shell

2015-09-03 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729295#comment-14729295 ] Fabian Hueske commented on FLINK-2613: -- How about printing a message such as {code}

[jira] [Updated] (FLINK-2617) ConcurrentModificationException when using HCatRecordReader to access a hive table

2015-09-03 Thread Arnaud Linz (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Linz updated FLINK-2617: --- Priority: Critical (was: Major) > ConcurrentModificationException when using HCatRecordReader to acce

[jira] [Created] (FLINK-2618) ExternalSortITCase failure

2015-09-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2618: -- Summary: ExternalSortITCase failure Key: FLINK-2618 URL: https://issues.apache.org/jira/browse/FLINK-2618 Project: Flink Issue Type: Bug Reporter: Sa

[jira] [Commented] (FLINK-2106) Add outer joins to Runtime

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729233#comment-14729233 ] ASF GitHub Bot commented on FLINK-2106: --- Github user fhueske commented on the pull r

[GitHub] flink pull request: [FLINK-2106] [runtime] add Left-, Right- and F...

2015-09-03 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/1052#issuecomment-137483619 Hi @r-pogalz, @jkovacs, thanks for the update. It's good to merge, IMO. Either you resolve my minor comments or I can do it before merging. Anybody

[GitHub] flink pull request: Implementation of distributed copying utility ...

2015-09-03 Thread detonator413
Github user detonator413 commented on the pull request: https://github.com/apache/flink/pull/1090#issuecomment-137480178 Hi Max, Look at the distcp utility (http://hadoop.apache.org/docs/r1.2.1/distcp.html ). The purpose of it

[jira] [Commented] (FLINK-2106) Add outer joins to Runtime

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729192#comment-14729192 ] ASF GitHub Bot commented on FLINK-2106: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-2106] [runtime] add Left-, Right- and F...

2015-09-03 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1052#discussion_r38654830 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/operators/LeftOuterJoinTaskExternalITTest.java --- @@ -0,0 +1,41 @@ +/* + * Licensed t

[GitHub] flink pull request: Implementation of distributed copying utility ...

2015-09-03 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1090#issuecomment-137477152 Thanks for your pull request! I'm assuming you would use this utility to copy files from your local to a remote file system, right? Your utility starts a Flink job to copy t

[jira] [Commented] (FLINK-2106) Add outer joins to Runtime

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729193#comment-14729193 ] ASF GitHub Bot commented on FLINK-2106: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-2106] [runtime] add Left-, Right- and F...

2015-09-03 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1052#discussion_r38654895 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/operators/RightOuterJoinTaskExternalITTest.java --- @@ -0,0 +1,41 @@ +/* + * Licensed

[GitHub] flink pull request: [FLINK-2106] [runtime] add Left-, Right- and F...

2015-09-03 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1052#discussion_r38654400 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/operators/FullOuterJoinTaskExternalITTest.java --- @@ -0,0 +1,41 @@ +/* + * Licensed t

[jira] [Commented] (FLINK-2106) Add outer joins to Runtime

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729186#comment-14729186 ] ASF GitHub Bot commented on FLINK-2106: --- Github user fhueske commented on a diff in

[jira] [Commented] (FLINK-2106) Add outer joins to Runtime

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729183#comment-14729183 ] ASF GitHub Bot commented on FLINK-2106: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-2106] [runtime] add Left-, Right- and F...

2015-09-03 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1052#discussion_r38654270 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/operators/AbstractOuterJoinTaskTest.java --- @@ -0,0 +1,452 @@ +/* + * Licensed to the

[GitHub] flink pull request: Implementation of distributed copying utility ...

2015-09-03 Thread detonator413
is a file. You can merge this pull request into a Git repository by running: $ git pull https://github.com/detonator413/flink distcp-example-20150903 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/1090.patch To close this pull req

[jira] [Commented] (FLINK-2605) Unclosed RandomAccessFile may leak resource in StaticFileServerHandler

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729116#comment-14729116 ] ASF GitHub Bot commented on FLINK-2605: --- GitHub user tedyu opened a pull request:

[GitHub] flink pull request: FLINK-2605 Unclosed RandomAccessFile may leak ...

2015-09-03 Thread tedyu
GitHub user tedyu opened a pull request: https://github.com/apache/flink/pull/1089 FLINK-2605 Unclosed RandomAccessFile may leak resource in StaticFileS… …erverHandler You can merge this pull request into a Git repository by running: $ git pull https://github.com/tedyu/flin

[jira] [Created] (FLINK-2617) ConcurrentModificationException when using HCatRecordReader to access a hive table

2015-09-03 Thread Arnaud Linz (JIRA)
Arnaud Linz created FLINK-2617: -- Summary: ConcurrentModificationException when using HCatRecordReader to access a hive table Key: FLINK-2617 URL: https://issues.apache.org/jira/browse/FLINK-2617 Project:

[GitHub] flink pull request: [FLINK-2615]Preserve executors for the entire ...

2015-09-03 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/1088#issuecomment-137421268 Sure. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request: [FLINK-2615]Preserve executors for the entire ...

2015-09-03 Thread sachingoel0101
Github user sachingoel0101 closed the pull request at: https://github.com/apache/flink/pull/1088 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (FLINK-2615) Multiple restarts of Local Cluster for a single program

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728942#comment-14728942 ] ASF GitHub Bot commented on FLINK-2615: --- Github user sachingoel0101 closed the pull

[jira] [Commented] (FLINK-2615) Multiple restarts of Local Cluster for a single program

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728939#comment-14728939 ] ASF GitHub Bot commented on FLINK-2615: --- Github user uce commented on the pull reque

[jira] [Commented] (FLINK-2615) Multiple restarts of Local Cluster for a single program

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728941#comment-14728941 ] ASF GitHub Bot commented on FLINK-2615: --- Github user sachingoel0101 commented on the

[GitHub] flink pull request: [FLINK-2615]Preserve executors for the entire ...

2015-09-03 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/1088#issuecomment-137421164 I would move the discussion to the respective PR. Sachin, could you close this PR? --- If your project is set up for it, you can reply to this email and have your reply app

[jira] [Commented] (FLINK-2615) Multiple restarts of Local Cluster for a single program

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728937#comment-14728937 ] ASF GitHub Bot commented on FLINK-2615: --- Github user sachingoel0101 commented on the

[GitHub] flink pull request: [FLINK-2615]Preserve executors for the entire ...

2015-09-03 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/1088#issuecomment-137420928 Aha. I just had a brief look at the PR. I had initially thought of implementing a start and stop method in the `ExecutionEnvironment` but decided against it,

[jira] [Commented] (FLINK-2615) Multiple restarts of Local Cluster for a single program

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728925#comment-14728925 ] ASF GitHub Bot commented on FLINK-2615: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-2615]Preserve executors for the entire ...

2015-09-03 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1088#issuecomment-137418968 The current behavior is actually desired. You can explicitly start the local executor, and explicitly stop it. When you did not explicitly start it, you get an auto-

[jira] [Created] (FLINK-2616) Failing Test: ZooKeeperLeaderElectionTest

2015-09-03 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created FLINK-2616: -- Summary: Failing Test: ZooKeeperLeaderElectionTest Key: FLINK-2616 URL: https://issues.apache.org/jira/browse/FLINK-2616 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-2615) Multiple restarts of Local Cluster for a single program

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728893#comment-14728893 ] ASF GitHub Bot commented on FLINK-2615: --- GitHub user sachingoel0101 opened a pull re

[GitHub] flink pull request: [FLINK-2615]Preserve executors for the entire ...

2015-09-03 Thread sachingoel0101
GitHub user sachingoel0101 opened a pull request: https://github.com/apache/flink/pull/1088 [FLINK-2615]Preserve executors for the entire run of program. 1. Prevents re-starts of local cluster several times on multiple executions. 2. Preserves the executor states for the entire r

[jira] [Commented] (FLINK-2111) Add "stop" signal to cleanly shutdown streaming jobs

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728884#comment-14728884 ] ASF GitHub Bot commented on FLINK-2111: --- Github user mjsax commented on a diff in th

[GitHub] flink pull request: [FLINK-2111] Add "stop" signal to cleanly shut...

2015-09-03 Thread mjsax
Github user mjsax commented on a diff in the pull request: https://github.com/apache/flink/pull/750#discussion_r38635830 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/taskmanager/TaskManager.scala --- @@ -411,6 +411,23 @@ class TaskManager( log.d

[jira] [Assigned] (FLINK-2615) Multiple restarts of Local Cluster for a single program

2015-09-03 Thread Sachin Goel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sachin Goel reassigned FLINK-2615: -- Assignee: Sachin Goel > Multiple restarts of Local Cluster for a single program > -

[jira] [Created] (FLINK-2615) Multiple restarts of Local Cluster for a single program

2015-09-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2615: -- Summary: Multiple restarts of Local Cluster for a single program Key: FLINK-2615 URL: https://issues.apache.org/jira/browse/FLINK-2615 Project: Flink Issue Type:

[jira] [Closed] (FLINK-2475) Rename Flink Client log file

2015-09-03 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax closed FLINK-2475. -- Resolution: Fixed fixed via 9f96b32bf8a0c77accdd91b7cfada2f6e751c167 > Rename Flink Client log

[jira] [Commented] (FLINK-2475) Rename Flink Client log file

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728850#comment-14728850 ] ASF GitHub Bot commented on FLINK-2475: --- Github user asfgit closed the pull request

[GitHub] flink pull request: [FLINK-2475] Rename Flink Client log file

2015-09-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1074 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-2613) Print usage information for Scala Shell

2015-09-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728833#comment-14728833 ] Maximilian Michels commented on FLINK-2613: --- Adding the message you suggested is

[jira] [Commented] (FLINK-2613) Print usage information for Scala Shell

2015-09-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728832#comment-14728832 ] Maximilian Michels commented on FLINK-2613: --- Oh good to know. I guess I only tri

[jira] [Commented] (FLINK-2613) Print usage information for Scala Shell

2015-09-03 Thread Nikolaas Steenbergen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728819#comment-14728819 ] Nikolaas Steenbergen commented on FLINK-2613: - There is a {{--help}} option: {

[GitHub] flink pull request: [FLINK-2030][FLINK-2274][core][utils]Histogram...

2015-09-03 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/861#issuecomment-137399688 Hey @chiwanpark , travis passes. Let me know if I should squash the commits. I'm only keeping them in case we need to go back to the Scala implementation. [which I

[jira] [Commented] (FLINK-2030) Implement an online histogram with Merging and equalization features

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728812#comment-14728812 ] ASF GitHub Bot commented on FLINK-2030: --- Github user sachingoel0101 commented on the

[jira] [Commented] (FLINK-2475) Rename Flink Client log file

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728793#comment-14728793 ] ASF GitHub Bot commented on FLINK-2475: --- Github user mjsax commented on the pull req

[GitHub] flink pull request: [FLINK-2475] Rename Flink Client log file

2015-09-03 Thread mjsax
Github user mjsax commented on the pull request: https://github.com/apache/flink/pull/1074#issuecomment-137397048 Will merge this... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[jira] [Commented] (FLINK-2235) Local Flink cluster allocates too much memory

2015-09-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728792#comment-14728792 ] Maximilian Michels commented on FLINK-2235: --- Pushed also to the release 0.9 bran

[jira] [Updated] (FLINK-2235) Local Flink cluster allocates too much memory

2015-09-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-2235: -- Fix Version/s: 0.9.2 > Local Flink cluster allocates too much memory > -

[jira] [Closed] (FLINK-2235) Local Flink cluster allocates too much memory

2015-09-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed FLINK-2235. - Resolution: Fixed > Local Flink cluster allocates too much memory > --

[jira] [Reopened] (FLINK-2235) Local Flink cluster allocates too much memory

2015-09-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels reopened FLINK-2235: --- Fix also in 0.9.2. > Local Flink cluster allocates too much memory > ---

[jira] [Commented] (FLINK-2583) Add Stream Sink For Rolling HDFS Files

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728787#comment-14728787 ] ASF GitHub Bot commented on FLINK-2583: --- Github user aljoscha commented on the pull

[jira] [Commented] (FLINK-2475) Rename Flink Client log file

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728786#comment-14728786 ] ASF GitHub Bot commented on FLINK-2475: --- Github user chiwanpark commented on the pul

[GitHub] flink pull request: [FLINK-2583] Add Stream Sink For Rolling HDFS ...

2015-09-03 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1084#issuecomment-137396268 Question is, should we do exactly once now or put it in as it is (more or less)? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] flink pull request: [FLINK-2475] Rename Flink Client log file

2015-09-03 Thread chiwanpark
Github user chiwanpark commented on the pull request: https://github.com/apache/flink/pull/1074#issuecomment-137396215 Looks good to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[jira] [Commented] (FLINK-2373) Add configuration parameter to createRemoteEnvironment method

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728777#comment-14728777 ] ASF GitHub Bot commented on FLINK-2373: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [FLINK-2373] Add configuration parameter to cr...

2015-09-03 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1066#discussion_r38629325 --- Diff: flink-tests/src/test/java/org/apache/flink/test/javaApiOperators/RemoteEnvironmentITCase.java --- @@ -0,0 +1,166 @@ +/* + * Licensed t

[jira] [Commented] (FLINK-2583) Add Stream Sink For Rolling HDFS Files

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728770#comment-14728770 ] ASF GitHub Bot commented on FLINK-2583: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-2583] Add Stream Sink For Rolling HDFS ...

2015-09-03 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1084#issuecomment-137393554 I think using truncate for exactly once is the way to go. To support users with older HDFS versions, how about this: 1. We consider only valid what was writt

[jira] [Commented] (FLINK-2475) Rename Flink Client log file

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728769#comment-14728769 ] ASF GitHub Bot commented on FLINK-2475: --- Github user mxm commented on the pull reque

[GitHub] flink pull request: [FLINK-2475] Rename Flink Client log file

2015-09-03 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1074#issuecomment-137393037 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[jira] [Commented] (FLINK-2608) Arrays.asList(..) does not work with CollectionInputFormat

2015-09-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728765#comment-14728765 ] Maximilian Michels commented on FLINK-2608: --- Seems to be a Kryo serialization is

[jira] [Closed] (FLINK-2614) Scala Shell's default local execution mode is broken

2015-09-03 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed FLINK-2614. - Resolution: Fixed Fixed via 14ba66b. > Scala Shell's default local execution mode is brok

[jira] [Commented] (FLINK-2614) Scala Shell's default local execution mode is broken

2015-09-03 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728751#comment-14728751 ] Till Rohrmann commented on FLINK-2614: -- Good catch. I'm wondering why the tests didn'

[jira] [Created] (FLINK-2614) Scala Shell's default local execution mode is broken

2015-09-03 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-2614: - Summary: Scala Shell's default local execution mode is broken Key: FLINK-2614 URL: https://issues.apache.org/jira/browse/FLINK-2614 Project: Flink

[jira] [Commented] (FLINK-2583) Add Stream Sink For Rolling HDFS Files

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728745#comment-14728745 ] ASF GitHub Bot commented on FLINK-2583: --- Github user rmetzger commented on a diff in

[GitHub] flink pull request: [FLINK-2583] Add Stream Sink For Rolling HDFS ...

2015-09-03 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1084#discussion_r38627730 --- Diff: docs/apis/streaming_guide.md --- @@ -1836,6 +1837,110 @@ More about information about Elasticsearch can be found [here](https://elastic.c

[jira] [Commented] (FLINK-2583) Add Stream Sink For Rolling HDFS Files

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728744#comment-14728744 ] ASF GitHub Bot commented on FLINK-2583: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-2583] Add Stream Sink For Rolling HDFS ...

2015-09-03 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1084#issuecomment-137390414 I'm currently trying out the module. Some comments: - Why do we name the module `flink-connector-hdfs`. I think a name such as `flink-connector-filesystems` or `flin

[jira] [Created] (FLINK-2613) Print usage information for Scala Shell

2015-09-03 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-2613: - Summary: Print usage information for Scala Shell Key: FLINK-2613 URL: https://issues.apache.org/jira/browse/FLINK-2613 Project: Flink Issue Type: I

[jira] [Created] (FLINK-2612) ZooKeeperLeaderElectionITCase failure

2015-09-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2612: -- Summary: ZooKeeperLeaderElectionITCase failure Key: FLINK-2612 URL: https://issues.apache.org/jira/browse/FLINK-2612 Project: Flink Issue Type: Bug R

[jira] [Commented] (FLINK-2605) Unclosed RandomAccessFile may leak resource in StaticFileServerHandler

2015-09-03 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728730#comment-14728730 ] Ufuk Celebi commented on FLINK-2605: Yes. This is part of the new web interface, which

[jira] [Commented] (FLINK-2605) Unclosed RandomAccessFile may leak resource in StaticFileServerHandler

2015-09-03 Thread Chiwan Park (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728729#comment-14728729 ] Chiwan Park commented on FLINK-2605: Nice catch, [~tedyu]. If you want your patch to

[jira] [Commented] (FLINK-2605) Unclosed RandomAccessFile may leak resource in StaticFileServerHandler

2015-09-03 Thread Chiwan Park (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728733#comment-14728733 ] Chiwan Park commented on FLINK-2605: Also, you can use try-with-resources. :) > Unclo

[GitHub] flink pull request: [FLINK-2030][FLINK-2274][core][utils]Histogram...

2015-09-03 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/861#issuecomment-137382016 Okay. Please take a look now. [There is an unintentional formatting introduced by IDE in Histogram.java. Will remove it while squashing.] --- If your project

[jira] [Commented] (FLINK-2030) Implement an online histogram with Merging and equalization features

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728718#comment-14728718 ] ASF GitHub Bot commented on FLINK-2030: --- Github user sachingoel0101 commented on the

[jira] [Commented] (FLINK-2030) Implement an online histogram with Merging and equalization features

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728712#comment-14728712 ] ASF GitHub Bot commented on FLINK-2030: --- Github user chiwanpark commented on the pul

[GitHub] flink pull request: [FLINK-2030][FLINK-2274][core][utils]Histogram...

2015-09-03 Thread chiwanpark
Github user chiwanpark commented on the pull request: https://github.com/apache/flink/pull/861#issuecomment-137381508 I'm inclined to preventing base class for the histogram. Decision Tree will be implemented in Scala and we can use pattern matching (case-match statement) for solving

[jira] [Created] (FLINK-2611) YARN reports failed final state for successful jobs

2015-09-03 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-2611: - Summary: YARN reports failed final state for successful jobs Key: FLINK-2611 URL: https://issues.apache.org/jira/browse/FLINK-2611 Project: Flink Issue Typ

[jira] [Commented] (FLINK-2606) Extend StormFileSpout to handle HDFS

2015-09-03 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728711#comment-14728711 ] Matthias J. Sax commented on FLINK-2606: It just came to my mind, that there exist

[jira] [Commented] (FLINK-2030) Implement an online histogram with Merging and equalization features

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728709#comment-14728709 ] ASF GitHub Bot commented on FLINK-2030: --- Github user sachingoel0101 commented on the

[GitHub] flink pull request: [FLINK-2030][FLINK-2274][core][utils]Histogram...

2015-09-03 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/861#issuecomment-137380847 Yes. For Discrete fields, quantiles do not make sense. In the paper, they only cover the continuous fields, since the Discrete fields are more or less trivial to h

[jira] [Commented] (FLINK-2030) Implement an online histogram with Merging and equalization features

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728701#comment-14728701 ] ASF GitHub Bot commented on FLINK-2030: --- Github user chiwanpark commented on the pul

[GitHub] flink pull request: [FLINK-2030][FLINK-2274][core][utils]Histogram...

2015-09-03 Thread chiwanpark
Github user chiwanpark commented on the pull request: https://github.com/apache/flink/pull/861#issuecomment-137379709 +1 for adding a class for `Double` values. From my curiosity, Could `DiscreteHistogram` be used for decision tree? In the given paper, they used histogram base

[jira] [Commented] (FLINK-2030) Implement an online histogram with Merging and equalization features

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728687#comment-14728687 ] ASF GitHub Bot commented on FLINK-2030: --- Github user sachingoel0101 commented on the

[GitHub] flink pull request: [FLINK-2030][FLINK-2274][core][utils]Histogram...

2015-09-03 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/861#issuecomment-137378160 Yes. I was concerned about the API breaking part too. What about keeping the original histogram as such, and add something like `DoubleHistogram`, which basica

[jira] [Commented] (FLINK-2030) Implement an online histogram with Merging and equalization features

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728685#comment-14728685 ] ASF GitHub Bot commented on FLINK-2030: --- Github user chiwanpark commented on the pul

[GitHub] flink pull request: [FLINK-2030][FLINK-2274][core][utils]Histogram...

2015-09-03 Thread chiwanpark
Github user chiwanpark commented on the pull request: https://github.com/apache/flink/pull/861#issuecomment-137376194 Hi, I just reviewed the updated PR. Sorry for late. Your implementation is nice. It seems acting like I expected. But I have to check the following: I

[jira] [Commented] (FLINK-2490) Remove unwanted boolean check in function SocketTextStreamFunction.streamFromSocket

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728655#comment-14728655 ] ASF GitHub Bot commented on FLINK-2490: --- Github user mxm commented on the pull reque

[GitHub] flink pull request: [FLINK-2490][FIX]Remove the retryForever check...

2015-09-03 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/992#issuecomment-137372443 I think there is an issue with Travis at the moment. Could you force push to this branch again? --- If your project is set up for it, you can reply to this email and have yo

[jira] [Commented] (FLINK-2480) Improving tests coverage for org.apache.flink.streaming.api

2015-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728651#comment-14728651 ] ASF GitHub Bot commented on FLINK-2480: --- Github user mxm commented on a diff in the

[GitHub] flink pull request: [FLINK-2480][test]add a test for Print Sink wi...

2015-09-03 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/1073#discussion_r38621439 --- Diff: flink-staging/flink-streaming/flink-streaming-core/src/test/java/org/apache/flink/streaming/api/functions/PrintSinkFunctionTest.java --- @@ -97,20 +76,

  1   2   >