[GitHub] flink pull request: [FLINK-1615] [java api] SimpleTweetInputFormat

2015-04-28 Thread Elbehery
Github user Elbehery commented on the pull request: https://github.com/apache/flink/pull/621#issuecomment-97068257 @aljoscha GOT IT .. Now the build success locally. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[jira] [Commented] (FLINK-1615) Introduces a new InputFormat for Tweets

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517032#comment-14517032 ] ASF GitHub Bot commented on FLINK-1615: --- Github user Elbehery commented on the pull

[jira] [Commented] (FLINK-1950) Increase default heap cutoff ratio from 20% to 30% and move default value to ConfigConstants

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517079#comment-14517079 ] ASF GitHub Bot commented on FLINK-1950: --- Github user tillrohrmann commented on a

[GitHub] flink pull request: FLINK-1950: Change heap safety margin computat...

2015-04-28 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/637#issuecomment-97079297 Looks good to me. I'm strongly for merging this rather soon, since this will improve the user experience. --- If your project is set up for it, you can reply to

[GitHub] flink pull request: FLINK-1950: Change heap safety margin computat...

2015-04-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/637#discussion_r29246446 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java --- @@ -197,10 +197,19 @@ * Upper bound for heap cutoff

[jira] [Commented] (FLINK-1950) Increase default heap cutoff ratio from 20% to 30% and move default value to ConfigConstants

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517081#comment-14517081 ] ASF GitHub Bot commented on FLINK-1950: --- Github user tillrohrmann commented on the

[jira] [Created] (FLINK-1953) Rework Checkpoint Coordinator

2015-04-28 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1953: --- Summary: Rework Checkpoint Coordinator Key: FLINK-1953 URL: https://issues.apache.org/jira/browse/FLINK-1953 Project: Flink Issue Type: Bug

[GitHub] flink pull request: [FLINK-1670] Made DataStream iterable

2015-04-28 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/581#issuecomment-97051927 I tested it from the IDE and submitting remotely to the local cluster, it seems to work properly. Later today I will try running it on EC2. It is actually a very neat

[jira] [Commented] (FLINK-1670) Collect method for streaming

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516982#comment-14516982 ] ASF GitHub Bot commented on FLINK-1670: --- Github user gyfora commented on the pull

[jira] [Commented] (FLINK-1952) Cannot run ConnectedComponents example: Could not allocate a slot on instance

2015-04-28 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516845#comment-14516845 ] Stephan Ewen commented on FLINK-1952: - That is helpful, thanks! Cannot run

[jira] [Commented] (FLINK-1950) Increase default heap cutoff ratio from 20% to 30% and move default value to ConfigConstants

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516936#comment-14516936 ] ASF GitHub Bot commented on FLINK-1950: --- Github user StephanEwen commented on the

[GitHub] flink pull request: FLINK-1950: Change heap safety margin computat...

2015-04-28 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/637#issuecomment-97102260 Thank you for the feedback. I'm going to merge the PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[jira] [Commented] (FLINK-1950) Increase default heap cutoff ratio from 20% to 30% and move default value to ConfigConstants

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517174#comment-14517174 ] ASF GitHub Bot commented on FLINK-1950: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: FLINK-1950: Change heap safety margin computat...

2015-04-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/637 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-1950) Increase default heap cutoff ratio from 20% to 30% and move default value to ConfigConstants

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517178#comment-14517178 ] ASF GitHub Bot commented on FLINK-1950: --- Github user asfgit closed the pull request

[GitHub] flink pull request: [FLINK-1937] [ml] Fixes sparse vector/matrix c...

2015-04-28 Thread chiwanpark
Github user chiwanpark commented on the pull request: https://github.com/apache/flink/pull/636#issuecomment-97100649 Looks good to merge. :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (FLINK-1937) Cannot create SparseVector with only one non-zero element.

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517158#comment-14517158 ] ASF GitHub Bot commented on FLINK-1937: --- Github user chiwanpark commented on the

[jira] [Commented] (FLINK-1670) Collect method for streaming

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517325#comment-14517325 ] ASF GitHub Bot commented on FLINK-1670: --- Github user gyfora commented on the pull

[GitHub] flink pull request: [FLINK-1948] [streaming] Manual task slot shar...

2015-04-28 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/634#issuecomment-97134507 Looks good. How about we try to offer a method like `startNewChain()` as well, so that the pipeline control seems consistent. We then have increasing levels

[GitHub] flink pull request: [FLINK-1670] Made DataStream iterable

2015-04-28 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/581#issuecomment-97125728 I tried it on EC2, and it worked properly when I submitted the job from the command line. I cannot submit to EC2 using the remote environment but thats probably a firewall

[GitHub] flink pull request: [FLINK-1922] Fixes NPE when TM receives a null...

2015-04-28 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/631#discussion_r29262910 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/taskmanager/TaskInputSplitProviderTest.java --- @@ -0,0 +1,93 @@ +/* + * Licensed

[jira] [Commented] (FLINK-1948) Add manual task slot handling for streaming jobs

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517380#comment-14517380 ] ASF GitHub Bot commented on FLINK-1948: --- Github user StephanEwen commented on the

[jira] [Commented] (FLINK-1922) Failed task deployment causes NPE on input split assignment

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517389#comment-14517389 ] ASF GitHub Bot commented on FLINK-1922: --- Github user StephanEwen commented on a diff

[jira] [Commented] (FLINK-1948) Add manual task slot handling for streaming jobs

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517390#comment-14517390 ] ASF GitHub Bot commented on FLINK-1948: --- Github user gyfora commented on the pull

[GitHub] flink pull request: [FLINK-1948] [streaming] Manual task slot shar...

2015-04-28 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/634#issuecomment-97135328 when you say startNewResourceGroup() that starts a new chain as well, but I guess we could specify a startNewChain() but then we should probably add a method for isolating

[GitHub] flink pull request: [FLINK-1927] [py] Operator distribution rework

2015-04-28 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/638 [FLINK-1927] [py] Operator distribution rework Python operators are no longer serialized and instead rebuilt on each node. This also means that the dill library is no longer necessary. You can merge

[jira] [Commented] (FLINK-924) Extend JarFileCreator to automatically include dependencies

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516690#comment-14516690 ] ASF GitHub Bot commented on FLINK-924: -- Github user StephanEwen commented on the pull

[GitHub] flink pull request: [FLINK-924] Add automatic dependency retrieval...

2015-04-28 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/35#issuecomment-96982580 Very good! Is there a way we can integrate this deeper with the remote environment? Something like `env.autoCollectDependencies()` and then it internally build

[jira] [Commented] (FLINK-1950) Increase default heap cutoff ratio from 20% to 30% and move default value to ConfigConstants

2015-04-28 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516694#comment-14516694 ] Stephan Ewen commented on FLINK-1950: - Given that our non-heap overhead has a minimal

[GitHub] flink pull request: [FLINK-924] Add automatic dependency retrieval...

2015-04-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/35 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: [FLINK-924] Add automatic dependency retrieval...

2015-04-28 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/35#issuecomment-96960370 Thanks for working with this on me. Very nice contribution. :smile: --- If your project is set up for it, you can reply to this email and have your reply appear on

[jira] [Commented] (FLINK-1937) Cannot create SparseVector with only one non-zero element.

2015-04-28 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516699#comment-14516699 ] Till Rohrmann commented on FLINK-1937: -- Hi [~chiwanpark], the problem here is that

[GitHub] flink pull request: [FLINK-1922] Fixes NPE when TM receives a null...

2015-04-28 Thread hsaputra
Github user hsaputra commented on a diff in the pull request: https://github.com/apache/flink/pull/631#discussion_r29268270 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/taskmanager/TaskInputSplitProviderTest.java --- @@ -0,0 +1,93 @@ +/* + * Licensed to

[jira] [Commented] (FLINK-1922) Failed task deployment causes NPE on input split assignment

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517515#comment-14517515 ] ASF GitHub Bot commented on FLINK-1922: --- Github user hsaputra commented on a diff in

[GitHub] flink pull request: [FLINK-1523][gelly] Vertex centric iteration e...

2015-04-28 Thread andralungu
Github user andralungu commented on the pull request: https://github.com/apache/flink/pull/537#issuecomment-97159494 Thanks for the review, @StephanEwen! PR updated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[jira] [Commented] (FLINK-1523) Vertex-centric iteration extensions

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517562#comment-14517562 ] ASF GitHub Bot commented on FLINK-1523: --- Github user andralungu commented on the

[jira] [Commented] (FLINK-1676) enableForceKryo() is not working as expected

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517580#comment-14517580 ] ASF GitHub Bot commented on FLINK-1676: --- Github user StephanEwen commented on the

[jira] [Commented] (FLINK-1922) Failed task deployment causes NPE on input split assignment

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517581#comment-14517581 ] ASF GitHub Bot commented on FLINK-1922: --- Github user StephanEwen commented on the

[GitHub] flink pull request: [FLINK-1615] [java api] SimpleTweetInputFormat

2015-04-28 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/621#issuecomment-96953776 Unfortunately, Travis cuts of the log if it is too long, like here: https://travis-ci.org/aljoscha/flink/jobs/60177866 (that's from your pull request). You have to click

[jira] [Commented] (FLINK-1615) Introduces a new InputFormat for Tweets

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516564#comment-14516564 ] ASF GitHub Bot commented on FLINK-1615: --- Github user aljoscha commented on the pull

[jira] [Created] (FLINK-1952) Cannot run ConnectedComponents example: Could not allocate a slot on instance

2015-04-28 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1952: - Summary: Cannot run ConnectedComponents example: Could not allocate a slot on instance Key: FLINK-1952 URL: https://issues.apache.org/jira/browse/FLINK-1952

[GitHub] flink pull request: [FLINK-1937] [ml] Fixes sparse vector/matrix c...

2015-04-28 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/636 [FLINK-1937] [ml] Fixes sparse vector/matrix creation fromCOO with a single element The problem seems to be that Scala apparently cannot infer the correct type of a single tuple in the

[jira] [Commented] (FLINK-1937) Cannot create SparseVector with only one non-zero element.

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516703#comment-14516703 ] ASF GitHub Bot commented on FLINK-1937: --- GitHub user tillrohrmann opened a pull

[GitHub] flink pull request: [FLINK-1925] Fixes blocking method submitTask ...

2015-04-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/622#discussion_r29226710 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/Execution.java --- @@ -345,26 +346,9 @@ public void onComplete(Throwable

[GitHub] flink pull request: [FLINK-1925] Fixes blocking method submitTask ...

2015-04-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/622#discussion_r29227228 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/taskmanager/TaskManager.scala --- @@ -795,108 +795,111 @@ extends Actor with

[jira] [Commented] (FLINK-1925) Split SubmitTask method up into two phases: Receive TDD and instantiation of TDD

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516736#comment-14516736 ] ASF GitHub Bot commented on FLINK-1925: --- Github user tillrohrmann commented on a

[jira] [Commented] (FLINK-924) Extend JarFileCreator to automatically include dependencies

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516589#comment-14516589 ] ASF GitHub Bot commented on FLINK-924: -- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-924) Extend JarFileCreator to automatically include dependencies

2015-04-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516590#comment-14516590 ] ASF GitHub Bot commented on FLINK-924: -- Github user aljoscha commented on the pull

[jira] [Resolved] (FLINK-1924) [Py] Refactor a few minor things

2015-04-28 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1924. --- Resolution: Fixed Merged [Py] Refactor a few minor things

[jira] [Assigned] (FLINK-1950) Increase default heap cutoff ratio from 20% to 30% and move default value to ConfigConstants

2015-04-28 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reassigned FLINK-1950: - Assignee: Robert Metzger Increase default heap cutoff ratio from 20% to 30% and move

[jira] [Resolved] (FLINK-1950) Increase default heap cutoff ratio from 20% to 30% and move default value to ConfigConstants

2015-04-28 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1950. --- Resolution: Fixed Resolved in http://git-wip-us.apache.org/repos/asf/flink/commit/f2daa108