[jira] [Updated] (STORM-810) PartitionManager in storm-kafka should commit latest offset before close

[ https://issues.apache.org/jira/browse/STORM-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiajun updated STORM-810: - Description: When KafkaSpout refresh with kafka partitions, it will remove patitions that no longer served by this

[jira] [Created] (STORM-810) PartitionManager in storm-kafka should commit latest offset before close

xiajun created STORM-810: Summary: PartitionManager in storm-kafka should commit latest offset before close Key: STORM-810 URL: https://issues.apache.org/jira/browse/STORM-810 Project: Apache Storm

Re: Forcing code distribution+geographic position of nodes

Depends on your implementation ;) Storm's default scheduler is implementing the same interface, so it is possible the do it in an efficient way. -Matthias On 05/06/2015 12:54 PM, Franca van Kaam wrote: Thanks Might be a stupid question but would this be efficient if I want to use this for

Re: Forcing code distribution+geographic position of nodes

Ok I will try it, thanks a lot ;) how about geographical coordinates? is it possible to put this as a property of the node and use it in the scheduling as well as in grouping to redirect tuples? On Wed, May 6, 2015 at 1:45 PM, Matthias J. Sax mj...@informatik.hu-berlin.de wrote: Depends on

Re: Forcing code distribution+geographic position of nodes

Hi, you can implement your own custom scheduler. An example how to do this is given here. https://xumingming.sinaapp.com/885/twitter-storm-how-to-develop-a-pluggable-scheduler/ -Matthias On 05/06/2015 12:18 PM, Franca van Kaam wrote: Hello, I am fairly new to Storm and Clojure and I am

Re: Forcing code distribution+geographic position of nodes

Thanks Might be a stupid question but would this be efficient if I want to use this for all of the nodes in my cluster? certain groups of nodes should have some of the bolts on them, and other nodes should be executing different bolts... Is it possible too do this on such a large scale? On Wed,

Re: Forcing code distribution+geographic position of nodes

That is possible, that need very careful design to get it right. The example show in the link I posted below, uses some meta data as well. This meta data could be your geographical coordinate I guess. -Matthias On 05/06/2015 01:58 PM, Franca van Kaam wrote: Ok I will try it, thanks a lot ;)

[GitHub] storm pull request: STORM-561: Add flux as an external module

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/546#discussion_r29808769 --- Diff: external/flux/README.md --- @@ -0,0 +1,834 @@ +# flux +A framework for creating and deploying Apache Storm streaming computations with

[GitHub] storm pull request: STORM-561: Add flux as an external module

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/546#discussion_r29808790 --- Diff: external/flux/README.md --- @@ -0,0 +1,834 @@ +# flux +A framework for creating and deploying Apache Storm streaming computations with

[jira] [Commented] (STORM-811) Hive test fail after first run

[ https://issues.apache.org/jira/browse/STORM-811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531568#comment-14531568 ] Jungtaek Lim commented on STORM-811: Really strange, I can't reproduce issue, too. I'm

[jira] [Commented] (STORM-561) Add ability to create topologies dynamically

[ https://issues.apache.org/jira/browse/STORM-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531599#comment-14531599 ] ASF GitHub Bot commented on STORM-561: -- Github user HeartSaVioR commented on a diff in

[GitHub] storm pull request: STORM-561: Add flux as an external module

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/546#discussion_r29810302 --- Diff: external/flux/flux-core/pom.xml --- @@ -0,0 +1,93 @@ +?xml version=1.0 encoding=UTF-8? +!-- + Licensed to the Apache Software

[jira] [Commented] (STORM-561) Add ability to create topologies dynamically

[ https://issues.apache.org/jira/browse/STORM-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531594#comment-14531594 ] ASF GitHub Bot commented on STORM-561: -- Github user HeartSaVioR commented on a diff in

[jira] [Commented] (STORM-561) Add ability to create topologies dynamically

[ https://issues.apache.org/jira/browse/STORM-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531605#comment-14531605 ] ASF GitHub Bot commented on STORM-561: -- Github user HeartSaVioR commented on a diff in

[jira] [Assigned] (STORM-811) Hive test fail after first run

[ https://issues.apache.org/jira/browse/STORM-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans reassigned STORM-811: - Assignee: Robert Joseph Evans Hive test fail after first run

[GitHub] storm pull request: STORM-561: Add flux as an external module

Github user ptgoetz commented on the pull request: https://github.com/apache/storm/pull/546#issuecomment-99629737 @HeartSaVioR, Thanks for the review! Thanks for catching that... I will fix it. --- If your project is set up for it, you can reply to this email and

[jira] [Commented] (STORM-561) Add ability to create topologies dynamically

[ https://issues.apache.org/jira/browse/STORM-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531558#comment-14531558 ] ASF GitHub Bot commented on STORM-561: -- Github user HeartSaVioR commented on a diff in

[jira] [Commented] (STORM-811) Hive test fail after first run

[ https://issues.apache.org/jira/browse/STORM-811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531439#comment-14531439 ] ASF GitHub Bot commented on STORM-811: -- GitHub user revans2 opened a pull request:

[jira] [Commented] (STORM-561) Add ability to create topologies dynamically

[ https://issues.apache.org/jira/browse/STORM-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531567#comment-14531567 ] ASF GitHub Bot commented on STORM-561: -- Github user ptgoetz commented on the pull

[jira] [Commented] (STORM-561) Add ability to create topologies dynamically

[ https://issues.apache.org/jira/browse/STORM-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531556#comment-14531556 ] ASF GitHub Bot commented on STORM-561: -- Github user HeartSaVioR commented on a diff in

[GitHub] storm pull request: STORM-561: Add flux as an external module

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/546#discussion_r29810793 --- Diff: external/flux/flux-examples/pom.xml --- @@ -0,0 +1,86 @@ +?xml version=1.0 encoding=UTF-8? +!-- + Licensed to the Apache Software

[GitHub] storm pull request: STORM-561: Add flux as an external module

Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/546#discussion_r29810721 --- Diff: external/flux/flux-examples/README.md --- @@ -0,0 +1,68 @@ +# Flux Examples +A collection of examples illustrating various capabilities.

[jira] [Created] (STORM-811) Hive test fail after first run

Robert Joseph Evans created STORM-811: - Summary: Hive test fail after first run Key: STORM-811 URL: https://issues.apache.org/jira/browse/STORM-811 Project: Apache Storm Issue Type: Bug

[GitHub] storm pull request: STORM-811: remove old metastor_db before runni...

GitHub user revans2 opened a pull request: https://github.com/apache/storm/pull/547 STORM-811: remove old metastor_db before running tests again. You can merge this pull request into a Git repository by running: $ git pull https://github.com/revans2/incubator-storm STORM-811

[GitHub] storm pull request: STORM-561: Add flux as an external module

GitHub user ptgoetz opened a pull request: https://github.com/apache/storm/pull/546 STORM-561: Add flux as an external module For a description of everything this does, it's probably easiest to look at the README file:

[jira] [Assigned] (STORM-561) Add ability to create topologies dynamically

[ https://issues.apache.org/jira/browse/STORM-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] P. Taylor Goetz reassigned STORM-561: - Assignee: P. Taylor Goetz (was: Nathan Leung) Add ability to create topologies

[jira] [Commented] (STORM-561) Add ability to create topologies dynamically

[ https://issues.apache.org/jira/browse/STORM-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531156#comment-14531156 ] ASF GitHub Bot commented on STORM-561: -- GitHub user ptgoetz opened a pull request: