Re: Integration between python and java in storm

2016-12-16 Thread Hugo Da Cruz Louro
Sam, You can take a look at the WordCountTopology example. The split sentence logic is in Python. This should be a good reference. Hugo On Dec 16, 2016, at 3:35 PM, sam

Re: Integration between python and java in storm

2016-12-16 Thread Li Wang
Storm has a shell bolt to process tuples in python. This might be what you need. Sent from my iPhone > On 17 Dec 2016, at 7:35 AM, sam mohel wrote: > > I have a project using storm written in JAVA . i want to exchange the > algorithm that the project used it to another

Integration between python and java in storm

2016-12-16 Thread sam mohel
I have a project using storm written in JAVA . i want to exchange the algorithm that the project used it to another BUT the other algorithm written in Python . Can i do this exchange ? or Should i re-write whole project with python ? Any Help will be appreciating .. Thanks

Re: Σχετ: DRPC http request

2016-12-16 Thread Bobby Evans
"exclamation" is the function, not "exclaim" the url should be http://localhost:3774/drpc/exclamation/aaa "exclaim; is the name of your topology, not the name of the function. - Bobby On Friday, December 16, 2016 2:52 PM, "tsantalos-spa...@yahoo.gr.INVALID"

Σχετ: DRPC http request

2016-12-16 Thread tsantalos-spamia
Ok, for the following typical storm example, how am I supposed to send a request over http ?? I see that via calling drpc.execute("exclamation", "aaa") you send the request aaa. The corresponding url over http?? The  http://localhost:3774/drpc/exclaim/aaa does not work                

[GitHub] storm pull request #1674: STORM-2083: Blacklist scheduler

2016-12-16 Thread abellina
Github user abellina commented on a diff in the pull request: https://github.com/apache/storm/pull/1674#discussion_r92872082 --- Diff: storm-core/src/jvm/org/apache/storm/scheduler/blacklist/BlacklistScheduler.java --- @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache

Confusing "nil" value for topology.eventlogger.executors

2016-12-16 Thread S G
Hi, I see the value "nil" for topology.eventlogger.executors at http://storm.apache.org/releases/1.0.0/Eventlogging.html While other values are 0 or 1, "nil" seems really confusing especially because it does not disable something, rather it enables something. Something not expected of "nil" as

[GitHub] storm issue #1825: STORM-2236 storm kafka client support manual partition ma...

2016-12-16 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/1825 Also I was wrong about spout instances interfering during reassignment. Since the task count is constant for the lifetime of the topology, there's no issue since a partition will always be assigned to

[GitHub] storm issue #1825: STORM-2236 storm kafka client support manual partition ma...

2016-12-16 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/1825 Btw @liurenjie1024 you need to make a PR for this against master first. We can't as far as I know merge features to 1.x before they are also on master. --- If your project is set up for it, you can

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92851175 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/TopicPartitionComparator.java --- @@ -0,0 +1,21 @@ +package

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92845198 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -59,18 +60,24 @@ // Storm

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92850100 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpoutConfig.java --- @@ -230,8 +237,37 @@ public Builder(Map

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92844773 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -236,6 +257,35 @@ private boolean poll() {

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92850399 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpoutConfig.java --- @@ -230,8 +237,37 @@ public Builder(Map

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92850866 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/TopicPartitionComparator.java --- @@ -0,0 +1,21 @@ +package

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92850572 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpoutConfig.java --- @@ -230,8 +237,37 @@ public Builder(Map

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92845054 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -200,16 +215,22 @@ private void setAcked(TopicPartition

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92847519 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -262,11 +312,12 @@ private void

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92845884 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -236,6 +257,35 @@ private boolean poll() {

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92848870 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -360,18 +411,22 @@ private void

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92845477 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -236,6 +257,35 @@ private boolean poll() {

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92844143 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -59,18 +60,24 @@ // Storm

[GitHub] storm pull request #1825: STORM-2236 storm kafka client support manual parti...

2016-12-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1825#discussion_r92849984 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpoutConfig.java --- @@ -230,8 +237,37 @@ public Builder(Map

[GitHub] storm pull request #1759: STORM-2185: Storm Supervisor doesn't delete direct...

2016-12-16 Thread knusbaum
Github user knusbaum closed the pull request at: https://github.com/apache/storm/pull/1759 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: DRPC http request

2016-12-16 Thread Bobby Evans
By default the http port for DRPC is 3774.  DRPC also requires a function and a payload.  Your topology that is using DRPC should have been configured with a function to use.  I don't know what that function is but you should know because you have launched your own topology.  If you have

[GitHub] storm pull request #1674: STORM-2083: Blacklist scheduler

2016-12-16 Thread abellina
Github user abellina commented on a diff in the pull request: https://github.com/apache/storm/pull/1674#discussion_r92843643 --- Diff: storm-core/src/jvm/org/apache/storm/scheduler/blacklist/BlacklistScheduler.java --- @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache

[GitHub] storm pull request #1674: STORM-2083: Blacklist scheduler

2016-12-16 Thread abellina
Github user abellina commented on a diff in the pull request: https://github.com/apache/storm/pull/1674#discussion_r92840532 --- Diff: storm-core/src/jvm/org/apache/storm/scheduler/blacklist/BlacklistScheduler.java --- @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache

[GitHub] storm pull request #1674: STORM-2083: Blacklist scheduler

2016-12-16 Thread abellina
Github user abellina commented on a diff in the pull request: https://github.com/apache/storm/pull/1674#discussion_r92837439 --- Diff: storm-core/src/jvm/org/apache/storm/scheduler/blacklist/BlacklistScheduler.java --- @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache

[GitHub] storm pull request #1674: STORM-2083: Blacklist scheduler

2016-12-16 Thread abellina
Github user abellina commented on a diff in the pull request: https://github.com/apache/storm/pull/1674#discussion_r92840162 --- Diff: storm-core/src/jvm/org/apache/storm/scheduler/blacklist/BlacklistScheduler.java --- @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache

[GitHub] storm pull request #1674: STORM-2083: Blacklist scheduler

2016-12-16 Thread abellina
Github user abellina commented on a diff in the pull request: https://github.com/apache/storm/pull/1674#discussion_r92839936 --- Diff: storm-core/src/jvm/org/apache/storm/scheduler/blacklist/BlacklistScheduler.java --- @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache

[GitHub] storm pull request #1674: STORM-2083: Blacklist scheduler

2016-12-16 Thread abellina
Github user abellina commented on a diff in the pull request: https://github.com/apache/storm/pull/1674#discussion_r92837760 --- Diff: storm-core/src/jvm/org/apache/storm/scheduler/blacklist/BlacklistScheduler.java --- @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache

[GitHub] storm pull request #1674: STORM-2083: Blacklist scheduler

2016-12-16 Thread abellina
Github user abellina commented on a diff in the pull request: https://github.com/apache/storm/pull/1674#discussion_r92837309 --- Diff: storm-core/src/jvm/org/apache/storm/scheduler/blacklist/BlacklistScheduler.java --- @@ -0,0 +1,252 @@ +/** + * Licensed to the Apache

[GitHub] storm issue #1785: [STORM-2201] Add dynamic scheduler configuration loading.

2016-12-16 Thread abellina
Github user abellina commented on the issue: https://github.com/apache/storm/pull/1785 thanks @ppoulosk, will do another pass today. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

DRPC http request

2016-12-16 Thread kalliopi kalantzaki
Hello, I am confused probably by something  quite trivial for most drpc users. I have implemented an initial Drpc storm project. My questions are:    1) If a third party wants to post an http request to my drcp application, how is this possible? I have found that this is made according to

[GitHub] storm issue #1785: [STORM-2201] Add dynamic scheduler configuration loading.

2016-12-16 Thread ppoulosk
Github user ppoulosk commented on the issue: https://github.com/apache/storm/pull/1785 Markdown added for interface and describing the configuration of implementations. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

Re: How to debug java.nio.channels.ClosedChannelException in Storm 1.0.2

2016-12-16 Thread Bobby Evans
Are you using acking and/or do you have back-pressure enabled? Your worker crashed because it exceeded the GC overhead limit which by default in java means that you were spending moe than 98% of the time doing GC and only 2% of the time doing real work.  I am rather surprised that the

[GitHub] storm issue #1816: STORM-2223: PMMLBolt

2016-12-16 Thread arunmahadevan
Github user arunmahadevan commented on the issue: https://github.com/apache/storm/pull/1816 +1 the changes looks good. After unzipping the distribution, I am not able to find the examples jar file under examples/storm-pmml-examples. Its under external/storm-pmml. --- If your