Re: external/storm-elasticsearch - upgrade requested

FYI there is an ES module in StormCrawler [ https://github.com/DigitalPebble/storm-crawler/tree/master/external/elasticsearch], its components are quite specific to storm-crawler apart from the MetricsComsumer

Storm 1.0.0 Windowing by id

Hi! With regard to the new windowing features of Storm 1.0.0, is it possible to group the windows by id, so that the events coming from different clients are processed by different windows? Thank you. Regards, Filipa

Re: Complete Latency Vs. Throughput--when do they not change in same direction?

Hey Nikos, Yep, totally agree with what you've written here. As I wrote in my response, the key point is whether the input rate differs. If the input rate is lower, totally agree that it makes sense that both the throughput and Complete Latency going down makes good sense. Similarly, if the rate

Re: Complete Latency Vs. Throughput--when do they not change in same direction?

Hello again John, No need to apologize. All experiments in distributed environments have so many details, that it is only normal to forget some of them in an initial explanation. Going back to my point on seeing less throughput with less latency, I will give you an example: Assume you own a

Re: Complete Latency Vs. Throughput--when do they not change in same direction?

Hey Nikos, Thanks for responding so quickly, and I apologize for leaving out a crucially important detail--the Kafka topic. My topo is reading from a static topic. I definitely agree that reading from a live topic could--and would likely--lead to variable throughput rates, both in terms of raw

Re: Complete Latency Vs. Throughput--when do they not change in same direction?

Hello John, I have to say that a system's telemetry is not a mystery easily understood. Then, let us try to deduce what might be the case in your use-case that causes inconsistent performance metrics. At first, I would like to ask if your KafkaSpout's produce tuples with the same rate. In other

Complete Latency Vs. Throughput--when do they not change in same direction?

Hi Everyone, I am a little puzzled by what I am seeing in some testing with a topology I have where the topo is reading from a KafkaSpout, doing some CPU intensive processing, and then writing out to Kafka via the standard KafkaBolt. I am doing testing in a multi-tenant environment and so test

RE: Storm KafkaSpout Integration

Larry, Could you please explain yourself? A single worded email telling me what to do is confusing and ignorant.Why are you telling me to unsubscribe? I was trying to be helpful by giving someone some code that they requested. RegardsDavid Date: Fri, 1 Apr 2016 10:25:51 +0100 Subject: Re:

Re: Storm KafkaSpout Integration

unsubscribe 2016-04-01 10:18 GMT+01:00 david kavanagh : > Hey, > > What i found online was a simple java Kafka Consumer, and i used that code > to write my own KafkaSpout. > Here is the link to the consumer that i found: >

RE: Storm KafkaSpout Integration

Hey, What i found online was a simple java Kafka Consumer, and i used that code to write my own KafkaSpout.Here is the link to the consumer that i found: http://wpcertification.blogspot.ie/2014/08/java-client-for-publishing-and.html I am using my implementation for a college assignment. Its