Re: Trident DRPC In-Order Processing

It seems it can't be done. So, I used a Pub/Sub feedback loop to simulate the synchronized processing feature of Storm DRPC. Any better ideas? On Wed, Nov 2, 2016 at 11:15 AM, Nilay Binjola wrote: > Bump. > > I would really appreciate suggestions and ideas on this. > > On

Re: Explicit Topology Parallelism Shape

That's unfortunate, I was hoping for a built-in way to do it, but that's ok. Thanks for the quick response. - Arthur On Mon, Nov 7, 2016 at 11:56 AM, P. Taylor Goetz wrote: > Yes, to do what you want you would need to implement a custom scheduler. > > More details can be

Re: Explicit Topology Parallelism Shape

Yes, to do what you want you would need to implement a custom scheduler. More details can be found here: http://storm.apache.org/releases/1.0.2/Storm-Scheduler.html -Taylor > On Nov 7, 2016, at 11:31 AM, Arthur Maciejewicz

Explicit Topology Parallelism Shape

Hello All, Is there a way to make the "shape" of topology parallelism explicit? For example, assume: * W workers on W nodes * 2 spouts with 1 executor each (total of 2 executors) * 1 "mapper" bolt with M executors * 1 "process" bolt with N executors. Is it currently possibly to co-locate

Re: ESBolt error

Thanks all for the responses. Turned out that i needed to set es.nodes.wan.only to true. That fixed the issue. On Mon, Nov 7, 2016 at 6:26 AM, Zhechao Ma wrote: > Did you set these two configuration "es.nodes" and "es.port" ? That should > be set like this: > >

Re: how to pause a topology

This can also be a simple logic in the spout nextTuple(). Something like: if (pauseEmitting) { //don't do anything } else { //emit tuples } On Mon, Nov 7, 2016 at 3:58 PM, Mohsen Bande wrote: > Charles, > when a component received a pause control tuple, what should it

Re: how to pause a topology

Charles, when a component received a pause control tuple, what should it do with incoming data tuples? should it fail/ack them? or wait forever? none of these seems good design On Mon, Nov 7, 2016 at 10:59 AM, mr_dj...@163.com wrote: > Hi Bande, > You may set a "control bolt",

KafkaBolt JSON Serializer Problem

I'm using KafkaBolt to write data to kafka. Tuple to kafka map is . I set both *key.serializer* and *value.serializer* as "org.apache.kafka.common.serialization.StringSerializer". I get the following Exception: org.apache.kafka.common.errors.SerializationException: Can't