Hello,

I would like to understand how the transfer of tuples emitted by the
executors move to the workers transfer queue. From what i understand


topology.executor.send.buffer.size :1024
is the number of tuples, once in the executors send queue, will be
transferred to the workers send queue as a batch.

topology.transfer.buffer.size :1024
is the number of messages sent by the worker over the network in batch.

question is: if i have bolts which take a lot of time to execute, then the
number of messages each executor can process is very low per second, say
about 2 tuples per sec, then would the executor outgoing transfer thread
move messages to worker transfer queue after 1024/2 = 512 seconds ? i have
40 executors per worker.

if not when does it decide to move messages from executor to worker
transfer queue ?

storm :0.9.4

Thanks
Anishek

Reply via email to