Team,
We have provisioned a distributed storm environment(version:1.2.1) and noticed
that Storm(or netty) uses some random ports to listen for TCP connections. Can
these port(or ranges) be configured, as we do for supervisor.slots.ports:
- 6700
Ex.
tcp60 0 :::39855:::*
Hi,
Can someone please explain at what point storm checks and applies
MAX_SPOUT_PENDING limit. Also, is this limit applied per executor(or Task
if that's the case) of spout or aggregated and applied over all the
executors of spout.
Suppose I have 3 executors and 3 tasks of spouts, each of them
Supplementing the other great answers here, Storm checks max spout pending
before it invokes nextTuple on the spout. The spout executor calls
nextTuple in a loop. If the spout task has more pending tuples (i.e.
emitted but not acked or failed or timed out) than max spout pending, the
executor
It’s kind of implied from prior responses but just wanted to emphasize .. it
is not used if ACKing is disabled (I.e acker count = 0)
Sent from Yahoo Mail for iPhone
On Wednesday, April 3, 2019, 11:50 AM, Stig Rohde Døssing
wrote:
Supplementing the other great answers here, Storm checks
*Storm version*: 1.0.3 I'm registering custom metric in the makeState of
the StateFactory implementation.
@Overridepublic State makeState(final Map conf, final IMetricsContext
metricsContext, final int partitionIndex, final int numPartitions) {
ReducedMetric reducedMetric = new
I’m pretty sure it’s per spout task. And they’re not coordinated. Each task
gets its own count.
Joshua
On Wed, Apr 3, 2019 at 4:50 AM Jayant Sharma
wrote:
> Hi,
>
> Can someone please explain at what point storm checks and applies
> MAX_SPOUT_PENDING limit. Also, is this limit applied per
Hi Jayant,
The MAX_SPOUT_PENDING is applied in each of the spouts.
Each spout take count of all the tuples it sends, increasing it for each emit
and decreasing it when it receive the final ack message for a “pending tuple”
(= a tuple that is sent but it’s still waiting an ack).
If the number
