Hi Toy,

once you're enabling ack, throttle should be happened via max spout pending
regardless of using BaseBasicBolt or handle ack manually.
Btw, I don't know about how kinesis connector is implemented, but we
normally implement spout to try its best to catch up pulling the data so
unless there's no data available it won't stop pulling. Max spout pending
makes spout waiting for tuples on-the-fly hence if your topology is so fast
to process tuples there's less chance to let spout throttle itself. If it's
the case, you may want to have your own spout implementation and deal with
that. (apply some throttling approach while getting
ReadThroughtputException)

Hope this helps,
Jungtaek Lim (HeartSaVioR)

2018년 2월 10일 (토) 오전 3:51, Toy <noppani...@gmail.com>님이 작성:

> Hi,
>
> We're using Storm to handle the data from Kinesis Stream and we're getting
> a lot of ReadThroughtputException from the cluster. But we also use
> BaseBasicBolt which it's supposed to do the ack automatically and we need
> to throttle the read throughput. The question is does MaxSpoutPending work
> with BaseBasicBolt?
>
> Thanks,
>
>

Reply via email to