Will MaxSpoutPending work with BaseBasicBolt

2018-02-09 Thread Toy
Hi, We're using Storm to handle the data from Kinesis Stream and we're getting a lot of ReadThroughtputException from the cluster. But we also use BaseBasicBolt which it's supposed to do the ack automatically and we need to throttle the read throughput. The question is does MaxSpoutPending work wi

Resource Aware Scheduler Kills Nimbus

2018-02-09 Thread Wuyang Zhang
Hi, I have the difficulty with the resource aware scheduler from the version 1.1.1. As suggested by the website, I add the following lines to storm.yaml: *storm.scheduler: “org.apache.storm.scheduler.resource.ResourceAwareScheduler”* * supervisor.memory.capacity.mb: 2048.0* * supervisor.cpu.cap