Re: Resource Aware Scheduler Kills Nimbus

2018-02-10 Thread Wuyang Zhang
Hi Jerry, I am not familiar with the pull operation on the Storm website... Can you do it when you get a chance? Also, I wonder how can I accurately specify the resource requirement, especially the cpu demand, for each task? Best, Wuyang ᐧ On Sat, Feb 10, 2018 at 3:21 PM, Jerry Peng wrote: >

Re: Resource Aware Scheduler Kills Nimbus

2018-02-10 Thread Jerry Peng
Yup, an error in the documentation Feel free to submit a pull request to fix the documentation. Best, Jerry On Sat, Feb 10, 2018 at 1:42 PM, Wuyang Zhang wrote: > Ok, I find it works by adding > storm.scheduler: org.apache.storm.scheduler.resource. > ResourceAwareScheduler > > instead of addi

Re: Resource Aware Scheduler Kills Nimbus

2018-02-10 Thread Wuyang Zhang
Ok, I find it works by adding storm.scheduler: org.apache.storm.scheduler.resource.ResourceAwareScheduler instead of adding storm.scheduler: “org.apache.storm.scheduler.resource.ResourceAwareScheduler” suggested by the website.. ᐧ On Sat, Feb 10, 2018 at 2:22 PM, Wuyang Zhang wrote: > When I

Re: Resource Aware Scheduler Kills Nimbus

2018-02-10 Thread Wuyang Zhang
When I redo the procedure, here is the more log *2018-02-10 14:10:32.791 o.a.s.d.nimbus main [INFO] Using custom scheduler: “org.apache.storm.scheduler.resource.ResourceAwareScheduler”* *2018-02-10 14:10:32.793 o.a.s.d.nimbus main [ERROR] Error on initialization of server service-handler* *java.la

Re: Resource Aware Scheduler Kills Nimbus

2018-02-10 Thread Wuyang Zhang
Hi Jerry, I just retry to use the resource aware scheduler in a single node with 4 slots without any further settings. The scheduler still kills the nimbus process. Please find nimbus.log and storm.yaml attached. Without add the line storm.scheduler: “org.apache.storm.scheduler.resource.Resource

Re: Resource Aware Scheduler Kills Nimbus

2018-02-10 Thread Zhang Wuyang
Hi Jerry, Thank you for the reply. Please find the storm.yaml below: ### These MUST be filled in for a storm configuration storm.zookeeper.servers: - "10.10.21.1" - "10.10.21.2" - "10.10.21.3" - "10.10.21.4" - "10.10.21.5" - "10.10.21.6" - "10.10.21.7"

Re: Resource Aware Scheduler Kills Nimbus

2018-02-10 Thread Jerry Peng
Wuyang, Can you provide your whole storm.yaml ? Best, Jerry On Fri, Feb 9, 2018 at 9:44 PM, Wuyang Zhang wrote: > Hi, > > I have the difficulty with the resource aware scheduler from the version > 1.1.1. > > As suggested by the website, I add the following lines to storm.yaml: > > *storm.sch