Hello Eric,
I am glad you are interested in my work on Resource Aware Scheduling in Storm.
I have a initial implementation of the code on my github:
https://github.com/jerrypeng/storm/tree/opensource_ras
I haven't made a pull request yet but I will make it soon. We are actively
improving and adding functionality at Yahoo to the initial work. In the future
we will add enforced resource isolation through using CGroups or a something
similar.
Best,
Boyang Jerry Peng
On Monday, September 14, 2015 5:05 PM, Erik Weathers
<[email protected]> wrote:
hi Storm Devs,
After reading the release notes for 0.10-beta, I was unsure if the
multi-tenancy feature will isolate topologies from one another in terms of
their process resources (CPU, memory):
- https://storm.apache.org/2015/06/15/storm0100-beta-released.html
- Note: there is a reference to: "configurable resource limits."
To understand how this is implemented, I tried searching through the code
(both 0.10.x-branch and master), but couldn't find any reference to
"cgroup". So how is the resource isolation being done?
Maybe this release note is referencing the "R-storm" work? That still
isn't isolating/limiting resources as far as I have been able to discern,
it's instead focused on scheduling. Also it doesn't seem to be fixed in
0.10 already, so I'm doubtful of it being the answer to my question.
- http://web.engr.illinois.edu/~bpeng/files/r-storm.pdf
- https://issues.apache.org/jira/browse/STORM-893
Thanks!
- Erik
