Thank you for your reply. As far as I understand, "slider flex ... " in the link http://slider.incubator.apache.org/docs/manpage.html performs scaling out upon the execution of the command. My questions is, does Slider have a programmable interface for scaling out? (and I'm not talking about automatic scaling, but about the functionality for an application to request more machines -- or memory/cpus from Slider).
Does Slider have such interface (API)? Thanks! -Jiwon On Fri, Jul 24, 2015 at 1:51 PM, Yong Feng <[email protected]> wrote: > Hi Jiwon, > > Slider supports horizontally scale out/in your application. Please refer to > following link for the user doc of slider commands which describes "slider > flex ..." > > http://slider.incubator.apache.org/docs/manpage.html > > Besides, YARN 1197 plans to support resizing YARN container. By leveraging > it, Slider is able to support vertically scale up/down your application > instance, for example increasing memory from 2GB to 4GB. > > https://issues.apache.org/jira/browse/YARN-1197 > > Based on slider's capabilities of scale out/in and scale up/down, you could > develop a driver to automatically flex your application. As I know there is > a team who is working on an open source general auto-scaler for YARN/Slider > based application which is named as Jaguar. You may contact them for > details. > > > https://hadoopsummit.uservoice.com/forums/283262-hadoop-governance-security-operations/suggestions/7074316-project-jaguar-an-application-autoscaler-for-hado > > Please feel free to let me know if you have any question. > > Thanks, > > Yong > > > On Fri, Jul 24, 2015 at 2:24 PM, Jiwon Seo <[email protected]> wrote: > > > Hi, > > > > I'm working on a research system for in-memory graph processing (called > > SociaLite). > > > > I'm curious if Slider supports dynamic resizing, requested by > applications. > > That is, if the application detects memory pressure, the it asks Slider > for > > more resources (e.g. nodes with XXX mb memory); then Slider will tell the > > application how many nodes are allocated/assigned to the app. > > > > Does Slider have this kind of application interface? (if so, any link to > > the doc?) Or for that functionality, should I directly use Yarn API? > > > > Thanks, > > > > -Jiwon > > >
