Thanks Sumit, Good to know this! I'm curious how does slider do to launch hbase on yarn. What I understand is you can not run region server on the same node. So if you want to run hbase on yarn by slider, you have to specify more than half of the available resource per host?
Best, Siyuan On Mon, Aug 4, 2014 at 1:56 PM, Sumit Mohanty <[email protected]> wrote: > Thats another feature called anti-affinity, from YARN, to enable container > allocation on different nodes for same container type. This feature is not > yet available and in the mean time you can enforce it by asking more than > half of available resource (e.g. memory) per host. > > Depending on the timeline of the availability of anti-affinity feature from > YARN, Slider can also add support for such a feature but the desirable path > is to get this through YARN. > > > On Mon, Aug 4, 2014 at 1:48 PM, [email protected] <[email protected]> wrote: > > > Thanks guys, so my next question is how can you guarantee containers are > > allocated on different nodes? > > > > > > Best, > > Siyuan > > > > > > On Mon, Aug 4, 2014 at 1:02 PM, Sumit Mohanty <[email protected]> > > wrote: > > > > > +1 to Joe's explanation. > > > > > > Slider plans to use the "label" support enabled through YARN-796 and > > allow > > > creation of app instances against a label. This way you can ensure that > > the > > > app instance has containers allocated only on a subset of the nodes. > > > > > > > > > On Mon, Aug 4, 2014 at 12:15 PM, Joseph Niemiec < > > [email protected]> > > > wrote: > > > > > > > I'll let someone else chime in here but my assumption is this will > > > require > > > > YARN-796 and then have Slider expose the config somehow which from my > > > > exploration has yet to be done. > > > > > > > > Outside of Slider if you wrote your own AM you can control this today > > in > > > > your resourcerequest to the RM. > > > > > > > > https://issues.apache.org/jira/browse/YARN-796 > > > > > > > > > > > > On Mon, Aug 4, 2014 at 2:37 PM, [email protected] <[email protected]> > > > wrote: > > > > > > > > > Hi guys, > > > > > > > > > > I'm new to slider and try to convert some application into yarn > app. > > I > > > > > would like to ask is there a way to specify only a subset of nodes > in > > > the > > > > > cluster to run my app and can slider guarantee every container(of > > that > > > > > application) run on different nodes? > > > > > > > > > > Thank you very much! > > > > > > > > > > Best, > > > > > Siyuan > > > > > > > > > > > > > > > > > > > > > -- > > > > Hortonworks Certified Hadoop 2 Java Developer > > > > > > > > Solutions Engineer, Hortonworks > > > > Phone: Office (734)-288-3930 Mobile (734)-301-9812 > > > > Email: [email protected] > > > > > > > > Apache Hadoop YARN: Moving beyond MapReduce and Batch Processing with > > > > Apache Hadoop 2 > > > > < > > > > > > > > > > http://www.amazon.com/Apache-Hadoop-YARN-Processing-Addison-Wesley/dp/0321934504 > > > > > > > > > > > > > -- > > > > CONFIDENTIALITY NOTICE > > > > NOTICE: This message is intended for the use of the individual or > > entity > > > to > > > > which it is addressed and may contain information that is > confidential, > > > > privileged and exempt from disclosure under applicable law. If the > > reader > > > > of this message is not the intended recipient, you are hereby > notified > > > that > > > > any printing, copying, dissemination, distribution, disclosure or > > > > forwarding of this communication is strictly prohibited. If you have > > > > received this communication in error, please contact the sender > > > immediately > > > > and delete it from your system. Thank You. > > > > > > > > > > -- > > > CONFIDENTIALITY NOTICE > > > NOTICE: This message is intended for the use of the individual or > entity > > to > > > which it is addressed and may contain information that is confidential, > > > privileged and exempt from disclosure under applicable law. If the > reader > > > of this message is not the intended recipient, you are hereby notified > > that > > > any printing, copying, dissemination, distribution, disclosure or > > > forwarding of this communication is strictly prohibited. If you have > > > received this communication in error, please contact the sender > > immediately > > > and delete it from your system. Thank You. > > > > > > > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. >
