Thanks Sumit! Best, Siyuan
On Mon, Aug 4, 2014 at 2:16 PM, Sumit Mohanty <[email protected]> wrote: > Its not so much as you cannot run but multiple instance on same host do not > have much advantage unless its a dev/test cluster and being used from a > functional testing standpoint. This is what we also do for functional > testing where multiple slave nodes are hosted on a single host. > > So if you plan to have one region server instance per host then it makes > sense to have the region server instance take as much of the available > memory as it can - hence we can make sure that the container can consume > most (not just > 50%) of the available memory. > > One anti-affinity is available or Slider adds such a feature itself, you > need not do use the work-around. > > > On Mon, Aug 4, 2014 at 2:04 PM, [email protected] <[email protected]> wrote: > > > Thanks Sumit, Good to know this! > > I'm curious how does slider do to launch hbase on yarn. What I understand > > is you can not run region server on the same node. > > So if you want to run hbase on yarn by slider, you have to specify more > > than half of the available resource per host? > > > > Best, > > Siyuan > > > > > > > > On Mon, Aug 4, 2014 at 1:56 PM, Sumit Mohanty <[email protected]> > > wrote: > > > > > Thats another feature called anti-affinity, from YARN, to enable > > container > > > allocation on different nodes for same container type. This feature is > > not > > > yet available and in the mean time you can enforce it by asking more > than > > > half of available resource (e.g. memory) per host. > > > > > > Depending on the timeline of the availability of anti-affinity feature > > from > > > YARN, Slider can also add support for such a feature but the desirable > > path > > > is to get this through YARN. > > > > > > > > > On Mon, Aug 4, 2014 at 1:48 PM, [email protected] <[email protected]> > > wrote: > > > > > > > Thanks guys, so my next question is how can you guarantee containers > > are > > > > allocated on different nodes? > > > > > > > > > > > > Best, > > > > Siyuan > > > > > > > > > > > > On Mon, Aug 4, 2014 at 1:02 PM, Sumit Mohanty < > > [email protected]> > > > > wrote: > > > > > > > > > +1 to Joe's explanation. > > > > > > > > > > Slider plans to use the "label" support enabled through YARN-796 > and > > > > allow > > > > > creation of app instances against a label. This way you can ensure > > that > > > > the > > > > > app instance has containers allocated only on a subset of the > nodes. > > > > > > > > > > > > > > > On Mon, Aug 4, 2014 at 12:15 PM, Joseph Niemiec < > > > > [email protected]> > > > > > wrote: > > > > > > > > > > > I'll let someone else chime in here but my assumption is this > will > > > > > require > > > > > > YARN-796 and then have Slider expose the config somehow which > from > > my > > > > > > exploration has yet to be done. > > > > > > > > > > > > Outside of Slider if you wrote your own AM you can control this > > today > > > > in > > > > > > your resourcerequest to the RM. > > > > > > > > > > > > https://issues.apache.org/jira/browse/YARN-796 > > > > > > > > > > > > > > > > > > On Mon, Aug 4, 2014 at 2:37 PM, [email protected] < > [email protected] > > > > > > > > wrote: > > > > > > > > > > > > > Hi guys, > > > > > > > > > > > > > > I'm new to slider and try to convert some application into yarn > > > app. > > > > I > > > > > > > would like to ask is there a way to specify only a subset of > > nodes > > > in > > > > > the > > > > > > > cluster to run my app and can slider guarantee every > container(of > > > > that > > > > > > > application) run on different nodes? > > > > > > > > > > > > > > Thank you very much! > > > > > > > > > > > > > > Best, > > > > > > > Siyuan > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Hortonworks Certified Hadoop 2 Java Developer > > > > > > > > > > > > Solutions Engineer, Hortonworks > > > > > > Phone: Office (734)-288-3930 Mobile (734)-301-9812 > > > > > > Email: [email protected] > > > > > > > > > > > > Apache Hadoop YARN: Moving beyond MapReduce and Batch Processing > > with > > > > > > Apache Hadoop 2 > > > > > > < > > > > > > > > > > > > > > > > > > > > > http://www.amazon.com/Apache-Hadoop-YARN-Processing-Addison-Wesley/dp/0321934504 > > > > > > > > > > > > > > > > > > > -- > > > > > > CONFIDENTIALITY NOTICE > > > > > > NOTICE: This message is intended for the use of the individual or > > > > entity > > > > > to > > > > > > which it is addressed and may contain information that is > > > confidential, > > > > > > privileged and exempt from disclosure under applicable law. If > the > > > > reader > > > > > > of this message is not the intended recipient, you are hereby > > > notified > > > > > that > > > > > > any printing, copying, dissemination, distribution, disclosure or > > > > > > forwarding of this communication is strictly prohibited. If you > > have > > > > > > received this communication in error, please contact the sender > > > > > immediately > > > > > > and delete it from your system. Thank You. > > > > > > > > > > > > > > > > -- > > > > > CONFIDENTIALITY NOTICE > > > > > NOTICE: This message is intended for the use of the individual or > > > entity > > > > to > > > > > which it is addressed and may contain information that is > > confidential, > > > > > privileged and exempt from disclosure under applicable law. If the > > > reader > > > > > of this message is not the intended recipient, you are hereby > > notified > > > > that > > > > > any printing, copying, dissemination, distribution, disclosure or > > > > > forwarding of this communication is strictly prohibited. If you > have > > > > > received this communication in error, please contact the sender > > > > immediately > > > > > and delete it from your system. Thank You. > > > > > > > > > > > > > > > -- > > > CONFIDENTIALITY NOTICE > > > NOTICE: This message is intended for the use of the individual or > entity > > to > > > which it is addressed and may contain information that is confidential, > > > privileged and exempt from disclosure under applicable law. If the > reader > > > of this message is not the intended recipient, you are hereby notified > > that > > > any printing, copying, dissemination, distribution, disclosure or > > > forwarding of this communication is strictly prohibited. If you have > > > received this communication in error, please contact the sender > > immediately > > > and delete it from your system. Thank You. > > > > > > > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. >
