David Most of the time you need to run same command on all nodes. "pdsh" would be a good tool to use.
1. You need to have puppet agent installed on every node. yum -y install puppet will do the trick, or you need to download repo, or use bigtop/bigtop_toolchain/bin/puppetize.sh directly. There's no deploy effort other than just install the package. 2. Masterless means each puppet agent takes commands and runs independently. We DONT use puppet master, which is a centralized master daemon to dispatch works to all the registered puppet agent. 3. Next, you need to copy bigtop puppet recipes and bigtop hiera configuration to all nodes, or at least make them available for all nodes via nfs. 4. Finally, execute the puppet apply command on all nodes and the puppet recipes will automatically figure out it's role. There no need to deploy head node first and then slaves. Ask if you still have questions. Thanks Evans 2016年3月15日 下午4:10於 "David Starina" <[email protected]>寫道： > Hi guys, > > me again. I haven't set up Puppet before, can you just point me in the > right direction? I know this is not a Puppet mailing list, but I bet you > have some tips for me :-) > > So what do I need to do? Install Puppet on every node? What does it mean > that the mode of Puppet is "*masterless"* - do I just have to do a basic > installation of Puppet and not care much about setting it up, and then > deploy bigtop on every node separately? And when setting the Hadoop head > node - does that mean that I need to deploy Bigtop on this node first, and > Bigtop will know this is the master node by the url or IP I provide to it? > And then deploy Bigtop via Puppet on all the other nodes and they will > connect to the head node (which is the NameNode, I suppose?). > > I can do this via trial and error, but if you guys can help me reduce the > "error" part, that will be great :) Sorry for such beginner questions, I > haven't used Puppet before ... The reason I'm asking is, I got access to a > "physical" (actually virtual, but it's the same) environment for a limited > amount of time (two weeks), and I need to start testing on it asap - and > since my day job takes a lot of my time, if I wanted to do this without > help it could take me two weeks just to set up the environment - but I need > to install it, which is not the central part of my project, and then run > some ML algorithms on a text corpus, which will be the main part of the > project ... > > --David > > On Thu, Mar 10, 2016 at 11:28 AM, David Starina <[email protected]> > wrote: > >> Thanks for the info! >> >> --David >> >> On Tue, Mar 8, 2016 at 7:15 PM, Jay Vyas <[email protected]> >> wrote: >> >>> I think there is enough info on youtube that you can cobble together a >>> syllabus if you need structured learning. >>> >>> See cos/Romans Bigtop talks which are on YouTube and then my Bigtop >>> internals hackathon video. That gives you both the high and low level >>> details to do whatever you want. >>> >>> > On Mar 8, 2016, at 1:11 PM, Konstantin Boudnik <[email protected]> wrote: >>> > >>> > We also had this discussion to start producing "The Big Book of Apache >>> > Bigtop" like HBase does, but never got into the materialization part >>> of that >>> > project. >>> > >>> > Cos >>> > >>> >> On Tue, Mar 08, 2016 at 11:44PM, Evans Ye wrote: >>> >> Hi David, >>> >> >>> >> If you just want to take Bigtop binaries to deploy a cluster, you can >>> refer >>> >> to our puppet management recipes: >>> >> https://github.com/apache/bigtop/tree/master/bigtop-deploy/puppet >>> >> >>> >> BTW bigtop provisioner is the best source to reference for how bigtop >>> >> provision a cluster: >>> >> >>> https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+Provisioner+User+Guide >>> >> >>> >> Please ask us if you find anything confusing. >>> >> >>> >> >>> >> Evans >>> >> >>> >> >>> >> >>> >> 2016-03-08 0:48 GMT+08:00 David Starina <[email protected]>: >>> >> >>> >>> Hi, >>> >>> >>> >>> Is there some version of Bigtop User Guide available? I know it used >>> to be >>> >>> on the be on http://bigtop.apache.org/ under the "User Guide" link, >>> but >>> >>> there's nothing there anymore ... >>> >>> >>> >>> I need some guide on how to install Bigtop on a physical cluster ... >>> It >>> >>> was easy to create a virtual cluster on my machine using Vagrant, >>> but I >>> >>> cannot find a manual to install on a physical cluster ... >>> >>> >>> >>> Cheers, >>> >>> David >>> >>> >>> >> >> >
