Thanks Arun, that's what I'm looking for. I hear you are working on a dev guide. I'm open to working with an early copy and providing feedback. Thanks.
----- Original Message ----- From: Arun C Murthy <[email protected]> To: [email protected] <[email protected]> Cc: Sharad Agarwal <[email protected]> Sent: Sun Jul 03 14:16:12 2011 Subject: Re: trouble building MR-279 branch Jim, On Jul 1, 2011, at 2:23 PM, Jim Falgout wrote: > On another note: do you know of any design docs for building an application > executor using the new resource manager? Just wondering how to get started? > Jim, we are in the process of doing a better job with docs etc. Sharad just gave a talk on writing a new AM at the Hadoop Core Contributor Meeting on 7/1... Sharad - could you upload your slides? thanks, Arun > -----Original Message----- > From: Anupam Seth [mailto:[email protected]] > Sent: Friday, July 01, 2011 2:10 PM > To: [email protected] > Subject: RE: trouble building MR-279 branch > > Hi Jim, > > Following are some notes (thanks to Jeff Naisbitt & Bobby Evans). > > Build YARN > ========== > These are in addition to what you would normally do. > > Install protobuf > use Protobuf 2.4.0a (Download from > http://code.google.com/p/protobuf/downloads/list) I actually used 2.4.1 and > it worked > > install the protoc executable (configure, make, make install) > install the maven artifact (cd java; mvn install) > > Installing protoc requires gcc 4.1.x or higher (RHEL5). > > If the make step fails with (Valid until a fix is released for protobuf > 2.4.0a) ./google/protobuf/descriptor.h:1152: error: > `google::protobuf::internal::Mutex*google::protobuf::DescriptorPool::mutex_' > is private Replace descriptor.cc with > http://protobuf.googlecode.com/svn-history/r380/trunk/src/google/protobuf/descriptor.cc > > Setup environment > > export MAVEN_OPTS=-Xmx512m > export LD_LIBRARY_PATH=/usr/local/lib > > Checkout the MR-279 branch > svn checkout http://svn.apache.org/repos/asf/hadoop/common/branches/MR-279 > > Build common > > cd MR-279/common > ant veryclean mvn-install tar > > Build hdfs > > cd ../hdfs > ant veryclean mvn-install -Dresolvers=internal tar > > Build yarn > > cd ../mapreduce > mvn clean install assembly:assembly > # If tests are failing, add this option to skip them: > -Dmaven.test.skip.exec=true # NOTE: in order to build on a Mac, you must also > include the <code>-P-cbuild</code> option # (e.g. <code>mvn clean install > assembly:assembly -P-cbuild -Dmaven.test.skip.exec=true</code>) > ant veryclean jar jar-test tar -Dresolvers=internal > > -----Original Message----- > From: Jim Falgout [mailto:[email protected]] > Sent: Friday, July 01, 2011 2:00 PM > To: [email protected] > Subject: trouble building MR-279 branch > > Hi, > > I've checked out the MR-279 branch and am having trouble getting it to build. > Any docs/blogs/notes around that may give some hints? > > The build is unable to resolve the yarn-server even though I ran a > "mvn-install" in the yarn source area to install it in the local repository. > > Thanks, > Jim. > >
