Also, for the maven based builds, BUILDING.txt in the root folder of hadoop source does get one started.
Thanks hemanth On Tue, Sep 11, 2012 at 4:28 PM, Harsh J <[email protected]> wrote: > I guess we'll need to clean that guide and divide it in two - For > branch-1 maintenance contributors, and for trunk contributors. > > I had another page that serves a slightly different purpose, but may > help you just the same: > http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk > > On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <[email protected]> > wrote: > > That's good to know - is there a more up to date guide than > http://wiki.apache.org/hadoop/HowToContribute which still makes many > references to ant builds? > > > > > > > > > > -----Original Message----- > > From: Harsh J [mailto:[email protected]] > > Sent: 11 September 2012 11:36 > > To: [email protected] > > Subject: Re: hadoop trunk build failure - yarn, surefire related? > > > > Ah there is no longer a need to run ant anymore on trunk. Ignore the > > leftover files in the base MR project directory - those should be > > cleaned up soon. All of the functional pieces of the build right now > > definitely use Maven. > > > > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <[email protected]> > wrote: > >> Ok - thanks Harsh. > >> > >> Following Steve's earlier advice I tried the mvn install, which worked > fine, then ant test in hadoop-mapreduce-project which failed. I was > mid-email to mapreduce-dev@hadoop, now I'll try mvn test in > hadoop-mapreduce-project and report back. > >> > >> Tony > >> > >> > >> -----Original Message----- > >> From: Harsh J [mailto:[email protected]] > >> Sent: 11 September 2012 11:25 > >> To: [email protected] > >> Subject: Re: hadoop trunk build failure - yarn, surefire related? > >> > >> Tony, > >> > >> What I do is: > >> > >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; > mvn test > >> > >> This seems to work in running without any missing dependencies at least. > >> > >> The user lists are all merged, but the developer lists remain separate > >> as that works better. > >> > >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[email protected]> > wrote: > >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots > I can > >>> see came from repository.apache.org though. > >>> > >>> > >>> > >>> How do I run the MR tests only? > >>> > >>> > >>> > >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all > lists > >>> had merged into one though - did I get the wrong end of the stick? > >>> > >>> > >>> > >>> Tony > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> From: Steve Loughran [mailto:[email protected]] > >>> Sent: 11 September 2012 10:45 > >>> > >>> > >>> To: [email protected] > >>> Subject: Re: hadoop trunk build failure - yarn, surefire related? > >>> > >>> > >>> > >>> It's probably some maven thing -in particular Maven's habit of > grabbing the > >>> online nightly snapshots off apache rather than local, > >>> > >>> > >>> > >>> try mvn clean install -DskipTests -offline > >>> > >>> to force in all the artifacts, then run the MR tests > >>> > >>> > >>> > >>> Tony -why not get on the mapreduce-dev mailing list, as this is the > place to > >>> discuss build and test process. > >>> > >>> On 11 September 2012 09:58, Tony Burton <[email protected]> > wrote: > >>> > >>> Hi, > >>> > >>> > >>> > >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the > >>> codebase as part of following the "How To Contribute" guide at > >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently > >>> failing in hadoop-mapreduce-client-jobclient, the failure message is > below - > >>> something to do with org.hadoop.yarn.client and/or the maven surefire > >>> plugin. Can anyone suggest how to proceed? Thanks! > >>> > >>> > >>> > >>> > >>> > >>> > >>> > >>> [INFO] > >>> > ------------------------------------------------------------------------ > >>> [INFO] Reactor Summary: > >>> [INFO] [snipped SKIPPED test groups] > >>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE > [13.988s] > >>> [INFO] > >>> [INFO] > >>> > ------------------------------------------------------------------------ > >>> [INFO] BUILD FAILURE > >>> [INFO] > >>> > ------------------------------------------------------------------------ > >>> [INFO] Total time: 17.229s > >>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012 > >>> [INFO] Final Memory: 21M/163M > >>> [INFO] > >>> > ------------------------------------------------------------------------ > >>> [ERROR] Failed to execute goal > >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test > (default-test) on > >>> project hadoop-mapreduce-client-jobclient: Execution default-test of > goal > >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: > >>> java.lang.reflect.InvocationTargetException; nested exception is > >>> java.lang.reflect.InvocationTargetException: null: > >>> org/hadoop/yarn/client/YarnClientImpl: > org.hadoop.yarn.client.YarnClientImpl > >>> -> [Help 1] > >>> [ERROR] > >>> [ERROR] To see the full stack trace of the errors, re-run Maven with > the -e > >>> switch. > >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. > >>> [ERROR] > >>> [ERROR] For more information about the errors and possible solutions, > please > >>> read the following articles: > >>> [ERROR] [Help 1] > >>> > http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException > >>> > >>> P Think of the environment: please don't print this email unless you > really > >>> need to. > >>> > >>> Outbound Email has been scanned for viruses and SPAM > >>> > >>> This email and any attachments are confidential, protected by > copyright and > >>> may be legally privileged. If you are not the intended recipient, then > the > >>> dissemination or copying of this email is prohibited. If you have > received > >>> this in error, please notify the sender by replying by email and then > delete > >>> the email completely from your system. Neither Sporting Index nor the > sender > >>> accepts responsibility for any virus, or any other defect which might > affect > >>> any computer or IT system into which the email is received and/or > opened. It > >>> is the responsibility of the recipient to scan the email and no > >>> responsibility is accepted for any loss or damage arising in any way > from > >>> receipt or use of this email. Sporting Index Ltd is a company > registered in > >>> England and Wales with company number 2636842, whose registered office > is at > >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd > is > >>> authorised and regulated by the UK Financial Services Authority (reg. > no. > >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any > >>> financial promotion contained herein has been issued and approved by > >>> Sporting Index Ltd. > >>> > >>> > >>> > >>> Inbound Email has been scanned for viruses and SPAM > >>> > >>> P Think of the environment: please don't print this email unless you > really > >>> need to. > >>> > >>> Outbound Email has been scanned for viruses and SPAM > >>> > >>> This email and any attachments are confidential, protected by > copyright and > >>> may be legally privileged. If you are not the intended recipient, then > the > >>> dissemination or copying of this email is prohibited. If you have > received > >>> this in error, please notify the sender by replying by email and then > delete > >>> the email completely from your system. Neither Sporting Index nor the > sender > >>> accepts responsibility for any virus, or any other defect which might > affect > >>> any computer or IT system into which the email is received and/or > opened. It > >>> is the responsibility of the recipient to scan the email and no > >>> responsibility is accepted for any loss or damage arising in any way > from > >>> receipt or use of this email. Sporting Index Ltd is a company > registered in > >>> England and Wales with company number 2636842, whose registered office > is at > >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd > is > >>> authorised and regulated by the UK Financial Services Authority (reg. > no. > >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any > >>> financial promotion contained herein has been issued and approved by > >>> Sporting Index Ltd. > >> > >> > >> > >> -- > >> Harsh J > >> www.sportingindex.com > >> Inbound Email has been scanned for viruses and SPAM > >> ********************************************************************** > >> This email and any attachments are confidential, protected by copyright > and may be legally privileged. If you are not the intended recipient, then > the dissemination or copying of this email is prohibited. If you have > received this in error, please notify the sender by replying by email and > then delete the email completely from your system. Neither Sporting Index > nor the sender accepts responsibility for any virus, or any other defect > which might affect any computer or IT system into which the email is > received and/or opened. It is the responsibility of the recipient to scan > the email and no responsibility is accepted for any loss or damage arising > in any way from receipt or use of this email. Sporting Index Ltd is a > company registered in England and Wales with company number 2636842, whose > registered office is at Gateway House, Milverton Street, London, SE11 4AP. > Sporting Index Ltd is authorised and regulated by the UK Financial > Services Authority (reg. no. 150404) and Gambling Commission (reg. no. > 000-027343-R-308898-001). Any financial promotion contained herein has > been issued > >> and approved by Sporting Index Ltd. > >> > >> Outbound email has been scanned for viruses and SPAM > > > > > > > > -- > > Harsh J > > www.sportingindex.com > > Inbound Email has been scanned for viruses and SPAM > > ********************************************************************** > > This email and any attachments are confidential, protected by copyright > and may be legally privileged. If you are not the intended recipient, then > the dissemination or copying of this email is prohibited. If you have > received this in error, please notify the sender by replying by email and > then delete the email completely from your system. Neither Sporting Index > nor the sender accepts responsibility for any virus, or any other defect > which might affect any computer or IT system into which the email is > received and/or opened. It is the responsibility of the recipient to scan > the email and no responsibility is accepted for any loss or damage arising > in any way from receipt or use of this email. Sporting Index Ltd is a > company registered in England and Wales with company number 2636842, whose > registered office is at Gateway House, Milverton Street, London, SE11 4AP. > Sporting Index Ltd is authorised and regulated by the UK Financial > Services Authority (reg. no. 150404) and Gambling Commission (reg. no. > 000-027343-R-308898-001). Any financial promotion contained herein has > been issued > > and approved by Sporting Index Ltd. > > > > Outbound email has been scanned for viruses and SPAM > > > > -- > Harsh J >
