Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.
The "DevelopingOnTrunkAfter279Merge" page has been changed by VinodKumarVavilapalli: http://wiki.apache.org/hadoop/DevelopingOnTrunkAfter279Merge?action=diff&rev1=2&rev2=3 Comment: Minor edits - MR-279 branch is merged into mapreduce trunk and this changes things a + MR-279 branch is merged into mapreduce trunk and this changes things a bit for developing on mapreduce. - bit for developing on mapreduce. + You can get all the help that is needed from the INSTALL file at http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-mapreduce/INSTALL. Reproducing some of those contents here for the short-term lookup. - You can get all the help that is needed from the INSTALL file at - http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-mapreduce/INSTALL. - Reproducing some of those contents here for the short-term lookup. - ------------------------------------ + ---------- Checking out source code - ------------------------------------ + + ---------- svn checkout http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-mapreduce - -------------------------- + ---------- Directory structure - -------------------------- + ---------- trunk/ + - - hadoop-mapreduce ( was mapreduce before) + . - hadoop-mapreduce ( was mapreduce before) trunk/hadoop-mapreduce - Classic code. JT/TT reside here + - - build.xml + . - build.xml - src - - src trunk/hadoop-mapreduce/ - New code related to yarn reside here. + + . - assembly - pom.xml - hadoop-mr-client - hadoop-yarn - Yarn APIs, libraries, and server code - - assembly - - pom.xml - - hadoop-mr-client - - hadoop-yarn - Yarn APIs, libraries, and server code - -- hadoop-yarn-api + . -- hadoop-yarn-api - -- hadoop-yarn-common + . -- hadoop-yarn-common -- hadoop-yarn-server - Server code, ResourceManager, NodeManager, + server libraries and tests. - --- hadoop-yarn-server-common - --- hadoop-yarn-server-nodemanager - --- hadoop-yarn-server-resourcemanager - --- hadoop-yarn-server-tests - - hadoop-mr-client - MapReduce server and client code - -- hadoop-mapreduce-client-app - -- hadoop-mapreduce-client-core - -- hadoop-mapreduce-client-jobclient - -- hadoop-mapreduce-client-common - -- hadoop-mapreduce-client-hs - -- hadoop-mapreduce-client-shuffle + . --- hadoop-yarn-server-common + . --- hadoop-yarn-server-nodemanager + . --- hadoop-yarn-server-resourcemanager + . --- hadoop-yarn-server-tests + + . - hadoop-mr-client - MapReduce server and client code + . -- hadoop-mapreduce-client-app + . -- hadoop-mapreduce-client-core + . -- hadoop-mapreduce-client-jobclient + . -- hadoop-mapreduce-client-common + . -- hadoop-mapreduce-client-hs + . -- hadoop-mapreduce-client-shuffle + - ----------- + ---------- Building + - ----------- + ---------- Building yarn code and install into the local maven cache. + - - mvn clean install + . - mvn clean install - In case you want to skip the tests run: mvn clean install -DskipTests Building classic code once yarn code is built. + - - ant veryclean jar jar-test -Dresolvers=internal + . - ant veryclean jar jar-test -Dresolvers=internal ---------- Eclipse + - ----------- + ---------- - 1) For hacking on the new yarn+MR code in eclipse, you should run + . 1) For hacking on the new yarn+MR code in eclipse, you should run + - "mvn eclipse:eclipse" and then import the checked out source root as a + "mvn eclipse:eclipse" and then import the checked out source root as a maven project. - maven project. + - 2) For developing on classic JT/TT code, running "ant eclipse" and + . 2) For developing on classic JT/TT code, running "ant eclipse" and + importing as java project should continue to work. - Hope that helps. If you run into issues, please send an email or + Hope that helps. If you run into issues, please send an email or create a JIRA issue. - create a JIRA issue.
