[
https://issues.apache.org/jira/browse/MAPREDUCE-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alejandro Abdelnur updated MAPREDUCE-3543:
------------------------------------------
Attachment: MAPREDUCE-3543v1.patch
MAPREDUCE-3543v1.sh
*This is work in progress*
Script and patch to move Gridmix stuff to hadoop-tools.
Run first the script then apply the patch (works both in GIT and SVN).
The rumen stuff is moved into gridmix module.
There are dependencies in MR1 JobTracker and JobHistory and compilation fails
because of that:
{code}
[INFO] Compiling 139 source files to
/Users/tucu/src/apache/hadoop/git/hadoop-tools/hadoop-gridmix/target/classes
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR]
/Users/tucu/src/apache/hadoop/git/hadoop-tools/hadoop-gridmix/src/main/java/org/apache/hadoop/mapred/gridmix/ClusterSummarizer.java:[26,31]
cannot find symbol
symbol : class JobTracker
location: package org.apache.hadoop.mapred
[ERROR]
/Users/tucu/src/apache/hadoop/git/hadoop-tools/hadoop-gridmix/src/main/java/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java:[23,45]
cannot find symbol
symbol : class JobHistory
location: package org.apache.hadoop.mapreduce.jobhistory
[ERROR]
/Users/tucu/src/apache/hadoop/git/hadoop-tools/hadoop-gridmix/src/main/java/org/apache/hadoop/tools/rumen/JobHistoryUtils.java:[30,45]
cannot find symbol
symbol : class JobHistory
location: package org.apache.hadoop.mapreduce.jobhistory
[ERROR]
/Users/tucu/src/apache/hadoop/git/hadoop-tools/hadoop-gridmix/src/main/java/org/apache/hadoop/tools/rumen/CurrentJHParser.java:[26,45]
cannot find symbol
symbol : class JobHistory
location: package org.apache.hadoop.mapreduce.jobhistory
[ERROR]
/Users/tucu/src/apache/hadoop/git/hadoop-tools/hadoop-gridmix/src/main/java/org/apache/hadoop/tools/rumen/TraceBuilder.java:[43,45]
cannot find symbol
symbol : class JobHistory
location: package org.apache.hadoop.mapreduce.jobhistory
[ERROR]
/Users/tucu/src/apache/hadoop/git/hadoop-tools/hadoop-gridmix/src/main/java/org/apache/hadoop/tools/rumen/Pre21JobHistoryConstants.java:[67,35]
cannot find symbol
symbol : variable JobHistory
location: class org.apache.hadoop.tools.rumen.Pre21JobHistoryConstants
[ERROR]
/Users/tucu/src/apache/hadoop/git/hadoop-tools/hadoop-gridmix/src/main/java/org/apache/hadoop/tools/rumen/JobHistoryUtils.java:[138,33]
cannot find symbol
symbol : variable JobHistory
location: class org.apache.hadoop.tools.rumen.JobHistoryUtils
[INFO] 7 errors
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
{code}
I assume the testcases will requires some minor tweaks like the streaming and
archives testcases. But cannot reach there as things don't compile.
I'm sure about the tests under contrib/gridmix/src/test/system, thus I didn't
move those yet.
> Mavenize Gridmix.
> -----------------
>
> Key: MAPREDUCE-3543
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3543
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Mahadev konar
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3543v1.patch, MAPREDUCE-3543v1.sh
>
>
> Gridmix codebase still resides in src/contrib and needs to be compiled via
> ant. We should move it to maven.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
