I am still not able to compile scheduler code in Hadoop-0.21
I tried to use eclipse and svn checkout.
I have the trunk, right click on the fairshare build.xml file and run.
However, I got a bunch of errors like:
[ivy:cachepath] :: loading settings :: file =
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/ivy/ivysettings.xml
compile:
[echo] contrib: fairscheduler
[javac] Compiling 19 source files to
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/build/contrib/fairscheduler/classes
[javac]
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java:21:
package org.apache.hadoop.mapreduce does not exist
[javac] import org.apache.hadoop.mapreduce.TaskType;
[javac] ^
[javac]
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/LoadManager.java:25:
package org.apache.hadoop.mapreduce does not exist
[javac] import org.apache.hadoop.mapreduce.TaskType;
[javac] ^
[javac]
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java:51:
cannot find symbol
[javac] symbol : class TaskTrackerStatus
[javac] location: class org.apache.hadoop.mapred.CapBasedLoadManager
[javac] public boolean canAssignMap(TaskTrackerStatus tracker,
[javac] ^
[javac]
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java:58:
cannot find symbol
[javac] symbol : class TaskTrackerStatus
[javac] location: class org.apache.hadoop.mapred.CapBasedLoadManager
[javac] public boolean canAssignReduce(TaskTrackerStatus tracker,
[javac] ^
[javac]
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java:65:
cannot find symbol
[javac] symbol : class TaskTrackerStatus
[javac] location: class org.apache.hadoop.mapred.CapBasedLoadManager
[javac] public boolean canLaunchTask(TaskTrackerStatus tracker,
[javac] ^
[javac]
/home/rgrandl/School/Project/hadoop_compile/hadoop_trunk1/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java:66:
cannot find symbol
[javac] symbol : class JobInProgress
[javac] location: class org.apache.hadoop.mapred.CapBasedLoadManager
[javac] JobInProgress job, TaskType type) {
[javac] ^
as it seems I don't have package org.apache.hadoop.mapreduce.
Could somebody point me out how to compile the code ?
I am not such an expert on using eclipse but also don't know how to try
other solution.
Thank you very much for any help,
Robert
On 01/14/2011 03:47 PM, Robert Grandl wrote:
Thanks for your reply.
However, I don't know what is Maven repository.
Could you be more detailed on what exactly I should put where ?
I would like an easy way to recompile schedulers source code.
Many thanks,
Robert
On 01/14/2011 03:42 PM, Harsh J wrote:
Hi,
On Fri, Jan 14, 2011 at 7:48 PM, Robert Grandl<[email protected]> wrote:
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: org.apache.hadoop#hadoop-common;0.21.0: not found
[ivy:resolve] :: org.apache.hadoop#hadoop-hdfs;0.21.0: not found
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
0.21.0 jars aren't in Maven yet. I think they'll be in after 0.21.1.
For now, add those jars to your local maven repository manually to get
the build working.
Or you could use trunk, if it is purely for development purposes.