Hi folks,
I would like to report the following:
(1) the current master does not compile with hadoop 2.4.0
(mvn -DskipTests clean package -Dhadoop.version=2.4.0 -Phadoop24
-P\!hadoop26)
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
(default-testCompile) on project tez-dag: Compilation failure
[ERROR]
/.../tez/tez-dag/src/test/java/org/apache/tez/dag/app/TestTaskAttemptListenerImplTezDag.java:[161,42]
cannot find symbol
[ERROR] symbol: method
newContainerId(org.apache.hadoop.yarn.api.records.ApplicationAttemptId,long)
[ERROR] location: class org.apache.hadoop.yarn.api.records.ContainerId
(2) I am trying to run the examples of tez 0.6.0 on a cluster with hadoop
2.4.0 and I am getting runtime exceptions:
2015-02-12 11:59:01,353 FATAL [main] app.DAGAppMaster: Error starting
DAGAppMaster
java.lang.AbstractMethodError:
org.apache.hadoop.yarn.api.records.ContainerId.setContainerId(J)V
at
org.apache.hadoop.yarn.api.records.ContainerId.newInstance(ContainerId.java:60)
at
org.apache.hadoop.yarn.util.ConverterUtils.toContainerId(ConverterUtils.java:178)
at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:1821)
The error appears when both using the cluster's hadoop jars (with the
tez-minimal jar) and using the hadoop jars shipped with tez-0.6.0.
I compiled the 0.6.0 release with the -Dhadoop.version=2.4.0 -Phadoop24
-P\!hadoop26 options. I also tried editing the pom file and changed the
hadoop version and removed tez-plugins.
Any advice? Is hadoop 2.4.0 supported in the long term, or would you
recommend to upgrade to 2.6.0?
Best,
Kostas
