Re: Re: tez compile
Hi, Now, Set the repo for https://repository.cloudera.com/artifactory/cloudera-repos , and version for 2.3.0-cdh5.1.0. then, run mvn package -P\!hadoop24 -P\!hadoop26 -DskipTests=true but, compile to tez-mapreduce module error! error information: /workspace/tez/apache-tez-0.7.0/tez-mapreduce/src/main/java/org/apache/tez/mapreduce/hadoop/mapreduce/JobContextImpl.java:[57,8] org.apache.tez.mapreduce.hadoop.mapreduce.JobContextImpl is not abstract and does not override abstract method userClassesTakesPrecedence() in org.apache.hadoop.mapreduce.JobContext Is it caused by version does not match ? thanks for your help! hanked...@emar.com From: Hitesh Shah Date: 2015-08-20 23:00 To: user Subject: Re: tez compile For the most part, yes - the compile should likely work given that the CDH release is based off Apache Hadoop 2.3. To build Tez, you will need to add the CDH maven repo to the pom.xml at the top-level. Modify hadoop.version to 2.3.0-cdh5.1.0” or something similar based on your requirements. And then run mvn package -P\!hadoop24 -P\!hadoop26 so that you disable all the features/modules that need a minimum of hadoop-2.4 and hadoop-2.6 respectively. Let us know if you run into any problems. thanks — Hitesh On Aug 20, 2015, at 3:29 AM, hanked...@emar.com wrote: Hi~ all Can use cdh-hadoop 2.3 to compile tez 7.0 ? Wirtten in the building.txt is support, lowest hadoop version 2.2 ? Now, my cluster with CDH 5.1 version, can use tez ? Thanks ! hanked...@emar.com
Re: tez compile
Seems this is due to CHD's API incompatibility CLOUDERA-BUILD. Deprecate user-classes-takes-precedence APIs, because they appear in CDH and not upstream commit 7bd71f3d4c8c9471bfb4bdc0baa004d78647ff76 Author: Harsh J ha...@cloudera.com Date: Sat Apr 20 08:19:28 2013 +0530 http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.2.0-cdh5.0.0-beta-2.CHANGES.txt Best Regard, Jeff Zhang From: hanked...@emar.commailto:hanked...@emar.com hanked...@emar.commailto:hanked...@emar.com Reply-To: user user@tez.apache.orgmailto:user@tez.apache.org Date: Friday, August 21, 2015 at 2:56 PM To: user user@tez.apache.orgmailto:user@tez.apache.org Subject: Re: Re: tez compile Hi, Now, Set the repo for https://repository.cloudera.com/artifactory/cloudera-repos , and version for 2.3.0-cdh5.1.0. then, run mvn package -P\!hadoop24 -P\!hadoop26 -DskipTests=true but, compile to tez-mapreduce module error! error information: /workspace/tez/apache-tez-0.7.0/tez-mapreduce/src/main/java/org/apache/tez/mapreduce/hadoop/mapreduce/JobContextImpl.java:[57,8] org.apache.tez.mapreduce.hadoop.mapreduce.JobContextImpl is not abstract and does not override abstract method userClassesTakesPrecedence() in org.apache.hadoop.mapreduce.JobContext Is it caused by version does not match ? thanks for your help! hanked...@emar.commailto:hanked...@emar.com From: Hitesh Shahmailto:hit...@apache.org Date: 2015-08-20 23:00 To: usermailto:user@tez.apache.org Subject: Re: tez compile For the most part, yes - the compile should likely work given that the CDH release is based off Apache Hadoop 2.3. To build Tez, you will need to add the CDH maven repo to the pom.xml at the top-level. Modify hadoop.version to 2.3.0-cdh5.1.0 or something similar based on your requirements. And then run mvn package -P\!hadoop24 -P\!hadoop26 so that you disable all the features/modules that need a minimum of hadoop-2.4 and hadoop-2.6 respectively. Let us know if you run into any problems. thanks - Hitesh On Aug 20, 2015, at 3:29 AM, hanked...@emar.commailto:hanked...@emar.com wrote: Hi~ all Can use cdh-hadoop 2.3 to compile tez 7.0 ? Wirtten in the building.txt is support, lowest hadoop version 2.2 ? Now, my cluster with CDH 5.1 version, can use tez ? Thanks ! hanked...@emar.commailto:hanked...@emar.com
tez compile
Hi~ all Can use cdh-hadoop 2.3 to compile tez 7.0 ? Wirtten in the building.txt is support, lowest hadoop version 2.2 ? Now, my cluster with CDH 5.1 version, can use tez ? Thanks ! hanked...@emar.com
Re: tez compile
For the most part, yes - the compile should likely work given that the CDH release is based off Apache Hadoop 2.3. To build Tez, you will need to add the CDH maven repo to the pom.xml at the top-level. Modify hadoop.version to 2.3.0-cdh5.1.0” or something similar based on your requirements. And then run mvn package -P\!hadoop24 -P\!hadoop26 so that you disable all the features/modules that need a minimum of hadoop-2.4 and hadoop-2.6 respectively. Let us know if you run into any problems. thanks — Hitesh On Aug 20, 2015, at 3:29 AM, hanked...@emar.com wrote: Hi~ all Can use cdh-hadoop 2.3 to compile tez 7.0 ? Wirtten in the building.txt is support, lowest hadoop version 2.2 ? Now, my cluster with CDH 5.1 version, can use tez ? Thanks ! hanked...@emar.com
