FYI, The following diff solves the problem. But I think this is a bug.
diff --git a/pom.xml b/pom.xml
index 122c05c..91ee1e5 100644
--- a/pom.xml
+++ b/pom.xml
@@ -424,6 +424,11 @@
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-auth</artifactId>
+ <version>${hadoop.version}</version>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-yarn-common</artifactId>
<version>${hadoop.version}</version>
<exclusions>
@@ -725,7 +730,7 @@
<plugin>
<groupId>com.github.eirslett</groupId>
<artifactId>frontend-maven-plugin</artifactId>
- <version>0.0.16</version>
+ <version>0.0.23</version>
</plugin>
<plugin>
<artifactId>exec-maven-plugin</artifactId>
diff --git a/tez-runtime-library/pom.xml b/tez-runtime-library/pom.xml
index 9d0fac0..fb27fb9 100644
--- a/tez-runtime-library/pom.xml
+++ b/tez-runtime-library/pom.xml
@@ -51,6 +51,10 @@
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-auth</artifactId>
+ </dependency>
+ <dependency>
+ <groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
</dependency>
<dependency>
On Wed, Jul 15, 2015 at 3:14 PM, Rajat Jain <[email protected]> wrote:
> The build compiles fine on EC2 instances, but fail on mac. This output is
> after I cleared my ~/.m2/repository folder.
>
> [INFO] -------------------------------------------------------------
> [INFO] -------------------------------------------------------------
> [ERROR] COMPILATION ERROR :
> [INFO] -------------------------------------------------------------
> [ERROR]
> /Users/rjain/workspace/tez/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/HttpConnection.java:[402,51]
> cannot access
> org.apache.hadoop.security.authentication.client.ConnectionConfigurator
> class file for
> org.apache.hadoop.security.authentication.client.ConnectionConfigurator not
> found
> [INFO] 1 error
> [INFO] -------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] tez ................................................ SUCCESS [
> 46.070 s]
> [INFO] tez-api ............................................ SUCCESS [01:24
> min]
> [INFO] tez-common ......................................... SUCCESS [
> 0.434 s]
> [INFO] tez-runtime-internals .............................. SUCCESS [
> 0.506 s]
> [INFO] tez-runtime-library ................................ FAILURE [
> 0.944 s]
> [INFO] tez-mapreduce ...................................... SKIPPED
> [INFO] tez-examples ....................................... SKIPPED
> [INFO] tez-dag ............................................ SKIPPED
> [INFO] tez-tests .......................................... SKIPPED
> [INFO] tez-ui ............................................. SKIPPED
> [INFO] tez-plugins ........................................ SKIPPED
> [INFO] tez-yarn-timeline-history .......................... SKIPPED
> [INFO] tez-yarn-timeline-history-with-acls ................ SKIPPED
> [INFO] tez-mbeans-resource-calculator ..................... SKIPPED
> [INFO] tez-tools .......................................... SKIPPED
> [INFO] tez-dist ........................................... SKIPPED
> [INFO] Tez ................................................ SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 02:12 min
> [INFO] Finished at: 2015-07-15T15:12:55-07:00
> [INFO] Final Memory: 37M/982M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:3.1:compile
> (default-compile) on project tez-runtime-library: Compilation failure
> [ERROR]
> /Users/rjain/workspace/tez/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/HttpConnection.java:[402,51]
> cannot access
> org.apache.hadoop.security.authentication.client.ConnectionConfigurator
> [ERROR] class file for
> org.apache.hadoop.security.authentication.client.ConnectionConfigurator not
> found
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :tez-runtime-library
> rjain@MAC: /Users/rjain/workspace/tez git:(ded6141) ✗
> ➜ mvn --version
> Apache Maven 3.2.2 (45f7c06d68e745d05611f7fd14efb6594181933e;
> 2014-06-17T06:51:42-07:00)
> Maven home: /Users/rjain/Downloads/apache-maven-3.2.2
> Java version: 1.7.0_71, vendor: Oracle Corporation
> Java home:
> /Library/Java/JavaVirtualMachines/jdk1.7.0_71.jdk/Contents/Home/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "mac os x", version: "10.11", arch: "x86_64", family: "mac"
>
> On Wed, Jul 15, 2015 at 2:56 PM, Rajat Jain <[email protected]> wrote:
>
>> Thanks Jianfeng and Prakash. I was indeed using maven 3.3. Updating the
>> version to 0.0.23 solved the problem.
>>
>> On Wed, Jul 15, 2015 at 2:52 PM, Jianfeng (Jeff) Zhang <
>> [email protected]> wrote:
>>
>>> Are you using maven 3.3.1 ? Please try maven 3.2.5
>>>
>>>
>>> http://mail-archives.apache.org/mod_mbox/maven-dev/201503.mbox/%[email protected]%3E
>>>
>>>
>>>
>>> Best Regard,
>>> Jeff Zhang
>>>
>>>
>>> From: Rajat Jain <[email protected]>
>>> Reply-To: Rajat Jain <[email protected]>
>>> Date: Wednesday, July 15, 2015 at 2:45 PM
>>> To: Jianfeng Zhang <[email protected]>
>>> Cc: "[email protected]" <[email protected]>
>>> Subject: Re: Error compiling tez (0.6.1 and 0.7.0) from scratch
>>>
>>> Yeah, these errors are from mvn clean install. Sorry I didn't
>>> mention it in my first email.
>>>
>>> On another machine, I get this error:
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm
>>> (install node and npm) on project tez-ui: Execution install node and npm of
>>> goal com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm
>>> failed: A required class was missing while executing
>>> com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm:
>>> org/slf4j/helpers/MarkerIgnoringBase
>>> [ERROR] -----------------------------------------------------
>>> [ERROR] realm =
>>> plugin>com.github.eirslett:frontend-maven-plugin:0.0.16
>>> [ERROR] strategy =
>>> org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy
>>> [ERROR] urls[0] =
>>> file:/home/ec2-user/.m2/repository/com/github/eirslett/frontend-maven-plugin/0.0.16/frontend-maven-plugin-0.0.16.jar
>>> [ERROR] urls[1] =
>>> file:/home/ec2-user/.m2/repository/com/github/eirslett/frontend-plugin-core/0.0.16/frontend-plugin-core-0.0.16.jar
>>> [ERROR] urls[2] =
>>> file:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar
>>> [ERROR] urls[3] =
>>> file:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar
>>> [ERROR] urls[4] =
>>> file:/home/ec2-user/.m2/repository/org/apache/commons/commons-compress/1.5/commons-compress-1.5.jar
>>> [ERROR] urls[5] =
>>> file:/home/ec2-user/.m2/repository/org/tukaani/xz/1.2/xz-1.2.jar
>>> [ERROR] urls[6] =
>>> file:/home/ec2-user/.m2/repository/org/apache/commons/commons-io/1.3.2/commons-io-1.3.2.jar
>>> [ERROR] urls[7] =
>>> file:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpclient/4.3.1/httpclient-4.3.1.jar
>>> [ERROR] urls[8] =
>>> file:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpcore/4.3/httpcore-4.3.jar
>>> [ERROR] urls[9] =
>>> file:/home/ec2-user/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar
>>> [ERROR] urls[10] =
>>> file:/home/ec2-user/.m2/repository/commons-codec/commons-codec/1.6/commons-codec-1.6.jar
>>> [ERROR] urls[11] =
>>> file:/home/ec2-user/.m2/repository/org/codehaus/plexus/plexus-utils/3.0.10/plexus-utils-3.0.10.jar
>>> [ERROR] urls[12] =
>>> file:/home/ec2-user/.m2/repository/javax/enterprise/cdi-api/1.0/cdi-api-1.0.jar
>>> [ERROR] urls[13] =
>>> file:/home/ec2-user/.m2/repository/javax/annotation/jsr250-api/1.0/jsr250-api-1.0.jar
>>> [ERROR] urls[14] =
>>> file:/home/ec2-user/.m2/repository/com/google/guava/guava/10.0.1/guava-10.0.1.jar
>>> [ERROR] urls[15] =
>>> file:/home/ec2-user/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar
>>> [ERROR] urls[16] =
>>> file:/home/ec2-user/.m2/repository/org/sonatype/sisu/sisu-guice/3.1.0/sisu-guice-3.1.0-no_aop.jar
>>> [ERROR] urls[17] =
>>> file:/home/ec2-user/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar
>>> [ERROR] urls[18] =
>>> file:/home/ec2-user/.m2/repository/org/eclipse/sisu/org.eclipse.sisu.inject/0.0.0.M2a/org.eclipse.sisu.inject-0.0.0.M2a.jar
>>> [ERROR] urls[19] =
>>> file:/home/ec2-user/.m2/repository/asm/asm/3.3.1/asm-3.3.1.jar
>>> [ERROR] urls[20] =
>>> file:/home/ec2-user/.m2/repository/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar
>>> [ERROR] urls[21] =
>>> file:/home/ec2-user/.m2/repository/org/apache/maven/plugin-tools/maven-plugin-annotations/3.2/maven-plugin-annotations-3.2.jar
>>> [ERROR] urls[22] =
>>> file:/home/ec2-user/.m2/repository/com/googlecode/slf4j-maven-plugin-log/slf4j-maven-plugin-log/1.0.0/slf4j-maven-plugin-log-1.0.0.jar
>>> [ERROR] Number of foreign imports: 1
>>> [ERROR] import: Entry[import from realm ClassRealm[maven.api, parent:
>>> null]]
>>> [ERROR]
>>> [ERROR] -----------------------------------------------------:
>>> org.slf4j.helpers.MarkerIgnoringBase
>>> [ERROR] -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>>> -e switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions,
>>> please read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginContainerException
>>> [ERROR]
>>> [ERROR] After correcting the problems, you can resume the build with the
>>> command
>>> [ERROR] mvn <goals> -rf :tez-ui
>>>
>>> On Wed, Jul 15, 2015 at 2:35 PM, Jianfeng (Jeff) Zhang <
>>> [email protected]> wrote:
>>>
>>>> Hi Rajat,
>>>>
>>>> Could you run mvn clean first ? Please try mvm clean install
>>>> –DskipTests
>>>>
>>>>
>>>> Best Regard,
>>>> Jeff Zhang
>>>>
>>>>
>>>> From: Rajat Jain <[email protected]>
>>>> Reply-To: "[email protected]" <[email protected]>, Rajat Jain <
>>>> [email protected]>
>>>> Date: Wednesday, July 15, 2015 at 2:26 PM
>>>> To: "[email protected]" <[email protected]>
>>>> Subject: Error compiling tez (0.6.1 and 0.7.0) from scratch
>>>>
>>>> I checked out release tags 0.6.1 and 0.7.0. Issued "mvn install
>>>> -DskipTests". Got the following compilation errors.
>>>>
>>>> [INFO] -------------------------------------------------------------
>>>> [INFO] -------------------------------------------------------------
>>>> [ERROR] COMPILATION ERROR :
>>>> [INFO] -------------------------------------------------------------
>>>> [ERROR]
>>>> /Users/rjain/workspace/tez/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/HttpConnection.java:[402,51]
>>>> cannot access
>>>> org.apache.hadoop.security.authentication.client.ConnectionConfigurator
>>>> class file for
>>>> org.apache.hadoop.security.authentication.client.ConnectionConfigurator not
>>>> found
>>>>
>>>> Any ideas how to fix these?
>>>>
>>>> Thanks,
>>>> Rajat
>>>>
>>>
>>>
>>
>
