Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

2015-07-15 Thread Hitesh Shah
Thanks for digging into the issue, Rajat. 

Mind filing a jira for this and uploading your patch ( without the frontend 
plugin change)? 

thanks
— Hitesh 

On Jul 15, 2015, at 3:53 PM, Rajat Jain rajat...@gmail.com wrote:

 I run this command:
 
 mvn clean install -DskipTests
 
 It automatically picks up Hadoop 2.6.0 from the pom.xml. I also thought 
 hadoop-auth would be implicitly included, but apparently thats not the case.
 
 On Wed, Jul 15, 2015 at 3:51 PM, Jianfeng (Jeff) Zhang 
 jzh...@hortonworks.com wrote:
 
 hadoop-auth should be implicitly included as a dependency of hadoop-common. 
 Do you specify hadoop version when building it ?
 
  
 
 
 
 
 
 Best Regard,
 Jeff Zhang
 
 
 From: Rajat Jain rajat...@gmail.com
 Reply-To: Rajat Jain rajat...@gmail.com
 Date: Wednesday, July 15, 2015 at 3:26 PM
 To: Jianfeng Zhang jzh...@hortonworks.com
 Cc: user@tez.apache.org user@tez.apache.org
 Subject: Re: Error compiling tez (0.6.1 and 0.7.0) from scratch
 
 @@ -424,6 +424,11 @@
/dependency
dependency
  groupIdorg.apache.hadoop/groupId
 +artifactIdhadoop-auth/artifactId
 +version${hadoop.version}/version
 +  /dependency
 +  dependency
 +groupIdorg.apache.hadoop/groupId
  artifactIdhadoop-yarn-common/artifactId
  version${hadoop.version}/version
  exclusions
 



Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

2015-07-15 Thread Jianfeng (Jeff) Zhang

hadoop-auth should be implicitly included as a dependency of hadoop-common. Do 
you specify hadoop version when building it ?







Best Regard,
Jeff Zhang


From: Rajat Jain rajat...@gmail.commailto:rajat...@gmail.com
Reply-To: Rajat Jain rajat...@gmail.commailto:rajat...@gmail.com
Date: Wednesday, July 15, 2015 at 3:26 PM
To: Jianfeng Zhang jzh...@hortonworks.commailto:jzh...@hortonworks.com
Cc: user@tez.apache.orgmailto:user@tez.apache.org 
user@tez.apache.orgmailto:user@tez.apache.org
Subject: Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

@@ -424,6 +424,11 @@
   /dependency
   dependency
 groupIdorg.apache.hadoop/groupId
+artifactIdhadoop-auth/artifactId
+version${hadoop.version}/version
+  /dependency
+  dependency
+groupIdorg.apache.hadoop/groupId
 artifactIdhadoop-yarn-common/artifactId
 version${hadoop.version}/version
 exclusions


Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

2015-07-15 Thread Rajat Jain
Thanks Jianfeng and Prakash. I was indeed using maven 3.3. Updating the
version to 0.0.23 solved the problem.

On Wed, Jul 15, 2015 at 2:52 PM, Jianfeng (Jeff) Zhang 
jzh...@hortonworks.com wrote:

  Are you using maven 3.3.1 ? Please try maven 3.2.5


 http://mail-archives.apache.org/mod_mbox/maven-dev/201503.mbox/%3c7050c8e8-90f6-47b4-b3dc-fd10cb9e4...@takari.io%3E



  Best Regard,
 Jeff Zhang


   From: Rajat Jain rajat...@gmail.com
 Reply-To: Rajat Jain rajat...@gmail.com
 Date: Wednesday, July 15, 2015 at 2:45 PM
 To: Jianfeng Zhang jzh...@hortonworks.com
 Cc: user@tez.apache.org user@tez.apache.org
 Subject: Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

Yeah, these errors are from mvn clean install. Sorry I didn't mention
 it in my first email.

  On another machine, I get this error:

  [INFO]
 
 [ERROR] Failed to execute goal
 com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm
 (install node and npm) on project tez-ui: Execution install node and npm of
 goal com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm
 failed: A required class was missing while executing
 com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm:
 org/slf4j/helpers/MarkerIgnoringBase
 [ERROR] -
 [ERROR] realm =plugincom.github.eirslett:frontend-maven-plugin:0.0.16
 [ERROR] strategy =
 org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy
 [ERROR] urls[0] =
 file:/home/ec2-user/.m2/repository/com/github/eirslett/frontend-maven-plugin/0.0.16/frontend-maven-plugin-0.0.16.jar
 [ERROR] urls[1] =
 file:/home/ec2-user/.m2/repository/com/github/eirslett/frontend-plugin-core/0.0.16/frontend-plugin-core-0.0.16.jar
 [ERROR] urls[2] =
 file:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar
 [ERROR] urls[3] =
 file:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar
 [ERROR] urls[4] =
 file:/home/ec2-user/.m2/repository/org/apache/commons/commons-compress/1.5/commons-compress-1.5.jar
 [ERROR] urls[5] =
 file:/home/ec2-user/.m2/repository/org/tukaani/xz/1.2/xz-1.2.jar
 [ERROR] urls[6] =
 file:/home/ec2-user/.m2/repository/org/apache/commons/commons-io/1.3.2/commons-io-1.3.2.jar
 [ERROR] urls[7] =
 file:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpclient/4.3.1/httpclient-4.3.1.jar
 [ERROR] urls[8] =
 file:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpcore/4.3/httpcore-4.3.jar
 [ERROR] urls[9] =
 file:/home/ec2-user/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar
 [ERROR] urls[10] =
 file:/home/ec2-user/.m2/repository/commons-codec/commons-codec/1.6/commons-codec-1.6.jar
 [ERROR] urls[11] =
 file:/home/ec2-user/.m2/repository/org/codehaus/plexus/plexus-utils/3.0.10/plexus-utils-3.0.10.jar
 [ERROR] urls[12] =
 file:/home/ec2-user/.m2/repository/javax/enterprise/cdi-api/1.0/cdi-api-1.0.jar
 [ERROR] urls[13] =
 file:/home/ec2-user/.m2/repository/javax/annotation/jsr250-api/1.0/jsr250-api-1.0.jar
 [ERROR] urls[14] =
 file:/home/ec2-user/.m2/repository/com/google/guava/guava/10.0.1/guava-10.0.1.jar
 [ERROR] urls[15] =
 file:/home/ec2-user/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar
 [ERROR] urls[16] =
 file:/home/ec2-user/.m2/repository/org/sonatype/sisu/sisu-guice/3.1.0/sisu-guice-3.1.0-no_aop.jar
 [ERROR] urls[17] =
 file:/home/ec2-user/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar
 [ERROR] urls[18] =
 file:/home/ec2-user/.m2/repository/org/eclipse/sisu/org.eclipse.sisu.inject/0.0.0.M2a/org.eclipse.sisu.inject-0.0.0.M2a.jar
 [ERROR] urls[19] =
 file:/home/ec2-user/.m2/repository/asm/asm/3.3.1/asm-3.3.1.jar
 [ERROR] urls[20] =
 file:/home/ec2-user/.m2/repository/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar
 [ERROR] urls[21] =
 file:/home/ec2-user/.m2/repository/org/apache/maven/plugin-tools/maven-plugin-annotations/3.2/maven-plugin-annotations-3.2.jar
 [ERROR] urls[22] =
 file:/home/ec2-user/.m2/repository/com/googlecode/slf4j-maven-plugin-log/slf4j-maven-plugin-log/1.0.0/slf4j-maven-plugin-log-1.0.0.jar
 [ERROR] Number of foreign imports: 1
 [ERROR] import: Entry[import  from realm ClassRealm[maven.api, parent:
 null]]
 [ERROR]
 [ERROR] -:
 org.slf4j.helpers.MarkerIgnoringBase
 [ERROR] - [Help 1]
 [ERROR]
 [ERROR] To see the full stack trace of the errors, re-run Maven with the
 -e switch.
 [ERROR] Re-run Maven using the -X switch to enable full debug logging.
 [ERROR]
 [ERROR] For more information about the errors and possible solutions,
 please read the following articles:
 [ERROR] [Help 1]
 http://cwiki.apache.org/confluence/display/MAVEN/PluginContainerException
 [ERROR]
 [ERROR] After correcting the problems, you can resume the build

Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

2015-07-15 Thread Jianfeng (Jeff) Zhang

This class belong to hadoop-auth which should be downloaded by maven. Do you 
find the hadoop auth jar under ~/.m2/repository ?


Best Regard,
Jeff Zhang


From: Rajat Jain rajat...@gmail.commailto:rajat...@gmail.com
Reply-To: Rajat Jain rajat...@gmail.commailto:rajat...@gmail.com
Date: Wednesday, July 15, 2015 at 3:14 PM
To: Jianfeng Zhang jzh...@hortonworks.commailto:jzh...@hortonworks.com
Cc: user@tez.apache.orgmailto:user@tez.apache.org 
user@tez.apache.orgmailto:user@tez.apache.org
Subject: Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

ConnectionConfigurator


Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

2015-07-15 Thread Jianfeng (Jeff) Zhang
Hi Rajat,

Could you run mvn clean first ?  Please try mvm clean install -DskipTests


Best Regard,
Jeff Zhang


From: Rajat Jain rajat...@gmail.commailto:rajat...@gmail.com
Reply-To: user@tez.apache.orgmailto:user@tez.apache.org 
user@tez.apache.orgmailto:user@tez.apache.org, Rajat Jain 
rajat...@gmail.commailto:rajat...@gmail.com
Date: Wednesday, July 15, 2015 at 2:26 PM
To: user@tez.apache.orgmailto:user@tez.apache.org 
user@tez.apache.orgmailto:user@tez.apache.org
Subject: Error compiling tez (0.6.1 and 0.7.0) from scratch

I checked out release tags 0.6.1 and 0.7.0. Issued mvn install -DskipTests. 
Got the following compilation errors.

[INFO] -
[INFO] -
[ERROR] COMPILATION ERROR :
[INFO] -
[ERROR] 
/Users/rjain/workspace/tez/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/HttpConnection.java:[402,51]
 cannot access 
org.apache.hadoop.security.authentication.client.ConnectionConfigurator
  class file for 
org.apache.hadoop.security.authentication.client.ConnectionConfigurator not 
found

Any ideas how to fix these?

Thanks,
Rajat


Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

2015-07-15 Thread Prakash Ramachandran
This is a known bug. TEZ-2560 is tracking it – will put in a fix soon.
For now you can use a maven version  3.3 OR change the frontend-maven-plugin 
version to 0.0.23 in the top level pom.xml

diff --git pom.xml pom.xml
index 122c05c..a2957f5 100644
--- pom.xml
+++ pom.xml
@@ -725,7 +725,7 @@
 plugin
   groupIdcom.github.eirslett/groupId
   artifactIdfrontend-maven-plugin/artifactId
-  version0.0.16/version
+  version0.0.23/version
 /plugin



From: Rajat Jain
Reply-To: user@tez.apache.orgmailto:user@tez.apache.org, Rajat Jain
Date: Wednesday, July 15, 2015 at 2:45 PM
To: Jianfeng (Jeff) Zhang
Cc: user@tez.apache.orgmailto:user@tez.apache.org
Subject: Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

Yeah, these errors are from mvn clean install. Sorry I didn't mention it in my 
first email.

On another machine, I get this error:

[INFO] 
[ERROR] Failed to execute goal 
com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm (install 
node and npm) on project tez-ui: Execution install node and npm of goal 
com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm failed: A 
required class was missing while executing 
com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm: 
org/slf4j/helpers/MarkerIgnoringBase
[ERROR] -
[ERROR] realm =plugincom.github.eirslett:frontend-maven-plugin:0.0.16
[ERROR] strategy = org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy
[ERROR] urls[0] = 
file:/home/ec2-user/.m2/repository/com/github/eirslett/frontend-maven-plugin/0.0.16/frontend-maven-plugin-0.0.16.jar
[ERROR] urls[1] = 
file:/home/ec2-user/.m2/repository/com/github/eirslett/frontend-plugin-core/0.0.16/frontend-plugin-core-0.0.16.jar
[ERROR] urls[2] = 
file:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar
[ERROR] urls[3] = 
file:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar
[ERROR] urls[4] = 
file:/home/ec2-user/.m2/repository/org/apache/commons/commons-compress/1.5/commons-compress-1.5.jar
[ERROR] urls[5] = 
file:/home/ec2-user/.m2/repository/org/tukaani/xz/1.2/xz-1.2.jar
[ERROR] urls[6] = 
file:/home/ec2-user/.m2/repository/org/apache/commons/commons-io/1.3.2/commons-io-1.3.2.jar
[ERROR] urls[7] = 
file:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpclient/4.3.1/httpclient-4.3.1.jar
[ERROR] urls[8] = 
file:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpcore/4.3/httpcore-4.3.jar
[ERROR] urls[9] = 
file:/home/ec2-user/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar
[ERROR] urls[10] = 
file:/home/ec2-user/.m2/repository/commons-codec/commons-codec/1.6/commons-codec-1.6.jar
[ERROR] urls[11] = 
file:/home/ec2-user/.m2/repository/org/codehaus/plexus/plexus-utils/3.0.10/plexus-utils-3.0.10.jar
[ERROR] urls[12] = 
file:/home/ec2-user/.m2/repository/javax/enterprise/cdi-api/1.0/cdi-api-1.0.jar
[ERROR] urls[13] = 
file:/home/ec2-user/.m2/repository/javax/annotation/jsr250-api/1.0/jsr250-api-1.0.jar
[ERROR] urls[14] = 
file:/home/ec2-user/.m2/repository/com/google/guava/guava/10.0.1/guava-10.0.1.jar
[ERROR] urls[15] = 
file:/home/ec2-user/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar
[ERROR] urls[16] = 
file:/home/ec2-user/.m2/repository/org/sonatype/sisu/sisu-guice/3.1.0/sisu-guice-3.1.0-no_aop.jar
[ERROR] urls[17] = 
file:/home/ec2-user/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar
[ERROR] urls[18] = 
file:/home/ec2-user/.m2/repository/org/eclipse/sisu/org.eclipse.sisu.inject/0.0.0.M2a/org.eclipse.sisu.inject-0.0.0.M2a.jar
[ERROR] urls[19] = 
file:/home/ec2-user/.m2/repository/asm/asm/3.3.1/asm-3.3.1.jar
[ERROR] urls[20] = 
file:/home/ec2-user/.m2/repository/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar
[ERROR] urls[21] = 
file:/home/ec2-user/.m2/repository/org/apache/maven/plugin-tools/maven-plugin-annotations/3.2/maven-plugin-annotations-3.2.jar
[ERROR] urls[22] = 
file:/home/ec2-user/.m2/repository/com/googlecode/slf4j-maven-plugin-log/slf4j-maven-plugin-log/1.0.0/slf4j-maven-plugin-log-1.0.0.jar
[ERROR] Number of foreign imports: 1
[ERROR] import: Entry[import  from realm ClassRealm[maven.api, parent: null]]
[ERROR]
[ERROR] -: 
org.slf4j.helpers.MarkerIgnoringBase
[ERROR] - [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/PluginContainerException
[ERROR]
[ERROR] After correcting

Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

2015-07-15 Thread Jianfeng (Jeff) Zhang
Are you using maven 3.3.1 ? Please try maven 3.2.5

http://mail-archives.apache.org/mod_mbox/maven-dev/201503.mbox/%3c7050c8e8-90f6-47b4-b3dc-fd10cb9e4...@takari.io%3E



Best Regard,
Jeff Zhang


From: Rajat Jain rajat...@gmail.commailto:rajat...@gmail.com
Reply-To: Rajat Jain rajat...@gmail.commailto:rajat...@gmail.com
Date: Wednesday, July 15, 2015 at 2:45 PM
To: Jianfeng Zhang jzh...@hortonworks.commailto:jzh...@hortonworks.com
Cc: user@tez.apache.orgmailto:user@tez.apache.org 
user@tez.apache.orgmailto:user@tez.apache.org
Subject: Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

Yeah, these errors are from mvn clean install. Sorry I didn't mention it in my 
first email.

On another machine, I get this error:

[INFO] 
[ERROR] Failed to execute goal 
com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm (install 
node and npm) on project tez-ui: Execution install node and npm of goal 
com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm failed: A 
required class was missing while executing 
com.github.eirslett:frontend-maven-plugin:0.0.16:install-node-and-npm: 
org/slf4j/helpers/MarkerIgnoringBase
[ERROR] -
[ERROR] realm =plugincom.github.eirslett:frontend-maven-plugin:0.0.16
[ERROR] strategy = org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy
[ERROR] urls[0] = 
file:/home/ec2-user/.m2/repository/com/github/eirslett/frontend-maven-plugin/0.0.16/frontend-maven-plugin-0.0.16.jar
[ERROR] urls[1] = 
file:/home/ec2-user/.m2/repository/com/github/eirslett/frontend-plugin-core/0.0.16/frontend-plugin-core-0.0.16.jar
[ERROR] urls[2] = 
file:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar
[ERROR] urls[3] = 
file:/home/ec2-user/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar
[ERROR] urls[4] = 
file:/home/ec2-user/.m2/repository/org/apache/commons/commons-compress/1.5/commons-compress-1.5.jar
[ERROR] urls[5] = 
file:/home/ec2-user/.m2/repository/org/tukaani/xz/1.2/xz-1.2.jar
[ERROR] urls[6] = 
file:/home/ec2-user/.m2/repository/org/apache/commons/commons-io/1.3.2/commons-io-1.3.2.jar
[ERROR] urls[7] = 
file:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpclient/4.3.1/httpclient-4.3.1.jar
[ERROR] urls[8] = 
file:/home/ec2-user/.m2/repository/org/apache/httpcomponents/httpcore/4.3/httpcore-4.3.jar
[ERROR] urls[9] = 
file:/home/ec2-user/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar
[ERROR] urls[10] = 
file:/home/ec2-user/.m2/repository/commons-codec/commons-codec/1.6/commons-codec-1.6.jar
[ERROR] urls[11] = 
file:/home/ec2-user/.m2/repository/org/codehaus/plexus/plexus-utils/3.0.10/plexus-utils-3.0.10.jar
[ERROR] urls[12] = 
file:/home/ec2-user/.m2/repository/javax/enterprise/cdi-api/1.0/cdi-api-1.0.jar
[ERROR] urls[13] = 
file:/home/ec2-user/.m2/repository/javax/annotation/jsr250-api/1.0/jsr250-api-1.0.jar
[ERROR] urls[14] = 
file:/home/ec2-user/.m2/repository/com/google/guava/guava/10.0.1/guava-10.0.1.jar
[ERROR] urls[15] = 
file:/home/ec2-user/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar
[ERROR] urls[16] = 
file:/home/ec2-user/.m2/repository/org/sonatype/sisu/sisu-guice/3.1.0/sisu-guice-3.1.0-no_aop.jar
[ERROR] urls[17] = 
file:/home/ec2-user/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar
[ERROR] urls[18] = 
file:/home/ec2-user/.m2/repository/org/eclipse/sisu/org.eclipse.sisu.inject/0.0.0.M2a/org.eclipse.sisu.inject-0.0.0.M2a.jar
[ERROR] urls[19] = 
file:/home/ec2-user/.m2/repository/asm/asm/3.3.1/asm-3.3.1.jar
[ERROR] urls[20] = 
file:/home/ec2-user/.m2/repository/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar
[ERROR] urls[21] = 
file:/home/ec2-user/.m2/repository/org/apache/maven/plugin-tools/maven-plugin-annotations/3.2/maven-plugin-annotations-3.2.jar
[ERROR] urls[22] = 
file:/home/ec2-user/.m2/repository/com/googlecode/slf4j-maven-plugin-log/slf4j-maven-plugin-log/1.0.0/slf4j-maven-plugin-log-1.0.0.jar
[ERROR] Number of foreign imports: 1
[ERROR] import: Entry[import  from realm ClassRealm[maven.api, parent: null]]
[ERROR]
[ERROR] -: 
org.slf4j.helpers.MarkerIgnoringBase
[ERROR] - [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/PluginContainerException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn goals -rf :tez-ui

On Wed, Jul 15, 2015 at 2:35 PM, Jianfeng (Jeff) Zhang 
jzh

Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

2015-07-15 Thread Rajat Jain
The build compiles fine on EC2 instances, but fail on mac. This output is
after I cleared my ~/.m2/repository folder.

[INFO] -
[INFO] -
[ERROR] COMPILATION ERROR :
[INFO] -
[ERROR]
/Users/rjain/workspace/tez/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/HttpConnection.java:[402,51]
cannot access
org.apache.hadoop.security.authentication.client.ConnectionConfigurator
  class file for
org.apache.hadoop.security.authentication.client.ConnectionConfigurator not
found
[INFO] 1 error
[INFO] -
[INFO]

[INFO] Reactor Summary:
[INFO]
[INFO] tez  SUCCESS [
46.070 s]
[INFO] tez-api  SUCCESS [01:24
min]
[INFO] tez-common . SUCCESS [
 0.434 s]
[INFO] tez-runtime-internals .. SUCCESS [
 0.506 s]
[INFO] tez-runtime-library  FAILURE [
 0.944 s]
[INFO] tez-mapreduce .. SKIPPED
[INFO] tez-examples ... SKIPPED
[INFO] tez-dag  SKIPPED
[INFO] tez-tests .. SKIPPED
[INFO] tez-ui . SKIPPED
[INFO] tez-plugins  SKIPPED
[INFO] tez-yarn-timeline-history .. SKIPPED
[INFO] tez-yarn-timeline-history-with-acls  SKIPPED
[INFO] tez-mbeans-resource-calculator . SKIPPED
[INFO] tez-tools .. SKIPPED
[INFO] tez-dist ... SKIPPED
[INFO] Tez  SKIPPED
[INFO]

[INFO] BUILD FAILURE
[INFO]

[INFO] Total time: 02:12 min
[INFO] Finished at: 2015-07-15T15:12:55-07:00
[INFO] Final Memory: 37M/982M
[INFO]

[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:compile
(default-compile) on project tez-runtime-library: Compilation failure
[ERROR]
/Users/rjain/workspace/tez/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/HttpConnection.java:[402,51]
cannot access
org.apache.hadoop.security.authentication.client.ConnectionConfigurator
[ERROR] class file for
org.apache.hadoop.security.authentication.client.ConnectionConfigurator not
found
[ERROR] - [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR]   mvn goals -rf :tez-runtime-library
rjain@MAC: /Users/rjain/workspace/tez git:(ded6141) ✗
➜   mvn --version
Apache Maven 3.2.2 (45f7c06d68e745d05611f7fd14efb6594181933e;
2014-06-17T06:51:42-07:00)
Maven home: /Users/rjain/Downloads/apache-maven-3.2.2
Java version: 1.7.0_71, vendor: Oracle Corporation
Java home:
/Library/Java/JavaVirtualMachines/jdk1.7.0_71.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: mac os x, version: 10.11, arch: x86_64, family: mac

On Wed, Jul 15, 2015 at 2:56 PM, Rajat Jain rajat...@gmail.com wrote:

 Thanks Jianfeng and Prakash. I was indeed using maven 3.3. Updating the
 version to 0.0.23 solved the problem.

 On Wed, Jul 15, 2015 at 2:52 PM, Jianfeng (Jeff) Zhang 
 jzh...@hortonworks.com wrote:

  Are you using maven 3.3.1 ? Please try maven 3.2.5


 http://mail-archives.apache.org/mod_mbox/maven-dev/201503.mbox/%3c7050c8e8-90f6-47b4-b3dc-fd10cb9e4...@takari.io%3E



  Best Regard,
 Jeff Zhang


   From: Rajat Jain rajat...@gmail.com
 Reply-To: Rajat Jain rajat...@gmail.com
 Date: Wednesday, July 15, 2015 at 2:45 PM
 To: Jianfeng Zhang jzh...@hortonworks.com
 Cc: user@tez.apache.org user@tez.apache.org
 Subject: Re: Error compiling tez (0.6.1 and 0.7.0) from scratch

Yeah, these errors are from mvn clean install. Sorry I didn't mention
 it in my first email.

  On another machine, I get this error:

  [INFO]
 
 [ERROR] Failed to execute goal
 com.github.eirslett:frontend-maven-plugin:0.0.16:install-node