RE: building Tez master branch fail
Interesting. When I first tried building tez I was using 2.5.0 protoc (and protoc -version returns 2.5.0). But the build fails with below error and I changed protobuf to 2.6.0 (as well as the pom.xml file) everything seems working... Xiaoyong -Original Message- From: Hitesh Shah [mailto:hit...@apache.org] Sent: Wednesday, September 2, 2015 11:05 PM To: user@tez.apache.org Subject: Re: building Tez master branch fail Actually protobuf version is still 2.5.0 on master. Hadoop forces everyone to use 2.5.0 for compatibility. 2.5.0 Please check to see whether protoc is firstly in your path and confirm that "protoc -version" returns 2.5.0 thanks - Hitesh On Sep 2, 2015, at 1:47 AM, Sandeep Kumar wrote: > In case you are trying to compile master branch then its pom.xml refers to > 2.6.0 protoc. So, you have to install protoc 2.6.0 on your host to compile > tez master branch. AFAIK tez 0.7.0 uses older version of protoc 2.5.0. > > > > On Wed, Sep 2, 2015 at 2:08 PM, Xiaoyong Zhu wrote: > Hi experts > > > > > > I am trying to build the tez master branch but it always gives me the error > message (it seems that the pom file has something wrong?) > > > > I am sure I am using protobuf 2.5, and not sure why there's such kind of > issue...the log is also attached. > > > > Thanks! > > > > [INFO] --- hadoop-maven-plugins:2.6.0:protoc (compile-protoc) @ tez-api --- > > [DEBUG] org.apache.hadoop:hadoop-maven-plugins:jar:2.6.0: > > [DEBUG]org.apache.maven:maven-plugin-api:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-model:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-artifact:jar:3.0:compile > > [DEBUG] org.sonatype.sisu:sisu-inject-plexus:jar:1.4.2:compile > > [DEBUG] org.sonatype.sisu:sisu-inject-bean:jar:1.4.2:compile > > [DEBUG] org.sonatype.sisu:sisu-guice:jar:noaop:2.1.7:compile > > [DEBUG]org.apache.maven:maven-core:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-settings:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-settings-builder:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-repository-metadata:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-model-builder:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-aether-provider:jar:3.0:runtime > > [DEBUG] org.sonatype.aether:aether-impl:jar:1.7:compile > > [DEBUG] org.sonatype.aether:aether-spi:jar:1.7:compile > > [DEBUG] org.sonatype.aether:aether-api:jar:1.7:compile > > [DEBUG] org.sonatype.aether:aether-util:jar:1.7:compile > > [DEBUG] org.codehaus.plexus:plexus-interpolation:jar:1.14:compile > > [DEBUG] org.codehaus.plexus:plexus-utils:jar:2.0.5:compile (version > managed from 2.0.4) > > [DEBUG] org.codehaus.plexus:plexus-classworlds:jar:2.2.3:compile > > [DEBUG] > org.codehaus.plexus:plexus-component-annotations:jar:1.5.5:compile > > [DEBUG] org.sonatype.plexus:plexus-sec-dispatcher:jar:1.3:compile > > > > > > > > [ERROR] Failed to execute goal > org.apache.hadoop:hadoop-maven-plugins:2.6.0:protoc (compile-protoc) on > project tez-api: org.apache.maven.plugin.MojoExecutionException: protoc > failure -> [Help 1] > > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute > goal org.apache.hadoop:hadoop-maven-plugins:2.6.0:protoc (compile-protoc) on > project tez-api: org.apache.maven.plugin.MojoExecutionException: protoc > failure > > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(https://na01.safelinks.protection.outlook.com/?url=MojoExecutor.java%3a217&data=01%7c01%7cxiaoyzhu%40064d.mgd.microsoft.com%7c9aeac44b044c4b8d770108d2b3a7d4df%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=W1F3pdG4vxxffqUwoSesJK2myq7rA8j1z4JK7pXVaSk%3d) > > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(https://na01.safelinks.protection.outlook.com/?url=MojoExecutor.java%3a153&data=01%7c01%7cxiaoyzhu%40064d.mgd.microsoft.com%7c9aeac44b044c4b8d770108d2b3a7d4df%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=vPQNJTH5JcxWipkZZO%2fmxfgaZiJeEZfwYUnKw36LqRU%3d) > > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(https://na01.safelinks.protection.outlook.com/?url=MojoExecutor.java%3a145&data=01%7c01%7cxiaoyzhu%40064d.mgd.microsoft.com%7c9aeac44b044c4b8d770108d2b3a7d4df%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=OzkAeV%2fLGpD0Bi%2bVgnA%2bUMERpnsbbadO%2fsGm1TKIE1g%3d) > > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(https://na01.safelinks.protection.outlook.com/?url=Lifec
Re: building Tez master branch fail
Actually protobuf version is still 2.5.0 on master. Hadoop forces everyone to use 2.5.0 for compatibility. 2.5.0 Please check to see whether protoc is firstly in your path and confirm that "protoc —version” returns 2.5.0 thanks — Hitesh On Sep 2, 2015, at 1:47 AM, Sandeep Kumar wrote: > In case you are trying to compile master branch then its pom.xml refers to > 2.6.0 protoc. So, you have to install protoc 2.6.0 on your host to compile > tez master branch. AFAIK tez 0.7.0 uses older version of protoc 2.5.0. > > > > On Wed, Sep 2, 2015 at 2:08 PM, Xiaoyong Zhu wrote: > Hi experts > > > > > > I am trying to build the tez master branch but it always gives me the error > message (it seems that the pom file has something wrong?) > > > > I am sure I am using protobuf 2.5, and not sure why there’s such kind of > issue…the log is also attached. > > > > Thanks! > > > > [INFO] --- hadoop-maven-plugins:2.6.0:protoc (compile-protoc) @ tez-api --- > > [DEBUG] org.apache.hadoop:hadoop-maven-plugins:jar:2.6.0: > > [DEBUG]org.apache.maven:maven-plugin-api:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-model:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-artifact:jar:3.0:compile > > [DEBUG] org.sonatype.sisu:sisu-inject-plexus:jar:1.4.2:compile > > [DEBUG] org.sonatype.sisu:sisu-inject-bean:jar:1.4.2:compile > > [DEBUG] org.sonatype.sisu:sisu-guice:jar:noaop:2.1.7:compile > > [DEBUG]org.apache.maven:maven-core:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-settings:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-settings-builder:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-repository-metadata:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-model-builder:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-aether-provider:jar:3.0:runtime > > [DEBUG] org.sonatype.aether:aether-impl:jar:1.7:compile > > [DEBUG] org.sonatype.aether:aether-spi:jar:1.7:compile > > [DEBUG] org.sonatype.aether:aether-api:jar:1.7:compile > > [DEBUG] org.sonatype.aether:aether-util:jar:1.7:compile > > [DEBUG] org.codehaus.plexus:plexus-interpolation:jar:1.14:compile > > [DEBUG] org.codehaus.plexus:plexus-utils:jar:2.0.5:compile (version > managed from 2.0.4) > > [DEBUG] org.codehaus.plexus:plexus-classworlds:jar:2.2.3:compile > > [DEBUG] > org.codehaus.plexus:plexus-component-annotations:jar:1.5.5:compile > > [DEBUG] org.sonatype.plexus:plexus-sec-dispatcher:jar:1.3:compile > > > > > > > > [ERROR] Failed to execute goal > org.apache.hadoop:hadoop-maven-plugins:2.6.0:protoc (compile-protoc) on > project tez-api: org.apache.maven.plugin.MojoExecutionException: protoc > failure -> [Help 1] > > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute > goal org.apache.hadoop:hadoop-maven-plugins:2.6.0:protoc (compile-protoc) on > project tez-api: org.apache.maven.plugin.MojoExecutionException: protoc > failure > > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217) > > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) > > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) > > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) > > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) > > at > org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) > > at > org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) > > at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) > > at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) > > at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) > > at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) > > at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at > org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) > > at > org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) > > at > org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) > > at > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) > > Caused by: org.apache.maven.plugin.MojoExecutionExcep
RE: building Tez master branch fail
Oh.. I am using protoc 2.5.0. will try the 2.6.0. Should we make this clear in the BUILDING.txt? since in the master branch’s BUILDING.txt it’s still referring to protoc 2.5.0 Xiaoyong From: Sandeep Kumar [mailto:sandeepdas@gmail.com] Sent: Wednesday, September 2, 2015 4:48 PM To: user@tez.apache.org Subject: Re: building Tez master branch fail In case you are trying to compile master branch then its pom.xml refers to 2.6.0 protoc. So, you have to install protoc 2.6.0 on your host to compile tez master branch. AFAIK tez 0.7.0 uses older version of protoc 2.5.0. On Wed, Sep 2, 2015 at 2:08 PM, Xiaoyong Zhu mailto:xiaoy...@microsoft.com>> wrote: Hi experts I am trying to build the tez master branch but it always gives me the error message (it seems that the pom file has something wrong?) I am sure I am using protobuf 2.5, and not sure why there’s such kind of issue…the log is also attached. Thanks! [INFO] --- hadoop-maven-plugins:2.6.0:protoc (compile-protoc) @ tez-api --- [DEBUG] org.apache.hadoop:hadoop-maven-plugins:jar:2.6.0: [DEBUG]org.apache.maven:maven-plugin-api:jar:3.0:compile [DEBUG] org.apache.maven:maven-model:jar:3.0:compile [DEBUG] org.apache.maven:maven-artifact:jar:3.0:compile [DEBUG] org.sonatype.sisu:sisu-inject-plexus:jar:1.4.2:compile [DEBUG] org.sonatype.sisu:sisu-inject-bean:jar:1.4.2:compile [DEBUG] org.sonatype.sisu:sisu-guice:jar:noaop:2.1.7:compile [DEBUG]org.apache.maven:maven-core:jar:3.0:compile [DEBUG] org.apache.maven:maven-settings:jar:3.0:compile [DEBUG] org.apache.maven:maven-settings-builder:jar:3.0:compile [DEBUG] org.apache.maven:maven-repository-metadata:jar:3.0:compile [DEBUG] org.apache.maven:maven-model-builder:jar:3.0:compile [DEBUG] org.apache.maven:maven-aether-provider:jar:3.0:runtime [DEBUG] org.sonatype.aether:aether-impl:jar:1.7:compile [DEBUG] org.sonatype.aether:aether-spi:jar:1.7:compile [DEBUG] org.sonatype.aether:aether-api:jar:1.7:compile [DEBUG] org.sonatype.aether:aether-util:jar:1.7:compile [DEBUG] org.codehaus.plexus:plexus-interpolation:jar:1.14:compile [DEBUG] org.codehaus.plexus:plexus-utils:jar:2.0.5:compile (version managed from 2.0.4) [DEBUG] org.codehaus.plexus:plexus-classworlds:jar:2.2.3:compile [DEBUG] org.codehaus.plexus:plexus-component-annotations:jar:1.5.5:compile [DEBUG] org.sonatype.plexus:plexus-sec-dispatcher:jar:1.3:compile [ERROR] Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:2.6.0:protoc (compile-protoc) on project tez-api: org.apache.maven.plugin.MojoExecutionException: protoc failure -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:2.6.0:protoc (compile-protoc) on project tez-api: org.apache.maven.plugin.MojoExecutionException: protoc failure at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) Caused by: org.apache.maven.plugin.MojoExecutionException: org.apache.maven.plugin.MojoExecutionException: protoc failure at org.apache.hadoop.maven.plugin.protoc.ProtocMojo.execute(ProtocMojo.java:105) at org.apache.maven.plugin.DefaultBuildPluginManager.ex
Re: building Tez master branch fail
In case you are trying to compile master branch then its pom.xml refers to 2.6.0 protoc. So, you have to install protoc 2.6.0 on your host to compile tez master branch. AFAIK tez 0.7.0 uses older version of protoc 2.5.0. On Wed, Sep 2, 2015 at 2:08 PM, Xiaoyong Zhu wrote: > Hi experts > > > > > > I am trying to build the tez master branch but it always gives me the > error message (it seems that the pom file has something wrong?) > > > > I am sure I am using protobuf 2.5, and not sure why there’s such kind of > issue…the log is also attached. > > > > Thanks! > > > > [INFO] --- hadoop-maven-plugins:2.6.0:protoc (compile-protoc) @ tez-api --- > > [DEBUG] org.apache.hadoop:hadoop-maven-plugins:jar:2.6.0: > > [DEBUG]org.apache.maven:maven-plugin-api:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-model:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-artifact:jar:3.0:compile > > [DEBUG] org.sonatype.sisu:sisu-inject-plexus:jar:1.4.2:compile > > [DEBUG] org.sonatype.sisu:sisu-inject-bean:jar:1.4.2:compile > > [DEBUG] org.sonatype.sisu:sisu-guice:jar:noaop:2.1.7:compile > > [DEBUG]org.apache.maven:maven-core:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-settings:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-settings-builder:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-repository-metadata:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-model-builder:jar:3.0:compile > > [DEBUG] org.apache.maven:maven-aether-provider:jar:3.0:runtime > > [DEBUG] org.sonatype.aether:aether-impl:jar:1.7:compile > > [DEBUG] org.sonatype.aether:aether-spi:jar:1.7:compile > > [DEBUG] org.sonatype.aether:aether-api:jar:1.7:compile > > [DEBUG] org.sonatype.aether:aether-util:jar:1.7:compile > > [DEBUG] org.codehaus.plexus:plexus-interpolation:jar:1.14:compile > > [DEBUG] org.codehaus.plexus:plexus-utils:jar:2.0.5:compile (version > managed from 2.0.4) > > [DEBUG] org.codehaus.plexus:plexus-classworlds:jar:2.2.3:compile > > [DEBUG] > org.codehaus.plexus:plexus-component-annotations:jar:1.5.5:compile > > [DEBUG] org.sonatype.plexus:plexus-sec-dispatcher:jar:1.3:compile > > > > > > > > [ERROR] Failed to execute goal > org.apache.hadoop:hadoop-maven-plugins:2.6.0:protoc (compile-protoc) on > project tez-api: org.apache.maven.plugin.MojoExecutionException: protoc > failure -> [Help 1] > > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute > goal org.apache.hadoop:hadoop-maven-plugins:2.6.0:protoc (compile-protoc) > on project tez-api: org.apache.maven.plugin.MojoExecutionException: protoc > failure > > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217) > > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) > > at > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) > > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) > > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) > > at > org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) > > at > org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) > > at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) > > at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) > > at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) > > at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) > > at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at > org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) > > at > org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) > > at > org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) > > at > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) > > Caused by: org.apache.maven.plugin.MojoExecutionException: > org.apache.maven.plugin.MojoExecutionException: protoc failure > > at > org.apache.hadoop.maven.plugin.protoc.ProtocMojo.execute(ProtocMojo.java:105) > > at > org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) > > Xiaoyong > > >
