Hi, Just re-ran again without killing zinc server process
/make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive -Pyarn -Dmaven.version=3.0.4 -Dscala-2.11 -X -rf :spark-sql_2.11 Build is success. Not sure how it worked with just re-running command again. On Sat, Sep 3, 2016 at 11:44 AM, Diwakar Dhanuskodi < diwakar.dhanusk...@gmail.com> wrote: > Hi, > > java version 7 > > mvn command > ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive > -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 > > > yes, I executed script to change scala version to 2.11 > killed "com.typesafe zinc.Nailgun" process > > re-ran mvn with below command again > > ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive > -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11 > > Getting same error > > [warn] /home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/ > scala/org/apache/spark/sql/sources/interfaces.scala:911: method isDir in > class FileStatus is deprecated: see corresponding Javadoc for more > information. > [warn] status.isDir, > [warn] ^ > [error] missing or invalid dependency detected while loading class file > 'WebUI.class'. > [error] Could not access term eclipse in package org, > [error] because it (or its dependencies) are missing. Check your build > definition for > [error] missing or conflicting dependencies. (Re-run with > `-Ylog-classpath` to see the problematic classpath.) > [error] A full rebuild may help if 'WebUI.class' was compiled against an > incompatible version of org. > [error] missing or invalid dependency detected while loading class file > 'WebUI.class'. > [error] Could not access term jetty in value org.eclipse, > [error] because it (or its dependencies) are missing. Check your build > definition for > [error] missing or conflicting dependencies. (Re-run with > `-Ylog-classpath` to see the problematic classpath.) > [error] A full rebuild may help if 'WebUI.class' was compiled against an > incompatible version of org.eclipse. > [warn] 17 warnings found > [error] two errors found > [debug] Compilation failed (CompilerInterface) > [error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s] > [INFO] ------------------------------------------------------------ > ------------ > [INFO] Reactor Summary: > [INFO] > [INFO] Spark Project Parent POM .......................... SUCCESS [5.583s] > [INFO] Spark Project Test Tags ........................... SUCCESS [4.189s] > [INFO] Spark Project Launcher ............................ SUCCESS > [12.226s] > [INFO] Spark Project Networking .......................... SUCCESS > [13.386s] > [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.723s] > [INFO] Spark Project Unsafe .............................. SUCCESS > [21.231s] > [INFO] Spark Project Core ................................ SUCCESS > [3:46.334s] > [INFO] Spark Project Bagel ............................... SUCCESS > [7.032s] > [INFO] Spark Project GraphX .............................. SUCCESS > [19.558s] > [INFO] Spark Project Streaming ........................... SUCCESS > [50.452s] > [INFO] Spark Project Catalyst ............................ SUCCESS > [1:14.172s] > [INFO] Spark Project SQL ................................. FAILURE > [23.222s] > [INFO] Spark Project ML Library .......................... SKIPPED > [INFO] Spark Project Tools ............................... SKIPPED > [INFO] Spark Project Hive ................................ SKIPPED > [INFO] Spark Project Docker Integration Tests ............ SKIPPED > [INFO] Spark Project REPL ................................ SKIPPED > [INFO] Spark Project YARN Shuffle Service ................ SKIPPED > [INFO] Spark Project YARN ................................ SKIPPED > [INFO] Spark Project Assembly ............................ SKIPPED > [INFO] Spark Project External Twitter .................... SKIPPED > [INFO] Spark Project External Flume Sink ................. SKIPPED > [INFO] Spark Project External Flume ...................... SKIPPED > [INFO] Spark Project External Flume Assembly ............. SKIPPED > [INFO] Spark Project External MQTT ....................... SKIPPED > [INFO] Spark Project External MQTT Assembly .............. SKIPPED > [INFO] Spark Project External ZeroMQ ..................... SKIPPED > [INFO] Spark Project External Kafka ...................... SKIPPED > [INFO] Spark Project Examples ............................ SKIPPED > [INFO] Spark Project External Kafka Assembly ............. SKIPPED > [INFO] ------------------------------------------------------------ > ------------ > [INFO] BUILD FAILURE > [INFO] ------------------------------------------------------------ > ------------ > [INFO] Total time: 7:45.641s > [INFO] Finished at: Sat Sep 03 11:28:34 IST 2016 > [INFO] Final Memory: 49M/415M > [INFO] ------------------------------------------------------------ > ------------ > [ERROR] Failed to execute goal > net.alchim31.maven:scala-maven-plugin:3.2.2:compile > (scala-compile-first) on project spark-sql_2.11: Execution > scala-compile-first of goal > net.alchim31.maven:scala-maven-plugin:3.2.2:compile > failed. CompileFailed -> [Help 1] > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute > goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile > (scala-compile-first) on project spark-sql_2.11: Execution > scala-compile-first of goal > net.alchim31.maven:scala-maven-plugin:3.2.2:compile > failed. > at org.apache.maven.lifecycle.internal.MojoExecutor.execute( > MojoExecutor.java:225) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute( > MojoExecutor.java:153) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute( > MojoExecutor.java:145) > at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder. > buildProject(LifecycleModuleBuilder.java:84) > at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder. > buildProject(LifecycleModuleBuilder.java:59) > at org.apache.maven.lifecycle.internal.LifecycleStarter. > singleThreadedBuild(LifecycleStarter.java:183) > at org.apache.maven.lifecycle.internal.LifecycleStarter. > execute(LifecycleStarter.java:161) > at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) > at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) > at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) > at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) > at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.codehaus.plexus.classworlds.launcher.Launcher. > launchEnhanced(Launcher.java:290) > at org.codehaus.plexus.classworlds.launcher.Launcher. > launch(Launcher.java:230) > at org.codehaus.plexus.classworlds.launcher.Launcher. > mainWithExitCode(Launcher.java:409) > at org.codehaus.plexus.classworlds.launcher.Launcher. > main(Launcher.java:352) > Caused by: org.apache.maven.plugin.PluginExecutionException: Execution > scala-compile-first of goal > net.alchim31.maven:scala-maven-plugin:3.2.2:compile > failed. > at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo( > DefaultBuildPluginManager.java:110) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute( > MojoExecutor.java:209) > ... 19 more > Caused by: Compile failed via zinc server > at sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java: > 136) > at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86) > at scala_maven.ScalaCompilerSupport.incrementalCompile( > ScalaCompilerSupport.java:303) > at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119) > at scala_maven.ScalaCompilerSupport.doExecute( > ScalaCompilerSupport.java:99) > at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482) > at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo( > DefaultBuildPluginManager.java:101) > ... 20 more > [ERROR] > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ > PluginExecutionException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn <goals> -rf :spark-sql_2.11 > > > On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <divya.htco...@gmail.com> > wrote: > >> Which java version are you using ? >> >> On 31 August 2016 at 04:30, Diwakar Dhanuskodi < >> diwakar.dhanusk...@gmail.com> wrote: >> >>> Hi, >>> >>> While building Spark 1.6.2 , getting below error in spark-sql. Much >>> appreciate for any help. >>> >>> ERROR] missing or invalid dependency detected while loading class file >>> 'WebUI.class'. >>> Could not access term eclipse in package org, >>> because it (or its dependencies) are missing. Check your build >>> definition for >>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to >>> see the problematic classpath.) >>> A full rebuild may help if 'WebUI.class' was compiled against an >>> incompatible version of org. >>> [ERROR] missing or invalid dependency detected while loading class file >>> 'WebUI.class'. >>> Could not access term jetty in value org.eclipse, >>> because it (or its dependencies) are missing. Check your build >>> definition for >>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to >>> see the problematic classpath.) >>> A full rebuild may help if 'WebUI.class' was compiled against an >>> incompatible version of org.eclipse. >>> [WARNING] 17 warnings found >>> [ERROR] two errors found >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [INFO] Reactor Summary: >>> [INFO] >>> [INFO] Spark Project Parent POM .......................... SUCCESS >>> [4.399s] >>> [INFO] Spark Project Test Tags ........................... SUCCESS >>> [3.443s] >>> [INFO] Spark Project Launcher ............................ SUCCESS >>> [10.131s] >>> [INFO] Spark Project Networking .......................... SUCCESS >>> [11.849s] >>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS >>> [6.641s] >>> [INFO] Spark Project Unsafe .............................. SUCCESS >>> [19.765s] >>> [INFO] Spark Project Core ................................ SUCCESS >>> [4:16.511s] >>> [INFO] Spark Project Bagel ............................... SUCCESS >>> [13.401s] >>> [INFO] Spark Project GraphX .............................. SUCCESS >>> [1:08.824s] >>> [INFO] Spark Project Streaming ........................... SUCCESS >>> [2:18.844s] >>> [INFO] Spark Project Catalyst ............................ SUCCESS >>> [2:43.695s] >>> [INFO] Spark Project SQL ................................. FAILURE >>> [1:01.762s] >>> [INFO] Spark Project ML Library .......................... SKIPPED >>> [INFO] Spark Project Tools ............................... SKIPPED >>> [INFO] Spark Project Hive ................................ SKIPPED >>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED >>> [INFO] Spark Project REPL ................................ SKIPPED >>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED >>> [INFO] Spark Project YARN ................................ SKIPPED >>> [INFO] Spark Project Assembly ............................ SKIPPED >>> [INFO] Spark Project External Twitter .................... SKIPPED >>> [INFO] Spark Project External Flume Sink ................. SKIPPED >>> [INFO] Spark Project External Flume ...................... SKIPPED >>> [INFO] Spark Project External Flume Assembly ............. SKIPPED >>> [INFO] Spark Project External MQTT ....................... SKIPPED >>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED >>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED >>> [INFO] Spark Project External Kafka ...................... SKIPPED >>> [INFO] Spark Project Examples ............................ SKIPPED >>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [INFO] BUILD FAILURE >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [INFO] Total time: 12:40.525s >>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016 >>> [INFO] Final Memory: 71M/830M >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [ERROR] Failed to execute goal >>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>> (scala-compile-first) on project spark-sql_2.11: Execution >>> scala-compile-first of goal >>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>> failed. CompileFailed -> [Help 1] >>> [ERROR] >>> [ERROR] To see the full stack trace of the errors, re-run Maven with the >>> -e switch. >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>> [ERROR] >>> [ERROR] For more information about the errors and possible solutions, >>> please read the following articles: >>> [ERROR] [Help 1] http://cwiki.apache.org/conflu >>> ence/display/MAVEN/PluginExecutionException >>> [ERROR] >>> [ERROR] After correcting the problems, you can resume the build with the >>> command >>> [ERROR] mvn <goals> -rf :spark-sql_2.11 >>> >>> >>> >> >
