Sorry my bad. In both the runs I included -Dscala-2.11 On Sat, Sep 3, 2016 at 12:39 PM, Nachiketa <nachiketa.shu...@gmail.com> wrote:
> I think the difference was the -Dscala2.11 to the command line. > > I have seen this show up when I miss that. > > Regards, > Nachiketa > > On Sat 3 Sep, 2016, 12:14 PM Diwakar Dhanuskodi, < > diwakar.dhanusk...@gmail.com> wrote: > >> Hi, >> >> Just re-ran again without killing zinc server process >> >> /make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive >> -Pyarn -Dmaven.version=3.0.4 -Dscala-2.11 -X -rf :spark-sql_2.11 >> >> Build is success. Not sure how it worked with just re-running command >> again. >> >> On Sat, Sep 3, 2016 at 11:44 AM, Diwakar Dhanuskodi < >> diwakar.dhanusk...@gmail.com> wrote: >> >>> Hi, >>> >>> java version 7 >>> >>> mvn command >>> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive >>> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 >>> >>> >>> yes, I executed script to change scala version to 2.11 >>> killed "com.typesafe zinc.Nailgun" process >>> >>> re-ran mvn with below command again >>> >>> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive >>> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11 >>> >>> Getting same error >>> >>> [warn] /home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/ >>> scala/org/apache/spark/sql/sources/interfaces.scala:911: method isDir >>> in class FileStatus is deprecated: see corresponding Javadoc for more >>> information. >>> [warn] status.isDir, >>> [warn] ^ >>> [error] missing or invalid dependency detected while loading class file >>> 'WebUI.class'. >>> [error] Could not access term eclipse in package org, >>> [error] because it (or its dependencies) are missing. Check your build >>> definition for >>> [error] missing or conflicting dependencies. (Re-run with >>> `-Ylog-classpath` to see the problematic classpath.) >>> [error] A full rebuild may help if 'WebUI.class' was compiled against an >>> incompatible version of org. >>> [error] missing or invalid dependency detected while loading class file >>> 'WebUI.class'. >>> [error] Could not access term jetty in value org.eclipse, >>> [error] because it (or its dependencies) are missing. Check your build >>> definition for >>> [error] missing or conflicting dependencies. (Re-run with >>> `-Ylog-classpath` to see the problematic classpath.) >>> [error] A full rebuild may help if 'WebUI.class' was compiled against an >>> incompatible version of org.eclipse. >>> [warn] 17 warnings found >>> [error] two errors found >>> [debug] Compilation failed (CompilerInterface) >>> [error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s] >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [INFO] Reactor Summary: >>> [INFO] >>> [INFO] Spark Project Parent POM .......................... SUCCESS >>> [5.583s] >>> [INFO] Spark Project Test Tags ........................... SUCCESS >>> [4.189s] >>> [INFO] Spark Project Launcher ............................ SUCCESS >>> [12.226s] >>> [INFO] Spark Project Networking .......................... SUCCESS >>> [13.386s] >>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS >>> [6.723s] >>> [INFO] Spark Project Unsafe .............................. SUCCESS >>> [21.231s] >>> [INFO] Spark Project Core ................................ SUCCESS >>> [3:46.334s] >>> [INFO] Spark Project Bagel ............................... SUCCESS >>> [7.032s] >>> [INFO] Spark Project GraphX .............................. SUCCESS >>> [19.558s] >>> [INFO] Spark Project Streaming ........................... SUCCESS >>> [50.452s] >>> [INFO] Spark Project Catalyst ............................ SUCCESS >>> [1:14.172s] >>> [INFO] Spark Project SQL ................................. FAILURE >>> [23.222s] >>> [INFO] Spark Project ML Library .......................... SKIPPED >>> [INFO] Spark Project Tools ............................... SKIPPED >>> [INFO] Spark Project Hive ................................ SKIPPED >>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED >>> [INFO] Spark Project REPL ................................ SKIPPED >>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED >>> [INFO] Spark Project YARN ................................ SKIPPED >>> [INFO] Spark Project Assembly ............................ SKIPPED >>> [INFO] Spark Project External Twitter .................... SKIPPED >>> [INFO] Spark Project External Flume Sink ................. SKIPPED >>> [INFO] Spark Project External Flume ...................... SKIPPED >>> [INFO] Spark Project External Flume Assembly ............. SKIPPED >>> [INFO] Spark Project External MQTT ....................... SKIPPED >>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED >>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED >>> [INFO] Spark Project External Kafka ...................... SKIPPED >>> [INFO] Spark Project Examples ............................ SKIPPED >>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [INFO] BUILD FAILURE >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [INFO] Total time: 7:45.641s >>> [INFO] Finished at: Sat Sep 03 11:28:34 IST 2016 >>> [INFO] Final Memory: 49M/415M >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [ERROR] Failed to execute goal >>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>> (scala-compile-first) on project spark-sql_2.11: Execution >>> scala-compile-first of goal >>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>> failed. CompileFailed -> [Help 1] >>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to >>> execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>> (scala-compile-first) on project spark-sql_2.11: Execution >>> scala-compile-first of goal >>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>> failed. >>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute( >>> MojoExecutor.java:225) >>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute( >>> MojoExecutor.java:153) >>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute( >>> MojoExecutor.java:145) >>> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder. >>> buildProject(LifecycleModuleBuilder.java:84) >>> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder. >>> buildProject(LifecycleModuleBuilder.java:59) >>> at org.apache.maven.lifecycle.internal.LifecycleStarter. >>> singleThreadedBuild(LifecycleStarter.java:183) >>> at org.apache.maven.lifecycle.internal.LifecycleStarter. >>> execute(LifecycleStarter.java:161) >>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) >>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) >>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) >>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) >>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at sun.reflect.NativeMethodAccessorImpl.invoke( >>> NativeMethodAccessorImpl.java:57) >>> at sun.reflect.DelegatingMethodAccessorImpl.invoke( >>> DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at org.codehaus.plexus.classworlds.launcher.Launcher. >>> launchEnhanced(Launcher.java:290) >>> at org.codehaus.plexus.classworlds.launcher.Launcher. >>> launch(Launcher.java:230) >>> at org.codehaus.plexus.classworlds.launcher.Launcher. >>> mainWithExitCode(Launcher.java:409) >>> at org.codehaus.plexus.classworlds.launcher.Launcher. >>> main(Launcher.java:352) >>> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution >>> scala-compile-first of goal >>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>> failed. >>> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo( >>> DefaultBuildPluginManager.java:110) >>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute( >>> MojoExecutor.java:209) >>> ... 19 more >>> Caused by: Compile failed via zinc server >>> at sbt_inc.SbtIncrementalCompiler.zincCompile( >>> SbtIncrementalCompiler.java:136) >>> at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java: >>> 86) >>> at scala_maven.ScalaCompilerSupport.incrementalCompile( >>> ScalaCompilerSupport.java:303) >>> at scala_maven.ScalaCompilerSupport.compile( >>> ScalaCompilerSupport.java:119) >>> at scala_maven.ScalaCompilerSupport.doExecute( >>> ScalaCompilerSupport.java:99) >>> at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482) >>> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo( >>> DefaultBuildPluginManager.java:101) >>> ... 20 more >>> [ERROR] >>> [ERROR] >>> [ERROR] For more information about the errors and possible solutions, >>> please read the following articles: >>> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ >>> PluginExecutionException >>> [ERROR] >>> [ERROR] After correcting the problems, you can resume the build with the >>> command >>> [ERROR] mvn <goals> -rf :spark-sql_2.11 >>> >>> >>> On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <divya.htco...@gmail.com> >>> wrote: >>> >>>> Which java version are you using ? >>>> >>>> On 31 August 2016 at 04:30, Diwakar Dhanuskodi < >>>> diwakar.dhanusk...@gmail.com> wrote: >>>> >>>>> Hi, >>>>> >>>>> While building Spark 1.6.2 , getting below error in spark-sql. Much >>>>> appreciate for any help. >>>>> >>>>> ERROR] missing or invalid dependency detected while loading class file >>>>> 'WebUI.class'. >>>>> Could not access term eclipse in package org, >>>>> because it (or its dependencies) are missing. Check your build >>>>> definition for >>>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to >>>>> see the problematic classpath.) >>>>> A full rebuild may help if 'WebUI.class' was compiled against an >>>>> incompatible version of org. >>>>> [ERROR] missing or invalid dependency detected while loading class >>>>> file 'WebUI.class'. >>>>> Could not access term jetty in value org.eclipse, >>>>> because it (or its dependencies) are missing. Check your build >>>>> definition for >>>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to >>>>> see the problematic classpath.) >>>>> A full rebuild may help if 'WebUI.class' was compiled against an >>>>> incompatible version of org.eclipse. >>>>> [WARNING] 17 warnings found >>>>> [ERROR] two errors found >>>>> [INFO] ------------------------------------------------------------ >>>>> ------------ >>>>> [INFO] Reactor Summary: >>>>> [INFO] >>>>> [INFO] Spark Project Parent POM .......................... SUCCESS >>>>> [4.399s] >>>>> [INFO] Spark Project Test Tags ........................... SUCCESS >>>>> [3.443s] >>>>> [INFO] Spark Project Launcher ............................ SUCCESS >>>>> [10.131s] >>>>> [INFO] Spark Project Networking .......................... SUCCESS >>>>> [11.849s] >>>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS >>>>> [6.641s] >>>>> [INFO] Spark Project Unsafe .............................. SUCCESS >>>>> [19.765s] >>>>> [INFO] Spark Project Core ................................ SUCCESS >>>>> [4:16.511s] >>>>> [INFO] Spark Project Bagel ............................... SUCCESS >>>>> [13.401s] >>>>> [INFO] Spark Project GraphX .............................. SUCCESS >>>>> [1:08.824s] >>>>> [INFO] Spark Project Streaming ........................... SUCCESS >>>>> [2:18.844s] >>>>> [INFO] Spark Project Catalyst ............................ SUCCESS >>>>> [2:43.695s] >>>>> [INFO] Spark Project SQL ................................. FAILURE >>>>> [1:01.762s] >>>>> [INFO] Spark Project ML Library .......................... SKIPPED >>>>> [INFO] Spark Project Tools ............................... SKIPPED >>>>> [INFO] Spark Project Hive ................................ SKIPPED >>>>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED >>>>> [INFO] Spark Project REPL ................................ SKIPPED >>>>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED >>>>> [INFO] Spark Project YARN ................................ SKIPPED >>>>> [INFO] Spark Project Assembly ............................ SKIPPED >>>>> [INFO] Spark Project External Twitter .................... SKIPPED >>>>> [INFO] Spark Project External Flume Sink ................. SKIPPED >>>>> [INFO] Spark Project External Flume ...................... SKIPPED >>>>> [INFO] Spark Project External Flume Assembly ............. SKIPPED >>>>> [INFO] Spark Project External MQTT ....................... SKIPPED >>>>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED >>>>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED >>>>> [INFO] Spark Project External Kafka ...................... SKIPPED >>>>> [INFO] Spark Project Examples ............................ SKIPPED >>>>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED >>>>> [INFO] ------------------------------------------------------------ >>>>> ------------ >>>>> [INFO] BUILD FAILURE >>>>> [INFO] ------------------------------------------------------------ >>>>> ------------ >>>>> [INFO] Total time: 12:40.525s >>>>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016 >>>>> [INFO] Final Memory: 71M/830M >>>>> [INFO] ------------------------------------------------------------ >>>>> ------------ >>>>> [ERROR] Failed to execute goal >>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>>>> (scala-compile-first) on project spark-sql_2.11: Execution >>>>> scala-compile-first of goal >>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >>>>> failed. CompileFailed -> [Help 1] >>>>> [ERROR] >>>>> [ERROR] To see the full stack trace of the errors, re-run Maven with >>>>> the -e switch. >>>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>>>> [ERROR] >>>>> [ERROR] For more information about the errors and possible solutions, >>>>> please read the following articles: >>>>> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ >>>>> PluginExecutionException >>>>> [ERROR] >>>>> [ERROR] After correcting the problems, you can resume the build with >>>>> the command >>>>> [ERROR] mvn <goals> -rf :spark-sql_2.11 >>>>> >>>>> >>>>> >>>> >>> >>
