Hi, java version 7
mvn command ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 yes, I executed script to change scala version to 2.11 killed "com.typesafe zinc.Nailgun" process re-ran mvn with below command again ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11 Getting same error [warn] /home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala:911: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information. [warn] status.isDir, [warn] ^ [error] missing or invalid dependency detected while loading class file 'WebUI.class'. [error] Could not access term eclipse in package org, [error] because it (or its dependencies) are missing. Check your build definition for [error] missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.) [error] A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org. [error] missing or invalid dependency detected while loading class file 'WebUI.class'. [error] Could not access term jetty in value org.eclipse, [error] because it (or its dependencies) are missing. Check your build definition for [error] missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.) [error] A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.eclipse. [warn] 17 warnings found [error] two errors found [debug] Compilation failed (CompilerInterface) [error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s] [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM .......................... SUCCESS [5.583s] [INFO] Spark Project Test Tags ........................... SUCCESS [4.189s] [INFO] Spark Project Launcher ............................ SUCCESS [12.226s] [INFO] Spark Project Networking .......................... SUCCESS [13.386s] [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.723s] [INFO] Spark Project Unsafe .............................. SUCCESS [21.231s] [INFO] Spark Project Core ................................ SUCCESS [3:46.334s] [INFO] Spark Project Bagel ............................... SUCCESS [7.032s] [INFO] Spark Project GraphX .............................. SUCCESS [19.558s] [INFO] Spark Project Streaming ........................... SUCCESS [50.452s] [INFO] Spark Project Catalyst ............................ SUCCESS [1:14.172s] [INFO] Spark Project SQL ................................. FAILURE [23.222s] [INFO] Spark Project ML Library .......................... SKIPPED [INFO] Spark Project Tools ............................... SKIPPED [INFO] Spark Project Hive ................................ SKIPPED [INFO] Spark Project Docker Integration Tests ............ SKIPPED [INFO] Spark Project REPL ................................ SKIPPED [INFO] Spark Project YARN Shuffle Service ................ SKIPPED [INFO] Spark Project YARN ................................ SKIPPED [INFO] Spark Project Assembly ............................ SKIPPED [INFO] Spark Project External Twitter .................... SKIPPED [INFO] Spark Project External Flume Sink ................. SKIPPED [INFO] Spark Project External Flume ...................... SKIPPED [INFO] Spark Project External Flume Assembly ............. SKIPPED [INFO] Spark Project External MQTT ....................... SKIPPED [INFO] Spark Project External MQTT Assembly .............. SKIPPED [INFO] Spark Project External ZeroMQ ..................... SKIPPED [INFO] Spark Project External Kafka ...................... SKIPPED [INFO] Spark Project Examples ............................ SKIPPED [INFO] Spark Project External Kafka Assembly ............. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 7:45.641s [INFO] Finished at: Sat Sep 03 11:28:34 IST 2016 [INFO] Final Memory: 49M/415M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project spark-sql_2.11: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project spark-sql_2.11: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) Caused by: org.apache.maven.plugin.PluginExecutionException: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209) ... 19 more Caused by: Compile failed via zinc server at sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:136) at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86) at scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303) at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119) at scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99) at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101) ... 20 more [ERROR] [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :spark-sql_2.11 On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <divya.htco...@gmail.com> wrote: > Which java version are you using ? > > On 31 August 2016 at 04:30, Diwakar Dhanuskodi < > diwakar.dhanusk...@gmail.com> wrote: > >> Hi, >> >> While building Spark 1.6.2 , getting below error in spark-sql. Much >> appreciate for any help. >> >> ERROR] missing or invalid dependency detected while loading class file >> 'WebUI.class'. >> Could not access term eclipse in package org, >> because it (or its dependencies) are missing. Check your build definition >> for >> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to >> see the problematic classpath.) >> A full rebuild may help if 'WebUI.class' was compiled against an >> incompatible version of org. >> [ERROR] missing or invalid dependency detected while loading class file >> 'WebUI.class'. >> Could not access term jetty in value org.eclipse, >> because it (or its dependencies) are missing. Check your build definition >> for >> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to >> see the problematic classpath.) >> A full rebuild may help if 'WebUI.class' was compiled against an >> incompatible version of org.eclipse. >> [WARNING] 17 warnings found >> [ERROR] two errors found >> [INFO] ------------------------------------------------------------ >> ------------ >> [INFO] Reactor Summary: >> [INFO] >> [INFO] Spark Project Parent POM .......................... SUCCESS >> [4.399s] >> [INFO] Spark Project Test Tags ........................... SUCCESS >> [3.443s] >> [INFO] Spark Project Launcher ............................ SUCCESS >> [10.131s] >> [INFO] Spark Project Networking .......................... SUCCESS >> [11.849s] >> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS >> [6.641s] >> [INFO] Spark Project Unsafe .............................. SUCCESS >> [19.765s] >> [INFO] Spark Project Core ................................ SUCCESS >> [4:16.511s] >> [INFO] Spark Project Bagel ............................... SUCCESS >> [13.401s] >> [INFO] Spark Project GraphX .............................. SUCCESS >> [1:08.824s] >> [INFO] Spark Project Streaming ........................... SUCCESS >> [2:18.844s] >> [INFO] Spark Project Catalyst ............................ SUCCESS >> [2:43.695s] >> [INFO] Spark Project SQL ................................. FAILURE >> [1:01.762s] >> [INFO] Spark Project ML Library .......................... SKIPPED >> [INFO] Spark Project Tools ............................... SKIPPED >> [INFO] Spark Project Hive ................................ SKIPPED >> [INFO] Spark Project Docker Integration Tests ............ SKIPPED >> [INFO] Spark Project REPL ................................ SKIPPED >> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED >> [INFO] Spark Project YARN ................................ SKIPPED >> [INFO] Spark Project Assembly ............................ SKIPPED >> [INFO] Spark Project External Twitter .................... SKIPPED >> [INFO] Spark Project External Flume Sink ................. SKIPPED >> [INFO] Spark Project External Flume ...................... SKIPPED >> [INFO] Spark Project External Flume Assembly ............. SKIPPED >> [INFO] Spark Project External MQTT ....................... SKIPPED >> [INFO] Spark Project External MQTT Assembly .............. SKIPPED >> [INFO] Spark Project External ZeroMQ ..................... SKIPPED >> [INFO] Spark Project External Kafka ...................... SKIPPED >> [INFO] Spark Project Examples ............................ SKIPPED >> [INFO] Spark Project External Kafka Assembly ............. SKIPPED >> [INFO] ------------------------------------------------------------ >> ------------ >> [INFO] BUILD FAILURE >> [INFO] ------------------------------------------------------------ >> ------------ >> [INFO] Total time: 12:40.525s >> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016 >> [INFO] Final Memory: 71M/830M >> [INFO] ------------------------------------------------------------ >> ------------ >> [ERROR] Failed to execute goal >> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >> (scala-compile-first) on project spark-sql_2.11: Execution >> scala-compile-first of goal >> net.alchim31.maven:scala-maven-plugin:3.2.2:compile >> failed. CompileFailed -> [Help 1] >> [ERROR] >> [ERROR] To see the full stack trace of the errors, re-run Maven with the >> -e switch. >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> [ERROR] >> [ERROR] For more information about the errors and possible solutions, >> please read the following articles: >> [ERROR] [Help 1] http://cwiki.apache.org/conflu >> ence/display/MAVEN/PluginExecutionException >> [ERROR] >> [ERROR] After correcting the problems, you can resume the build with the >> command >> [ERROR] mvn <goals> -rf :spark-sql_2.11 >> >> >> >
