No, i am running from the root directory, parent of core. Here is the first set of errors that i see when i compile from source (sorry the error message is very long, but adding it in case it helps in diagnosis). After i manually add javax.servlet dependency for version 3.0, these set of errors go away and i get the next set of errors about missing classes under eclipse-jetty.
I am on maven 3.2.5 and java 1.7. Error: [INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-core_2.10 --- [WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile [INFO] Using incremental compilation [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null) [INFO] Compiling 403 Scala sources and 33 Java sources to /Users/mchettiar/code/spark/core/target/scala-2.10/classes... [WARNING] Class javax.servlet.ServletException not found - continuing with a stub. [ERROR] while compiling: /Users/mchettiar/code/spark/core/src/main/scala/org/apache/spark/HttpServer.scala during phase: typer library version: version 2.10.4 compiler version: version 2.10.4 reconstructed args: -deprecation -feature -Xplugin:/Users/mchettiar/.m2/repository/org/scalamacros/paradise_2.10.4/2.0.1/paradise_2.10.4-2.0.1.jar -bootclasspath /Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre/lib/sunrsasign.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_75.jdk/Contents/Home/jre/classes:/Users/mchettiar/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar -classpath /Users/mchettiar/code/spark/core/target/scala-2.10/classes:/Users/mchettiar/.m2/repository/com/twitter/chill_2.10/0.5.0/chill_2.10-0.5.0.jar:/Users/mchettiar/.m2/repository/com/esotericsoftware/kryo/kryo/2.21/kryo-2.21.jar:/Users/mchettiar/.m2/repository/com/esotericsoftware/reflectasm/reflectasm/1.07/reflectasm-1.07-shaded.jar:/Users/mchettiar/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/Users/mchettiar/.m2/repository/org/objenesis/objenesis/1.2/objenesis-1.2.jar:/Users/mchettiar/.m2/repository/com/twitter/chill-java/0.5.0/chill-java-0.5.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-client/2.4.0/hadoop-client-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-common/2.4.0/hadoop-common-2.4.0.jar:/Users/mchettiar/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/Users/mchettiar/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/mchettiar/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/Users/mchettiar/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/Users/mchettiar/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/Users/mchettiar/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/Users/mchettiar/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/Users/mchettiar/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/Users/mchettiar/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/Users/mchettiar/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/mchettiar/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.8.8/jackson-core-asl-1.8.8.jar:/Users/mchettiar/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/Users/mchettiar/.m2/repository/org/apache/avro/avro/1.7.6/avro-1.7.6.jar:/Users/mchettiar/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-auth/2.4.0/hadoop-auth-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/Users/mchettiar/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.0/hadoop-hdfs-2.4.0.jar:/Users/mchettiar/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.4.0/hadoop-mapreduce-client-app-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.4.0/hadoop-mapreduce-client-common-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.4.0/hadoop-yarn-client-2.4.0.jar:/Users/mchettiar/.m2/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.4.0/hadoop-yarn-server-common-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.4.0/hadoop-mapreduce-client-shuffle-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.4.0/hadoop-yarn-api-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.4.0/hadoop-mapreduce-client-core-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.4.0/hadoop-yarn-common-2.4.0.jar:/Users/mchettiar/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/mchettiar/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/mchettiar/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/Users/mchettiar/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.0/hadoop-mapreduce-client-jobclient-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/hadoop/hadoop-annotations/2.4.0/hadoop-annotations-2.4.0.jar:/Users/mchettiar/code/spark/network/common/target/spark-network-common_2.10-1.2.2-SNAPSHOT.jar:/Users/mchettiar/code/spark/network/shuffle/target/spark-network-shuffle_2.10-1.2.2-SNAPSHOT.jar:/Users/mchettiar/.m2/repository/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar:/Users/mchettiar/.m2/repository/commons-codec/commons-codec/1.5/commons-codec-1.5.jar:/Users/mchettiar/.m2/repository/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.jar:/Users/mchettiar/.m2/repository/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.jar:/Users/mchettiar/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar:/Users/mchettiar/.m2/repository/org/apache/curator/curator-recipes/2.4.0/curator-recipes-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/curator/curator-framework/2.4.0/curator-framework-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/curator/curator-client/2.4.0/curator-client-2.4.0.jar:/Users/mchettiar/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar:/Users/mchettiar/.m2/repository/jline/jline/0.9.94/jline-0.9.94.jar:/Users/mchettiar/.m2/repository/org/eclipse/jetty/jetty-plus/8.1.14.v20131031/jetty-plus-8.1.14.v20131031.jar:/Users/mchettiar/.m2/repository/org/eclipse/jetty/orbit/javax.transaction/1.1.1.v201105210645/javax.transaction-1.1.1.v201105210645.jar:/Users/mchettiar/.m2/repository/org/eclipse/jetty/jetty-webapp/8.1.14.v20131031/jetty-webapp-8.1.14.v20131031.jar:/Users/mchettiar/.m2/repository/org/eclipse/jetty/jetty-jndi/8.1.14.v20131031/jetty-jndi-8.1.14.v20131031.jar:/Users/mchettiar/.m2/repository/org/eclipse/jetty/orbit/javax.mail.glassfish/1.4.1.v201005082020/javax.mail.glassfish-1.4.1.v201005082020.jar:/Users/mchettiar/.m2/repository/org/eclipse/jetty/orbit/javax.activation/1.1.0.v201105071233/javax.activation-1.1.0.v201105071233.jar:/Users/mchettiar/.m2/repository/org/eclipse/jetty/jetty-security/8.1.14.v20131031/jetty-security-8.1.14.v20131031.jar:/Users/mchettiar/.m2/repository/org/eclipse/jetty/jetty-util/8.1.14.v20131031/jetty-util-8.1.14.v20131031.jar:/Users/mchettiar/.m2/repository/org/eclipse/jetty/jetty-server/8.1.14.v20131031/jetty-server-8.1.14.v20131031.jar:/Users/mchettiar/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/Users/mchettiar/.m2/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/Users/mchettiar/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/mchettiar/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Users/mchettiar/.m2/repository/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar:/Users/mchettiar/.m2/repository/org/slf4j/jul-to-slf4j/1.7.5/jul-to-slf4j-1.7.5.jar:/Users/mchettiar/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.5/jcl-over-slf4j-1.7.5.jar:/Users/mchettiar/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/mchettiar/.m2/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar:/Users/mchettiar/.m2/repository/com/ning/compress-lzf/1.0.0/compress-lzf-1.0.0.jar:/Users/mchettiar/.m2/repository/org/xerial/snappy/snappy-java/ 1.1.1.6/snappy-java-1.1.1.6.jar:/Users/mchettiar/.m2/repository/net/jpountz/lz4/lz4/1.2.0/lz4-1.2.0.jar:/Users/mchettiar/.m2/repository/org/roaringbitmap/RoaringBitmap/0.4.5/RoaringBitmap-0.4.5.jar:/Users/mchettiar/.m2/repository/commons-net/commons-net/2.2/commons-net-2.2.jar:/Users/mchettiar/.m2/repository/org/spark-project/akka/akka-remote_2.10/2.3.4-spark/akka-remote_2.10-2.3.4-spark.jar:/Users/mchettiar/.m2/repository/org/spark-project/akka/akka-actor_2.10/2.3.4-spark/akka-actor_2.10-2.3.4-spark.jar:/Users/mchettiar/.m2/repository/com/typesafe/config/1.2.1/config-1.2.1.jar:/Users/mchettiar/.m2/repository/io/netty/netty/3.8.0.Final/netty-3.8.0.Final.jar:/Users/mchettiar/.m2/repository/org/spark-project/protobuf/protobuf-java/2.5.0-spark/protobuf-java-2.5.0-spark.jar:/Users/mchettiar/.m2/repository/org/uncommons/maths/uncommons-maths/1.2.2a/uncommons-maths-1.2.2a.jar:/Users/mchettiar/.m2/repository/org/spark-project/akka/akka-slf4j_2.10/2.3.4-spark/akka-slf4j_2.10-2.3.4-spark.jar:/Users/mchettiar/.m2/repository/org/json4s/json4s-jackson_2.10/3.2.10/json4s-jackson_2.10-3.2.10.jar:/Users/mchettiar/.m2/repository/org/json4s/json4s-core_2.10/3.2.10/json4s-core_2.10-3.2.10.jar:/Users/mchettiar/.m2/repository/org/json4s/json4s-ast_2.10/3.2.10/json4s-ast_2.10-3.2.10.jar:/Users/mchettiar/.m2/repository/com/thoughtworks/paranamer/paranamer/2.6/paranamer-2.6.jar:/Users/mchettiar/.m2/repository/org/scala-lang/scalap/2.10.4/scalap-2.10.4.jar:/Users/mchettiar/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar:/Users/mchettiar/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.3.1/jackson-databind-2.3.1.jar:/Users/mchettiar/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.3.0/jackson-annotations-2.3.0.jar:/Users/mchettiar/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.3.1/jackson-core-2.3.1.jar:/Users/mchettiar/.m2/repository/org/apache/mesos/mesos/0.18.1/mesos-0.18.1-shaded-protobuf.jar:/Users/mchettiar/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/Users/mchettiar/.m2/repository/com/clearspring/analytics/stream/2.7.0/stream-2.7.0.jar:/Users/mchettiar/.m2/repository/com/codahale/metrics/metrics-core/3.0.0/metrics-core-3.0.0.jar:/Users/mchettiar/.m2/repository/com/codahale/metrics/metrics-jvm/3.0.0/metrics-jvm-3.0.0.jar:/Users/mchettiar/.m2/repository/com/codahale/metrics/metrics-json/3.0.0/metrics-json-3.0.0.jar:/Users/mchettiar/.m2/repository/com/codahale/metrics/metrics-graphite/3.0.0/metrics-graphite-3.0.0.jar:/Users/mchettiar/.m2/repository/org/tachyonproject/tachyon-client/0.5.0/tachyon-client-0.5.0.jar:/Users/mchettiar/.m2/repository/org/tachyonproject/tachyon/0.5.0/tachyon-0.5.0.jar:/Users/mchettiar/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar:/Users/mchettiar/.m2/repository/org/spark-project/pyrolite/2.0.1/pyrolite-2.0.1.jar:/Users/mchettiar/.m2/repository/net/sf/py4j/py4j/0.8.2.1/py4j-0.8.2.1.jar:/Users/mchettiar/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/Users/mchettiar/.m2/repository/org/codehaus/groovy/groovy-all/2.3.7/groovy-all-2.3.7.jar -unchecked last tree to typer: Ident(Server) symbol: <none> (flags: ) symbol definition: <none> symbol owners: context owners: variable server -> class HttpServer -> package spark == Enclosing template or block == Template( // val <local HttpServer>: <notype> in class HttpServer "org.apache.spark.Logging" // parents ValDef( private "_" <tpt> <empty> ) // 13 statements ValDef( // private[this] val conf: <?> in class HttpServer private <local> <paramaccessor> "conf" "SparkConf" <empty> ) ValDef( // private[this] val resourceBase: <?> in class HttpServer private <local> <paramaccessor> "resourceBase" "File" <empty> ) ValDef( // private[this] val securityManager: <?> in class HttpServer private <local> <paramaccessor> "securityManager" "SecurityManager" <empty> ) ValDef( // private[this] val requestedPort: <?> in class HttpServer private <local> <paramaccessor> "requestedPort" "Int" <empty> ) ValDef( // private[this] val serverName: <?> in class HttpServer private <local> <paramaccessor> "serverName" "String" <empty> ) DefDef( // def <init>(conf: org.apache.spark.SparkConf,resourceBase: java.io.File,securityManager: org.apache.spark.SecurityManager,requestedPort: Int,serverName: String): org.apache.spark.HttpServer in class HttpServer <method> <triedcooking> "<init>" [] // 1 parameter list ValDef( // conf: org.apache.spark.SparkConf <param> <paramaccessor> "conf" "SparkConf" // class SparkConf extends Cloneable with Logging in package spark, tree.tpe=org.apache.spark.SparkConf <empty> ) ValDef( // resourceBase: java.io.File <param> <paramaccessor> "resourceBase" "File" <empty> ) ValDef( // securityManager: org.apache.spark.SecurityManager <param> <paramaccessor> "securityManager" "SecurityManager" // private[package spark] class SecurityManager extends Logging with SecretKeyHolder in package spark, tree.tpe=org.apache.spark.SecurityManager <empty> ) ValDef( // requestedPort: Int <param> <defaultparam/trait> <paramaccessor> "requestedPort" "Int" 0 ) ValDef( // serverName: String <param> <defaultparam/trait> <paramaccessor> "serverName" "String" "HTTP server" ) <tpt> // tree.tpe=org.apache.spark.HttpServer Block( Apply( super."<init>" Nil ) () ) ) ValDef( // private[this] var server: <?> in class HttpServer private <mutable> <local> "server" "Server" null ) ValDef( // private[this] var port: <?> in class HttpServer private <mutable> <local> "port" "Int" "requestedPort" ) DefDef( // def start(): Unit in class HttpServer <method> <triedcooking> "start" [] List(Nil) "scala"."Unit" // final abstract class Unit extends AnyVal in package scala, tree.tpe=Unit If( Apply( "server"."$bang$eq" null ) Throw( Apply( new ServerStateException."<init>" "Server is already started" ) ) Block( // 5 statements Apply( "logInfo" "Starting HTTP Server" ) ValDef( private <local> <synthetic> "x$1" <tpt> Match( Annotated( Apply( new scala.unchecked."<init>" Nil ) Apply( TypeApply( "Utils"."startServiceOnPort" "Server" ) // 4 arguments "requestedPort" "doStart" "conf" "serverName" ) ) CaseDef( Apply( "scala"."Tuple2" // 2 arguments Bind( "actualServer" "_" ) Bind( "actualPort" "_" ) ) Apply( "scala"."Tuple2" // 2 arguments "actualServer" "actualPort" ) ) ) ) ValDef( 0 "actualServer" <tpt> "x$1"."_1" ) ValDef( 0 "actualPort" <tpt> "x$1"."_2" ) Assign( "server" "actualServer" ) Assign( "port" "actualPort" ) ) ) ) DefDef( // private def doStart: <?> in class HttpServer <method> private "doStart" [] // 1 parameter list ValDef( <param> "startPort" "Int" <empty> ) AppliedTypeTree( "scala"."Tuple2" // 2 arguments "Server" "Int" ) Block( // 16 statements ValDef( 0 "server" <tpt> Apply( new Server."<init>" Nil ) ) ValDef( 0 "connector" <tpt> Apply( new SocketConnector."<init>" Nil ) ) Apply( "connector"."setMaxIdleTime" Apply( 60."$times" 1000 ) ) Apply( "connector"."setSoLingerTime" -1 ) Apply( "connector"."setPort" "startPort" ) Apply( "server"."addConnector" "connector" ) ValDef( 0 "threadPool" <tpt> Apply( new QueuedThreadPool."<init>" Nil ) ) Apply( "threadPool"."setDaemon" true ) Apply( "server"."setThreadPool" "threadPool" ) ValDef( 0 "resHandler" <tpt> Apply( new ResourceHandler."<init>" Nil ) ) Apply( "resHandler"."setResourceBase" "resourceBase"."getAbsolutePath" ) ValDef( 0 "handlerList" <tpt> Apply( new HandlerList."<init>" Nil ) ) Apply( "handlerList"."setHandlers" Apply( "Array" // 2 arguments "resHandler" Apply( new DefaultHandler."<init>" Nil ) ) ) If( Apply( "securityManager"."isAuthenticationEnabled" Nil ) Block( // 3 statements Apply( "logDebug" "HttpServer is using security" ) ValDef( 0 "sh" <tpt> Apply( "setupSecurityHandler" "securityManager" ) ) Apply( "sh"."setHandler" "handlerList" ) Apply( "server"."setHandler" "sh" ) ) Block( Apply( "logDebug" "HttpServer is not using security" ) Apply( "server"."setHandler" "handlerList" ) ) ) Apply( "server"."start" Nil ) ValDef( 0 "actualPort" <tpt> server.getConnectors()(0)."getLocalPort" ) Apply( "scala"."Tuple2" // 2 arguments "server" "actualPort" ) ) ) DefDef( // private def setupSecurityHandler: <?> in class HttpServer <method> private "setupSecurityHandler" [] // 1 parameter list ValDef( <param> "securityMgr" "SecurityManager" <empty> ) "ConstraintSecurityHandler" Block( // 16 statements ValDef( 0 "constraint" <tpt> Apply( new Constraint."<init>" Nil ) ) Apply( "constraint"."setName" "Constraint"."__DIGEST_AUTH" ) Apply( "constraint"."setRoles" Apply( "Array" "user" ) ) Apply( "constraint"."setAuthenticate" true ) Apply( "constraint"."setDataConstraint" "Constraint"."DC_NONE" ) ValDef( 0 "cm" <tpt> Apply( new ConstraintMapping."<init>" Nil ) ) Apply( "cm"."setConstraint" "constraint" ) Apply( "cm"."setPathSpec" "/*" ) ValDef( 0 "sh" <tpt> Apply( new ConstraintSecurityHandler."<init>" Nil ) ) ValDef( 0 "hashLogin" <tpt> Apply( new HashLoginService."<init>" Nil ) ) ValDef( 0 "userCred" <tpt> Apply( new Password."<init>" Apply( "securityMgr"."getSecretKey" Nil ) ) ) If( Apply( "userCred"."$eq$eq" null ) Throw( Apply( new Exception."<init>" "Error: secret key is null with authentication on" ) ) () ) Apply( "hashLogin"."putUser" // 3 arguments Apply( "securityMgr"."getHttpUser" Nil ) "userCred" Apply( "Array" "user" ) ) Apply( "sh"."setLoginService" "hashLogin" ) Apply( "sh"."setAuthenticator" Apply( new DigestAuthenticator."<init>" Nil ) ) Apply( "sh"."setConstraintMappings" Apply( "Array" "cm" ) ) "sh" ) ) DefDef( // def stop(): Unit in class HttpServer <method> <triedcooking> "stop" [] List(Nil) "scala"."Unit" // final abstract class Unit extends AnyVal in package scala, tree.tpe=Unit If( Apply( "server"."$eq$eq" null ) Throw( Apply( new ServerStateException."<init>" "Server is already stopped" ) ) Block( // 2 statements Apply( "server"."stop" Nil ) Assign( "port" -1 ) Assign( "server" null ) ) ) ) DefDef( // def uri: String in class HttpServer <method> <triedcooking> "uri" [] Nil "String" If( Apply( "server"."$eq$eq" null ) Throw( Apply( new ServerStateException."<init>" "Server is not started" ) ) Apply( "http://".$plus(Utils.localIpAddress).$plus(":")."$plus" "port" ) ) ) ) uncaught exception during compilation: java.lang.AssertionError [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM ........................... SUCCESS [ 4.306 s] [INFO] Spark Project Networking ........................... SUCCESS [ 6.978 s] [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 5.273 s] [INFO] Spark Project Core ................................. SKIPPED [INFO] Spark Project Bagel ................................ SKIPPED [INFO] Spark Project GraphX ............................... SKIPPED [INFO] Spark Project Streaming ............................ SKIPPED [INFO] Spark Project Catalyst ............................. SKIPPED [INFO] Spark Project SQL .................................. SKIPPED [INFO] Spark Project ML Library ........................... SKIPPED [INFO] Spark Project Tools ................................ SKIPPED [INFO] Spark Project Hive ................................. SKIPPED [INFO] Spark Project REPL ................................. SKIPPED [INFO] Spark Project YARN Parent POM ...................... SKIPPED [INFO] Spark Project YARN Stable API ...................... SKIPPED [INFO] Spark Project Hive Thrift Server ................... SKIPPED [INFO] Spark Project Assembly ............................. SKIPPED [INFO] Spark Project External Twitter ..................... SKIPPED [INFO] Spark Project External Flume Sink .................. SKIPPED [INFO] Spark Project External Flume ....................... SKIPPED [INFO] Spark Project External MQTT ........................ SKIPPED [INFO] Spark Project External ZeroMQ ...................... SKIPPED [INFO] Spark Project External Kafka ....................... SKIPPED [INFO] Spark Project Examples ............................. SKIPPED [INFO] Spark Project YARN Shuffle Service ................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 33.464 s [INFO] Finished at: 2015-03-27T12:01:56-07:00 [INFO] Final Memory: 58M/541M [INFO] ------------------------------------------------------------------------ --------------------------------------------------- constituent[0]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/aether-api-1.0.0.v20140518.jar constituent[1]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/aether-connector-basic-1.0.0.v20140518.jar constituent[2]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/aether-impl-1.0.0.v20140518.jar constituent[3]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/aether-spi-1.0.0.v20140518.jar constituent[4]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/aether-transport-wagon-1.0.0.v20140518.jar constituent[5]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/aether-util-1.0.0.v20140518.jar constituent[6]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/aopalliance-1.0.jar constituent[7]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/cdi-api-1.0.jar constituent[8]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/commons-cli-1.2.jar constituent[9]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/commons-io-2.2.jar constituent[10]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/commons-lang-2.6.jar constituent[11]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/guava-18.0.jar constituent[12]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/javax.inject-1.jar constituent[13]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/jsoup-1.7.2.jar constituent[14]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/jsr250-api-1.0.jar constituent[15]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-aether-provider-3.2.5.jar constituent[16]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-artifact-3.2.5.jar constituent[17]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-compat-3.2.5.jar constituent[18]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-core-3.2.5.jar constituent[19]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-embedder-3.2.5.jar constituent[20]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-model-3.2.5.jar constituent[21]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-model-builder-3.2.5.jar constituent[22]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-plugin-api-3.2.5.jar constituent[23]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-repository-metadata-3.2.5.jar constituent[24]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-settings-3.2.5.jar constituent[25]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/maven-settings-builder-3.2.5.jar constituent[26]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/org.eclipse.sisu.inject-0.3.0.M1.jar constituent[27]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/org.eclipse.sisu.plexus-0.3.0.M1.jar constituent[28]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/plexus-cipher-1.7.jar constituent[29]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/plexus-component-annotations-1.5.5.jar constituent[30]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/plexus-interpolation-1.21.jar constituent[31]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/plexus-sec-dispatcher-1.3.jar constituent[32]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/plexus-utils-3.0.20.jar constituent[33]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/sisu-guice-3.2.3-no_aop.jar constituent[34]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/slf4j-api-1.7.5.jar constituent[35]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/slf4j-simple-1.7.5.jar constituent[36]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/wagon-file-2.8.jar constituent[37]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/wagon-http-2.8-shaded.jar constituent[38]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/wagon-http-shared-2.8.jar constituent[39]: file:/usr/local/Cellar/maven/3.2.5/libexec/lib/wagon-provider-api-2.8.jar constituent[40]: file:/usr/local/Cellar/maven/3.2.5/libexec/conf/logging/ --------------------------------------------------- Exception in thread "main" java.lang.AssertionError: assertion failed: javax.servlet.ServletException at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1212) at scala.reflect.internal.Symbols$Symbol.initialize(Symbols.scala:1374) at scala.tools.nsc.symtab.classfile.ClassfileParser.parseExceptions$1(ClassfileParser.scala:1051) at scala.tools.nsc.symtab.classfile.ClassfileParser.scala$tools$nsc$symtab$classfile$ClassfileParser$$parseAttribute$1(ClassfileParser.scala:920) at scala.tools.nsc.symtab.classfile.ClassfileParser.parseAttributes(ClassfileParser.scala:1080) at scala.tools.nsc.symtab.classfile.ClassfileParser.parseMethod(ClassfileParser.scala:666) at scala.tools.nsc.symtab.classfile.ClassfileParser.scala$tools$nsc$symtab$classfile$ClassfileParser$$queueLoad$1(ClassfileParser.scala:557) at scala.tools.nsc.symtab.classfile.ClassfileParser$$anonfun$parseClass$1.apply$mcV$sp(ClassfileParser.scala:567) at scala.tools.nsc.symtab.classfile.ClassfileParser.parseClass(ClassfileParser.scala:572) at scala.tools.nsc.symtab.classfile.ClassfileParser.parse(ClassfileParser.scala:88) at scala.tools.nsc.symtab.SymbolLoaders$ClassfileLoader.doComplete(SymbolLoaders.scala:261) at scala.tools.nsc.symtab.SymbolLoaders$SymbolLoader.complete(SymbolLoaders.scala:194) at scala.tools.nsc.symtab.SymbolLoaders$SymbolLoader.load(SymbolLoaders.scala:210) at scala.reflect.internal.Symbols$Symbol.exists(Symbols.scala:893) at scala.tools.nsc.typechecker.Typers$Typer.typedIdent$2(Typers.scala:5064) at scala.tools.nsc.typechecker.Typers$Typer.typedIdentOrWildcard$1(Typers.scala:5218) at scala.tools.nsc.typechecker.Typers$Typer.typed1(Typers.scala:5561) at org.scalamacros.paradise.typechecker.Analyzer$$anon$1.org $scalamacros$paradise$typechecker$Typers$ParadiseTyper$$super$typed1(Analyzer.scala:19) at org.scalamacros.paradise.typechecker.Typers$ParadiseTyper$class.typed1(Typers.scala:44) at org.scalamacros.paradise.typechecker.Analyzer$$anon$1.typed1(Analyzer.scala:19) at scala.tools.nsc.typechecker.Typers$Typer.typed(Typers.scala:5642) at scala.tools.nsc.typechecker.Typers$Typer.typedType(Typers.scala:5769) at scala.tools.nsc.typechecker.Typers$Typer.typedType(Typers.scala:5772) at scala.tools.nsc.typechecker.Namers$Namer.valDefSig(Namers.scala:1317) at scala.tools.nsc.typechecker.Namers$Namer.getSig$1(Namers.scala:1457) at scala.tools.nsc.typechecker.Namers$Namer.typeSig(Namers.scala:1466) at scala.tools.nsc.typechecker.Namers$Namer$$anonfun$monoTypeCompleter$1$$anonfun$apply$1.apply$mcV$sp(Namers.scala:731) at scala.tools.nsc.typechecker.Namers$Namer$$anonfun$monoTypeCompleter$1$$anonfun$apply$1.apply(Namers.scala:730) at scala.tools.nsc.typechecker.Namers$Namer$$anonfun$monoTypeCompleter$1$$anonfun$apply$1.apply(Namers.scala:730) at scala.tools.nsc.typechecker.Namers$Namer.scala$tools$nsc$typechecker$Namers$Namer$$logAndValidate(Namers.scala:1499) at scala.tools.nsc.typechecker.Namers$Namer$$anonfun$monoTypeCompleter$1.apply(Namers.scala:730) at scala.tools.nsc.typechecker.Namers$Namer$$anonfun$monoTypeCompleter$1.apply(Namers.scala:729) at org.scalamacros.paradise.typechecker.Namers$$anon$3.completeImpl(Namers.scala:743) at scala.tools.nsc.typechecker.Namers$LockingTypeCompleter$class.complete(Namers.scala:1622) at org.scalamacros.paradise.typechecker.Namers$$anon$3.complete(Namers.scala:741) at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1231) at scala.reflect.internal.Symbols$Symbol.initialize(Symbols.scala:1374) at scala.tools.nsc.typechecker.MethodSynthesis$MethodSynth$class.addDerivedTrees(MethodSynthesis.scala:225) at scala.tools.nsc.typechecker.Namers$Namer.addDerivedTrees(Namers.scala:55) at scala.tools.nsc.typechecker.Typers$Typer$$anonfun$32.apply(Typers.scala:1917) at scala.tools.nsc.typechecker.Typers$Typer$$anonfun$32.apply(Typers.scala:1917) at scala.tools.nsc.typechecker.Typers$Typer$$anonfun$rewrappingWrapperTrees$1.apply(Typers.scala:1856) at scala.tools.nsc.typechecker.Typers$Typer$$anonfun$rewrappingWrapperTrees$1.apply(Typers.scala:1853) at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251) at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251) at scala.collection.immutable.List.foreach(List.scala:318) at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:251) at scala.collection.AbstractTraversable.flatMap(Traversable.scala:105) at scala.tools.nsc.typechecker.Typers$Typer.typedTemplate(Typers.scala:1917) at org.scalamacros.paradise.typechecker.Analyzer$$anon$1.org $scalamacros$paradise$typechecker$Typers$ParadiseTyper$$super$typedTemplate(Analyzer.scala:19) at org.scalamacros.paradise.typechecker.Typers$ParadiseTyper$class.typedTemplate(Typers.scala:51) at org.scalamacros.paradise.typechecker.Analyzer$$anon$1.typedTemplate(Analyzer.scala:19) at scala.tools.nsc.typechecker.Typers$Typer.typedClassDef(Typers.scala:1759) at org.scalamacros.paradise.typechecker.Analyzer$$anon$1.org $scalamacros$paradise$typechecker$Typers$ParadiseTyper$$super$typedClassDef(Analyzer.scala:19) at org.scalamacros.paradise.typechecker.Typers$ParadiseTyper$class.typedClassDef(Typers.scala:62) at org.scalamacros.paradise.typechecker.Analyzer$$anon$1.typedClassDef(Analyzer.scala:19) at scala.tools.nsc.typechecker.Typers$Typer.typed1(Typers.scala:5583) at org.scalamacros.paradise.typechecker.Analyzer$$anon$1.org $scalamacros$paradise$typechecker$Typers$ParadiseTyper$$super$typed1(Analyzer.scala:19) at org.scalamacros.paradise.typechecker.Typers$ParadiseTyper$class.typed1(Typers.scala:44) at org.scalamacros.paradise.typechecker.Analyzer$$anon$1.typed1(Analyzer.scala:19) at scala.tools.nsc.typechecker.Typers$Typer.typed(Typers.scala:5642) at scala.tools.nsc.typechecker.Typers$Typer.scala$tools$nsc$typechecker$Typers$Typer$$typedStat$1(Typers.scala:2928) at scala.tools.nsc.typechecker.Typers$Typer$$anonfun$61.apply(Typers.scala:3032) at scala.tools.nsc.typechecker.Typers$Typer$$anonfun$61.apply(Typers.scala:3032) at scala.collection.immutable.List.loop$1(List.scala:170) at scala.collection.immutable.List.mapConserve(List.scala:186) at scala.tools.nsc.typechecker.Typers$Typer.typedStats(Typers.scala:3032) at scala.tools.nsc.typechecker.Typers$Typer.typedPackageDef$1(Typers.scala:5301) at scala.tools.nsc.typechecker.Typers$Typer.typed1(Typers.scala:5587) at org.scalamacros.paradise.typechecker.Analyzer$$anon$1.org $scalamacros$paradise$typechecker$Typers$ParadiseTyper$$super$typed1(Analyzer.scala:19) at org.scalamacros.paradise.typechecker.Typers$ParadiseTyper$class.typedPackageDef$1(Typers.scala:35) at org.scalamacros.paradise.typechecker.Typers$ParadiseTyper$class.typed1(Typers.scala:43) at org.scalamacros.paradise.typechecker.Analyzer$$anon$1.typed1(Analyzer.scala:19) at scala.tools.nsc.typechecker.Typers$Typer.typed(Typers.scala:5642) at scala.tools.nsc.typechecker.Typers$Typer.typed(Typers.scala:5704) at scala.tools.nsc.typechecker.Analyzer$typerFactory$$anon$3.apply(Analyzer.scala:99) at scala.tools.nsc.Global$GlobalPhase.applyPhase(Global.scala:464) at scala.tools.nsc.typechecker.Analyzer$typerFactory$$anon$3$$anonfun$run$1.apply(Analyzer.scala:91) at scala.tools.nsc.typechecker.Analyzer$typerFactory$$anon$3$$anonfun$run$1.apply(Analyzer.scala:91) at scala.collection.Iterator$class.foreach(Iterator.scala:727) at scala.collection.AbstractIterator.foreach(Iterator.scala:1157) at scala.tools.nsc.typechecker.Analyzer$typerFactory$$anon$3.run(Analyzer.scala:91) at scala.tools.nsc.Global$Run.compileUnitsInternal(Global.scala:1583) at scala.tools.nsc.Global$Run.compileUnits(Global.scala:1557) at scala.tools.nsc.Global$Run.compileSources(Global.scala:1553) at scala.tools.nsc.Global$Run.compile(Global.scala:1662) at xsbt.CachedCompiler0.run(CompilerInterface.scala:123) at xsbt.CachedCompiler0.run(CompilerInterface.scala:99) at xsbt.CompilerInterface.run(CompilerInterface.scala:27) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at sbt.compiler.AnalyzingCompiler.call(AnalyzingCompiler.scala:102) at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:48) at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:41) at sbt.compiler.AggressiveCompile$$anonfun$3$$anonfun$compileScala$1$1.apply$mcV$sp(AggressiveCompile.scala:99) at sbt.compiler.AggressiveCompile$$anonfun$3$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:99) at sbt.compiler.AggressiveCompile$$anonfun$3$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:99) at sbt.compiler.AggressiveCompile.sbt$compiler$AggressiveCompile$$timed(AggressiveCompile.scala:166) at sbt.compiler.AggressiveCompile$$anonfun$3.compileScala$1(AggressiveCompile.scala:98) at sbt.compiler.AggressiveCompile$$anonfun$3.apply(AggressiveCompile.scala:143) at sbt.compiler.AggressiveCompile$$anonfun$3.apply(AggressiveCompile.scala:87) at sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:39) at sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:37) at sbt.inc.IncrementalCommon.cycle(Incremental.scala:99) at sbt.inc.Incremental$$anonfun$1.apply(Incremental.scala:38) at sbt.inc.Incremental$$anonfun$1.apply(Incremental.scala:37) at sbt.inc.Incremental$.manageClassfiles(Incremental.scala:65) at sbt.inc.Incremental$.compile(Incremental.scala:37) at sbt.inc.IncrementalCompile$.apply(Compile.scala:27) at sbt.compiler.AggressiveCompile.compile2(AggressiveCompile.scala:157) at sbt.compiler.AggressiveCompile.compile1(AggressiveCompile.scala:71) at com.typesafe.zinc.Compiler.compile(Compiler.scala:184) at com.typesafe.zinc.Compiler.compile(Compiler.scala:164) at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:92) at scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303) at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119) at scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99) at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216) at org.apache.maven.cli.MavenCli.main(MavenCli.java:160) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) On Fri, Mar 27, 2015 at 5:23 AM, Sean Owen <so...@cloudera.com> wrote: > I built from the head of branch-1.2 and spark-core compiled correctly > with your exact command. You have something wrong with how you are > building. For example, you're not trying to run this from the core > subdirectory are you? > > On Thu, Mar 26, 2015 at 10:36 PM, Pala M Muthaia > <mchett...@rocketfuelinc.com> wrote: > > Hi, > > > > We are trying to build spark 1.2 from source (tip of the branch-1.2 at > the > > moment). I tried to build spark using the following command: > > > > mvn -U -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive > -Phive-thriftserver > > -DskipTests clean package > > > > I encountered various missing class definition exceptions (e.g: class > > javax.servlet.ServletException not found). > > > > I eventually got the build to succeed after adding the following set of > > dependencies to the spark-core's pom.xml: > > > > <dependency> > > <groupId>javax.servlet</groupId> > > <artifactId>servlet-api</artifactId> > > <version>3.0</version> > > </dependency> > > > > <dependency> > > <groupId>org.eclipse.jetty</groupId> > > <artifactId>jetty-io</artifactId> > > </dependency> > > > > <dependency> > > <groupId>org.eclipse.jetty</groupId> > > <artifactId>jetty-http</artifactId> > > </dependency> > > > > <dependency> > > <groupId>org.eclipse.jetty</groupId> > > <artifactId>jetty-servlet</artifactId> > > </dependency> > > > > Pretty much all of the missing class definition errors came up while > > building HttpServer.scala, and went away after the above dependencies > were > > included. > > > > My guess is official build for spark 1.2 is working already. My question > is > > what is wrong with my environment or setup, that requires me to add > > dependencies to pom.xml in this manner, to get this build to succeed. > > > > Also, i am not sure if this build would work at runtime for us, i am > still > > testing this out. > > > > > > Thanks, > > pala >