For building in intellij with sbt my mileage has varied widely: it had built as late as Monday (after the 1.3.0 release) - and with zero 'special' steps: just "import" as sbt project.
However I can not presently repeat the process. The wiki page has the latest instructions on how to build with maven - but not with sbt. Is there a resource for that? https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-IntelliJ The error I see is same as from a post in July http://apache-spark-user-list.1001560.n3.nabble.com/Build-spark-with-Intellij-IDEA-13-td9904.html Here is an excerpt: uncaught exception during compilation: java.lang.AssertionError Error:scalac: Error: assertion failed: com.google.protobuf.InvalidProtocolBufferException java.lang.AssertionError: assertion failed: com.google.protobuf.InvalidProtocolBufferException at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1212) The answer in the mailing list to that thread was about using maven .. so that is not useful here.