Attempting to build Spark from source on EC2 using sbt gives the error "sbt.ResolveException: unresolved dependency: org.scala-lang#scala-library;2.10.2: not found". This only seems to happen on EC2, not on my local machine.
To reproduce, launch a cluster using spark-ec2, clone the Spark repository, and run sbt/sbt assembly. A complete transcript is at https://gist.github.com/ankurdave/bb96ea237700f5cd670c. Here is an excerpt with the error: [info] Resolving org.scala-lang#scala-library;2.10.2 ... [warn] module not found: org.scala-lang#scala-library;2.10.2 [...] [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :: UNRESOLVED DEPENDENCIES :: [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :: org.scala-lang#scala-library;2.10.2: not found [warn] :::::::::::::::::::::::::::::::::::::::::::::: sbt.ResolveException: unresolved dependency: org.scala-lang#scala-library;2.10.2: not found at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:217) [...] [error] (*:update) sbt.ResolveException: unresolved dependency: org.scala-lang#scala-library;2.10.2: not found Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore? After a bisection, it seems the problem was introduced by the SBT-Maven change (628932b) [1, 2]. Ankur [1] https://github.com/apache/spark/pull/772 [2] https://issues.apache.org/jira/browse/SPARK-1776