Attempting to build Spark from source on EC2 using sbt gives the error 
"sbt.ResolveException: unresolved dependency: 
org.scala-lang#scala-library;2.10.2: not found". This only seems to happen on 
EC2, not on my local machine.

To reproduce, launch a cluster using spark-ec2, clone the Spark repository, and 
run sbt/sbt assembly. A complete transcript is at 
https://gist.github.com/ankurdave/bb96ea237700f5cd670c. Here is an excerpt with 
the error:

    [info] Resolving org.scala-lang#scala-library;2.10.2 ...
    [warn]  module not found: org.scala-lang#scala-library;2.10.2
    [...]
    [warn]  ::::::::::::::::::::::::::::::::::::::::::::::
    [warn]  ::          UNRESOLVED DEPENDENCIES         ::
    [warn]  ::::::::::::::::::::::::::::::::::::::::::::::
    [warn]  :: org.scala-lang#scala-library;2.10.2: not found
    [warn]  ::::::::::::::::::::::::::::::::::::::::::::::
    sbt.ResolveException: unresolved dependency: 
org.scala-lang#scala-library;2.10.2: not found
            at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:217)
    [...]
    [error] (*:update) sbt.ResolveException: unresolved dependency: 
org.scala-lang#scala-library;2.10.2: not found
    Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore?

After a bisection, it seems the problem was introduced by the SBT-Maven change 
(628932b) [1, 2].

Ankur

[1] https://github.com/apache/spark/pull/772
[2] https://issues.apache.org/jira/browse/SPARK-1776

Reply via email to