Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/12171#issuecomment-205695469
```
[warn] module not found:
org.pentaho#pentaho-aggdesigner-algorithm;5.1.5-jhyde
[warn] ==== public: tried
[warn]
https://repo1.maven.org/maven2/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
[warn] ==== Maven2 Local: tried
[warn]
file:/home/sparkivy/per-executor-caches/6/.m2/repository/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
[warn] ==== local: tried
[warn]
/home/sparkivy/per-executor-caches/6/.ivy2/local/org.pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/ivys/ivy.xml
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: org.pentaho#pentaho-aggdesigner-algorithm;5.1.5-jhyde: not
found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn]
[warn] Note: Unresolved dependencies path:
[warn] org.pentaho:pentaho-aggdesigner-algorithm:5.1.5-jhyde
[warn] +- org.apache.calcite:calcite-core:1.2.0-incubating
[warn] +- org.spark-project.hive:hive-exec:1.2.1.spark
((com.typesafe.sbt.pom.MavenHelper) MavenHelper.scala#L76)
[warn] +- org.apache.spark:spark-yarn_2.11:2.0.0-SNAPSHOT
```
It looks like compilation failed because the
`pentaho-aggdesigner-algorithm` transitive dependency isn't present in Maven
Central; see also
https://mail-archives.apache.org/mod_mbox/hive-dev/201412.mbox/%3c571034233.2432062.1419887855285.javamail.ya...@jws10685.mail.bf1.yahoo.com%3E
This is a great illustration of why Spark's build bans the use of
dependencies which aren't present in Maven Central: non-central repos can go
offline and break a previously-good build.
I _did_ keep the exclusion which is supposed to be preventing this dep.
from being pulled in, so I wonder whether this is a problem specific to the SBT
build. Let me try re-running with Maven to see if our POM reader plugin could
be to blame.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
