Kengo Seki created BIGTOP-3335:
----------------------------------
Summary: Fix Mahout build after upgrading Spark to 2.4.5
Key: BIGTOP-3335
URL: https://issues.apache.org/jira/browse/BIGTOP-3335
Project: Bigtop
Issue Type: Bug
Components: build
Reporter: Kengo Seki
Assignee: Kengo Seki
After BIGTOP-3165, building Mahout came to fail as follows, because Scala 2.10
support was removed from Spark 2.3.
{code}
$ ./gradlew mahout-pkg
(snip)
[INFO] ----------------< org.apache.mahout:mahout-spark_2.10 >-----------------
[INFO] Building Mahout Spark bindings 0.13.0 [9/11]
[INFO] --------------------------------[ jar ]---------------------------------
[WARNING] The POM for org.apache.spark:spark-core_2.10:jar:2.4.5 is missing, no
dependency information available
[WARNING] The POM for org.apache.spark:spark-mllib_2.10:jar:2.4.5 is missing,
no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Apache Mahout 0.13.0:
[INFO]
[INFO] Mahout Build Tools ................................. SUCCESS [ 2.564 s]
[INFO] Apache Mahout ...................................... SUCCESS [ 0.047 s]
[INFO] Mahout Math ........................................ SUCCESS [ 11.193 s]
[INFO] Mahout HDFS ........................................ SUCCESS [ 3.203 s]
[INFO] Mahout Map-Reduce .................................. SUCCESS [ 14.859 s]
[INFO] Mahout Integration ................................. SUCCESS [ 2.582 s]
[INFO] Mahout Examples .................................... SUCCESS [ 14.055 s]
[INFO] Mahout Math Scala bindings ......................... SUCCESS [ 30.022 s]
[INFO] Mahout Spark bindings .............................. FAILURE [ 0.029 s]
[INFO] Mahout Release Package ............................. SKIPPED
[INFO] Mahout H2O backend ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:18 min
[INFO] Finished at: 2020-04-03T17:07:38+09:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project mahout-spark_2.10: Could not resolve
dependencies for project org.apache.mahout:mahout-spark_2.10:jar:0.13.0: The
following artifacts could not be resolved:
org.apache.spark:spark-core_2.10:jar:2.4.5,
org.apache.spark:spark-mllib_2.10:jar:2.4.5: Failure to find
org.apache.spark:spark-core_2.10:jar:2.4.5 in
https://repository.cloudera.com/artifactory/cloudera-repos/ was cached in the
local repository, resolution will not be reattempted until the update interval
of cloudera has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :mahout-spark_2.10
debian/rules:30: recipe for target 'override_dh_auto_build' failed
make[1]: *** [override_dh_auto_build] Error 1
make[1]: Leaving directory
'/home/sekikn/repos/bigtop/output/mahout/mahout-0.13.0'
debian/rules:27: recipe for target 'build' failed
make: *** [build] Error 2
dpkg-buildpackage: error: debian/rules build subprocess returned exit status 2
debuild: fatal error at line 1152:
dpkg-buildpackage -rfakeroot -us -uc -ui -b
failed
> Task :mahout-deb FAILED
FAILURE: Build failed with an exception.
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
