Guillaume Pitel created SPARK-4816:
--------------------------------------
Summary: Maven profile netlib-lgpl does not work
Key: SPARK-4816
URL: https://issues.apache.org/jira/browse/SPARK-4816
Project: Spark
Issue Type: Bug
Components: Build
Affects Versions: 1.1.0
Environment: maven 3.0.5 / Ubuntu
Reporter: Guillaume Pitel
Priority: Minor
When doing what the documentation recommends to recompile Spark with Netlib
Native system binding (i.e. to bind with openblas or, in my case, MKL),
mvn -Pnetlib-lgpl -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -DskipTests clean
package
The resulting assembly jar still lacked the netlib-system class. (I checked the
content of spark-assembly...jar)
When forcing the netlib-lgpl profile in MLLib package to be active, the jar is
correctly built.
So I guess it's a problem with the way maven passes profiles activitations to
children modules.
Also, despite the documentation claiming that if the job's jar contains netlib
with necessary bindings, it should works, it does not. The classloader must be
unhappy with two occurrences of netlib ?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
