Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/4453#issuecomment-74412266
@mengxr I tried removing all but the Linux 64-bit native code (it does not
package libgfortran actually, as we know from experience and
https://github.com/mikiobraun/jblas/wiki/Missing-Libraries ). Good news is that
unit tests still pass on OS X, and on Jenkins here. The tests do exercise the
main usage of JBLAS which is in `NNLS` and the nonnegative case for ALS.
I worried that it was picking up the libs from outside the assembly during
tests, so I tried running some MLlib code that uses JBLAS (ALS.train +
nonnegative = true) in the shell, after removing everything but the assembly
jar and confirming it has none of these libraries inside. That succeeded.
I see that lots of the calls we make don't actually hit the `NativeBlas`
implementation anyway. But surely something still needs it? or else why did we
ever have to install `libgfortran`? It would be great news if the native libs
are actually unused. Off the top of your head, am I missing something?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
