Github user fommil commented on the pull request:
https://github.com/apache/spark/pull/4448#issuecomment-73369737
@srowen can you please create the JIRA? I will inevitably fill out all the
wrong fields anyway. I'll push a change to this PR in a moment.
Re: JBLAS oh I didn't realise that. Why? Does it do anything that
netlib-java/Breeze doesn't? My understanding is that it absolutely requires
natives to be available (which is kind of weird for a java application and
hence makes Spark a lot harder to setup/use), and packages its own builds of an
unspecified version of BLAS (possibly LAPACK?). i.e. it doesn't use system
optimised binaries (see my talk to find out why this is absolutely **critical**
for high performance). FYI, I have Intel MKL on all my machines because it is
ridiculously faster than the alternatives, and I am experimenting with
GPU/APU/FPGA backends.
Re: lpgl flag. ok, I'll add this back but it does sound like the flag is
incorrectly named. "natives" would perhaps have been better, but, legacy, meh.
Re: "OpenBLAS", no JBLAS packages its own (suboptimal) binaries. No runtime
link to `lib{blas,lapack}.so.3`:
```
ldd
mikiobraun-jblas-4ee5b65/src/main/resources/lib/static/Linux/amd64/libjblas_arch_flavor.so
linux-vdso.so.1 (0x00007fff4f98c000)
libgfortran.so.3 => /usr/lib/x86_64-linux-gnu/libgfortran.so.3
(0x00007f371fd71000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f371f9c8000)
libquadmath.so.0 => /usr/lib/x86_64-linux-gnu/libquadmath.so.0
(0x00007f371f78a000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f371f489000)
libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1
(0x00007f371f273000)
/lib64/ld-linux-x86-64.so.2 (0x00007f37202b0000)
~/Downloads ldd
mikiobraun-jblas-4ee5b65/src/main/resources/lib/static/Linux/amd64/
libjblas_arch_flavor.so sse3/
~/Downloads ldd
mikiobraun-jblas-4ee5b65/src/main/resources/lib/static/Linux/amd64/sse3/libjblas.so
linux-vdso.so.1 (0x00007ffff6ffc000)
libgfortran.so.3 => /usr/lib/x86_64-linux-gnu/libgfortran.so.3
(0x00007f7d32f16000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f7d32b6d000)
libquadmath.so.0 => /usr/lib/x86_64-linux-gnu/libquadmath.so.0
(0x00007f7d3292f000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f7d3262e000)
libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1
(0x00007f7d32418000)
/lib64/ld-linux-x86-64.so.2 (0x00007f7d33bf0000)
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
