This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new b604338678ce [SPARK-55605][BUILD][DOCS] Bump dev.ludovic.netlib 3.1.1
and update docs
b604338678ce is described below
commit b604338678cede820c4d0f8f6f8ff4a3ffa1fba8
Author: Cheng Pan <[email protected]>
AuthorDate: Thu Feb 19 08:17:00 2026 -0800
[SPARK-55605][BUILD][DOCS] Bump dev.ludovic.netlib 3.1.1 and update docs
### What changes were proposed in this pull request?
Bump dev.ludovic.netlib 3.1.1, notable changes:
https://github.com/luhenry/netlib/releases/tag/v3.1.1
https://github.com/luhenry/netlib/releases/tag/v3.1.0
> - Add allowNative system properties as switch
> - Update CI to test against JDK 25
> - Modernize dev container with multi-version Java support
> - Add macOS support with Apple Accelerate framework
Also, update docs.
### Why are the changes needed?
Benefits from the new features and keep the docs up to date.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass GHA.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #54380 from pan3793/SPARK-55605.
Authored-by: Cheng Pan <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
dev/deps/spark-deps-hadoop-3-hive-2.3 | 6 +++---
docs/ml-linalg-guide.md | 5 +++--
pom.xml | 2 +-
3 files changed, 7 insertions(+), 6 deletions(-)
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3
b/dev/deps/spark-deps-hadoop-3-hive-2.3
index e85114c7575f..6d9e76451576 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -12,7 +12,7 @@
analyticsaccelerator-s3/1.3.1//analyticsaccelerator-s3-1.3.1.jar
antlr-runtime/3.5.2//antlr-runtime-3.5.2.jar
antlr4-runtime/4.13.1//antlr4-runtime-4.13.1.jar
aopalliance-repackaged/3.0.6//aopalliance-repackaged-3.0.6.jar
-arpack/3.0.4//arpack-3.0.4.jar
+arpack/3.1.1//arpack-3.1.1.jar
arpack_combined_all/0.1//arpack_combined_all-0.1.jar
arrow-compression/18.3.0//arrow-compression-18.3.0.jar
arrow-format/18.3.0//arrow-format-18.3.0.jar
@@ -27,7 +27,7 @@ avro/1.12.1//avro-1.12.1.jar
azure-data-lake-store-sdk/2.3.9//azure-data-lake-store-sdk-2.3.9.jar
azure-keyvault-core/1.0.0//azure-keyvault-core-1.0.0.jar
azure-storage/7.0.1//azure-storage-7.0.1.jar
-blas/3.0.4//blas-3.0.4.jar
+blas/3.1.1//blas-3.1.1.jar
breeze-macros_2.13/2.1.0//breeze-macros_2.13-2.1.0.jar
breeze_2.13/2.1.0//breeze_2.13-2.1.0.jar
bundle/2.35.4//bundle-2.35.4.jar
@@ -177,7 +177,7 @@ kubernetes-model-rbac/7.5.2//kubernetes-model-rbac-7.5.2.jar
kubernetes-model-resource/7.5.2//kubernetes-model-resource-7.5.2.jar
kubernetes-model-scheduling/7.5.2//kubernetes-model-scheduling-7.5.2.jar
kubernetes-model-storageclass/7.5.2//kubernetes-model-storageclass-7.5.2.jar
-lapack/3.0.4//lapack-3.0.4.jar
+lapack/3.1.1//lapack-3.1.1.jar
leveldbjni-all/1.8//leveldbjni-all-1.8.jar
libfb303/0.9.3//libfb303-0.9.3.jar
libthrift/0.16.0//libthrift-0.16.0.jar
diff --git a/docs/ml-linalg-guide.md b/docs/ml-linalg-guide.md
index 6e91d81f4976..8fa3f9df332d 100644
--- a/docs/ml-linalg-guide.md
+++ b/docs/ml-linalg-guide.md
@@ -46,8 +46,7 @@ The installation should be done on all nodes of the cluster.
Generic version of
For Debian / Ubuntu:
```
-sudo apt-get install libopenblas-base
-sudo update-alternatives --config libblas.so.3
+sudo apt-get install libopenblas-dev
```
For CentOS / RHEL:
```
@@ -76,6 +75,8 @@ You can also point `dev.ludovic.netlib` to specific libraries
names and paths. F
If native libraries are not properly configured in the system, the Java
implementation (javaBLAS) will be used as fallback option.
+To disable native BLAS libraries and always use the Java implementation
(javaBLAS), set Java system property
`-Ddev.ludovic.netlib.blas.allowNative=false`. You have similar parameters for
LAPACK and ARPACK: `-Ddev.ludovic.netlib.lapack.allowNative=false`, and
`-Ddev.ludovic.netlib.arpack.allowNative=false`,
+
## Spark Configuration
The default behavior of multi-threading in either Intel MKL or OpenBLAS may
not be optimal with Spark's execution model [^1].
diff --git a/pom.xml b/pom.xml
index dde15c732974..3404ebf764dd 100644
--- a/pom.xml
+++ b/pom.xml
@@ -186,7 +186,7 @@
<fasterxml.jackson.version>2.21.0</fasterxml.jackson.version>
<ws.xmlschema.version>2.3.1</ws.xmlschema.version>
<snappy.version>1.1.10.8</snappy.version>
- <netlib.ludovic.dev.version>3.0.4</netlib.ludovic.dev.version>
+ <netlib.ludovic.dev.version>3.1.1</netlib.ludovic.dev.version>
<commons-codec.version>1.21.0</commons-codec.version>
<commons-compress.version>1.28.0</commons-compress.version>
<commons-io.version>2.21.0</commons-io.version>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
