[
https://issues.apache.org/jira/browse/SPARK-55290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Emilie Faracci updated SPARK-55290:
-----------------------------------
Affects Version/s: 4.1.0
4.2.0
(was: 4.2)
> `testReloadMissingTrustStore` fails with JDK 21 due to cross-device link error
> ------------------------------------------------------------------------------
>
> Key: SPARK-55290
> URL: https://issues.apache.org/jira/browse/SPARK-55290
> Project: Spark
> Issue Type: Bug
> Components: Tests
> Affects Versions: 4.1.0, 4.0.0, 4.2.0
> Reporter: Emilie Faracci
> Priority: Minor
> Labels: pull-request-available
>
> When building and testing with JDK 21, {{testReloadMissingTrustStore}} in
> {{org.apache.spark.network.ssl.ReloadingX509TrustManagerSuite}} fails with
> the following error
> {{[ERROR] Tests run: 6, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 1.981 s <<< FAILURE! -- in
> org.apache.spark.network.ssl.ReloadingX509TrustManagerSuite
> [ERROR]
> org.apache.spark.network.ssl.ReloadingX509TrustManagerSuite.testReloadMissingTrustStore
> -- Time elapsed: 0.021 s <<< ERROR!
> java.nio.file.AtomicMoveNotSupportedException:
> /var/folders/k3/w11hphls1q13hsq921zcwbqc0000gq/T/temp-key-store7512454643534556695jks
> -> testmissing.jks: Cross-device link
> at java.base/sun.nio.fs.UnixFileSystem.move(UnixFileSystem.java:871)
> at
> java.base/sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:309)
> at java.base/java.nio.file.Files.move(Files.java:1431)
> at
> org.apache.spark.network.ssl.SslSampleConfigs.saveKeyStore(SslSampleConfigs.java:233)
> at
> org.apache.spark.network.ssl.SslSampleConfigs.createTrustStore(SslSampleConfigs.java:129)
> at
> org.apache.spark.network.ssl.ReloadingX509TrustManagerSuite.testReloadMissingTrustStore(ReloadingX509TrustManagerSuite.java:195)
> [INFO]
> [INFO] Results:
> [INFO]
> [ERROR] Errors:
> [ERROR] ReloadingX509TrustManagerSuite.testReloadMissingTrustStore:195 ยป
> AtomicMoveNotSupported
> /var/folders/k3/w11hphls1q13hsq921zcwbqc0000gq/T/temp-key-store7512454643534556695jks
> -> testmissing.jks: Cross-device link
> [INFO]
> [ERROR] Tests run: 6, Failures: 0, Errors: 1, Skipped: 0
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 9.803 s
> [INFO] Finished at: 2026-01-29T11:30:24-08:00
> [INFO]
> ------------------------------------------------------------------------
> }}
> Verified that this fails in the same way with 4.0.0 onwards.
> Steps to reproduce:
> Use JDK 21 and an environment where {{/tmp}} and the current directory are on
> a different filesystem (partition).
> {{build/mvn clean install -Phive -Phive-thriftserver -DskipTests
> -Dmaven.scaladoc.skip -am -pl common/network-common
> build/mvn -pl common/network-common -Dtest=ReloadingX509TrustManagerSuite
> -Pyarn -Phive test}}
> Expected output: Test passes (works correctly with JDK 17)
> {{[INFO] -------------------------------------------------------
> [INFO] T E S T S
> [INFO] -------------------------------------------------------
> WARNING: Using incubator modules: jdk.incubator.vector
> [INFO] Running org.apache.spark.network.ssl.ReloadingX509TrustManagerSuite
> [INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.224
> s -- in org.apache.spark.network.ssl.ReloadingX509TrustManagerSuite
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 8.231 s
> [INFO] Finished at: 2026-01-29T12:02:17-08:00
> [INFO]
> ------------------------------------------------------------------------
> }}
> It should be the same with JDK 21 since support is added
> https://issues.apache.org/jira/browse/SPARK-43831.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
