SHOBHIT SHUKLA created SPARK-30467:
--------------------------------------
Summary: On Federal Information Processing Standard (FIPS) enabled
cluster, Spark Workers are not able to connect to Master.
Key: SPARK-30467
URL: https://issues.apache.org/jira/browse/SPARK-30467
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.4.4, 2.3.4, 2.3.3
Reporter: SHOBHIT SHUKLA
On _*Federal Information Processing Standard*_ (FIPS) enabled clusters, Spark
Workers are not able to create Spark Context If we configured
`spark.network.crypto.enabled true`.
Error logs :
```
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use
setLogLevel(newLevel).
fips.c(145): OpenSSL internal error, assertion failed: FATAL FIPS SELFTEST
FAILURE
JVMDUMP039I Processing dump event "abort", detail "" at 2020/01/09 06:41:50 -
please wait.
JVMDUMP032I JVM requested System dump using
'<SPARK_HOME>/bin/core.20200109.064150.283.0001.dmp' in response to an event
JVMDUMP030W Cannot write dump to
file<SPARK_HOME>/bin/core.20200109.064150.283.0001.dmp: Permission denied
JVMDUMP012E Error in System dump: The core file created by child process with
pid = 375 was not found. Expected to find core file with name
"/var/cores/core-netty-rpc-conne-sig11-user1000320999-group0-pid375-time*"
JVMDUMP030W Cannot write dump to file
<SPARK_HOME>/bin/javacore.20200109.064150.283.0002.txt: Permission denied
JVMDUMP032I JVM requested Java dump using
'/tmp/javacore.20200109.064150.283.0002.txt' in response to an event
JVMDUMP010I Java dump written to /tmp/javacore.20200109.064150.283.0002.txt
JVMDUMP032I JVM requested Snap dump using
'<SPARK_HOME>/bin/Snap.20200109.064150.283.0003.trc' in response to an event
JVMDUMP030W Cannot write dump to file
<SPARK_HOME>/bin/Snap.20200109.064150.283.0003.trc: Permission denied
JVMDUMP010I Snap dump written to /tmp/Snap.20200109.064150.283.0003.trc
JVMDUMP030W Cannot write dump to file
<SPARK_HOME>/bin/jitdump.20200109.064150.283.0004.dmp: Permission denied
JVMDUMP007I JVM Requesting JIT dump using
'/tmp/jitdump.20200109.064150.283.0004.dmp'
JVMDUMP010I JIT dump written to /tmp/jitdump.20200109.064150.283.0004.dmp
JVMDUMP013I Processed dump event "abort", detail "".```
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
