[
https://issues.apache.org/jira/browse/SPARK-19374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Derek M Miller updated SPARK-19374:
-----------------------------------
Description:
I am currently getting an SSL error when turning on ssl. I have confirmed
nothing is wrong the certificates as well. This is running on the emr and has
the following configuration for spark-defaults:
{code}
{
"Classification": "spark-defaults",
"Properties": {
"spark.yarn.maxAppAttempts": "1",
"spark.yarn.executor.memoryOverhead": "2048",
"spark.ssl.enabled": "true",
"spark.ssl.keyStore": "not_real_path/keystore.jks",
"spark.ssl.keyStorePassword": "not_a_real_password",
"spark.ssl.trustStore": "not_real_path/truststore.jks",
"spark.ssl.trustStorePassword": "not_a_real_password"
}
}
{code}
and I am getting the following exception:
```
17/01/26 20:02:31 INFO spark.SecurityManager: Changing view acls to: hadoop
17/01/26 20:02:31 INFO spark.SecurityManager: Changing modify acls to: hadoop
17/01/26 20:02:31 INFO spark.SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(hadoop); users
with modify permissions: Set(hadoop)
17/01/26 20:02:31 INFO yarn.Client: Deleting staging directory
.sparkStaging/application_1485460802835_0001
Exception in thread "main" java.security.KeyManagementException: Default
SSLContext is initialized automatically
at
sun.security.ssl.SSLContextImpl$DefaultSSLContext.engineInit(SSLContextImpl.java:749)
at javax.net.ssl.SSLContext.init(SSLContext.java:282)
at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:284)
at
org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:881)
at
org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:142)
at org.apache.spark.deploy.yarn.Client.run(Client.scala:1021)
at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1081)
at org.apache.spark.deploy.yarn.Client.main(Client.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
at
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
17/01/26 20:02:31 INFO util.ShutdownHookManager: Shutdown hook called
```
was:
I am currently getting an SSL error when turning on ssl. I have confirmed
nothing is wrong the certificates as well. This is running on the emr and has
the following configuration for spark-defaults:
```
{
"Classification": "spark-defaults",
"Properties": {
"spark.yarn.maxAppAttempts": "1",
"spark.yarn.executor.memoryOverhead": "2048",
"spark.ssl.enabled": "true",
"spark.ssl.keyStore": "not_real_path/keystore.jks",
"spark.ssl.keyStorePassword": "not_a_real_password",
"spark.ssl.trustStore": "not_real_path/truststore.jks",
"spark.ssl.trustStorePassword": "not_a_real_password"
}
}
```
and I am getting the following exception:
```
17/01/26 20:02:31 INFO spark.SecurityManager: Changing view acls to: hadoop
17/01/26 20:02:31 INFO spark.SecurityManager: Changing modify acls to: hadoop
17/01/26 20:02:31 INFO spark.SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(hadoop); users
with modify permissions: Set(hadoop)
17/01/26 20:02:31 INFO yarn.Client: Deleting staging directory
.sparkStaging/application_1485460802835_0001
Exception in thread "main" java.security.KeyManagementException: Default
SSLContext is initialized automatically
at
sun.security.ssl.SSLContextImpl$DefaultSSLContext.engineInit(SSLContextImpl.java:749)
at javax.net.ssl.SSLContext.init(SSLContext.java:282)
at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:284)
at
org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:881)
at
org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:142)
at org.apache.spark.deploy.yarn.Client.run(Client.scala:1021)
at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1081)
at org.apache.spark.deploy.yarn.Client.main(Client.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
at
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
17/01/26 20:02:31 INFO util.ShutdownHookManager: Shutdown hook called
```
> java.security.KeyManagementException: Default SSLContext is initialized
> automatically
> -------------------------------------------------------------------------------------
>
> Key: SPARK-19374
> URL: https://issues.apache.org/jira/browse/SPARK-19374
> Project: Spark
> Issue Type: Bug
> Reporter: Derek M Miller
>
> I am currently getting an SSL error when turning on ssl. I have confirmed
> nothing is wrong the certificates as well. This is running on the emr and has
> the following configuration for spark-defaults:
> {code}
> {
> "Classification": "spark-defaults",
> "Properties": {
> "spark.yarn.maxAppAttempts": "1",
> "spark.yarn.executor.memoryOverhead": "2048",
> "spark.ssl.enabled": "true",
> "spark.ssl.keyStore": "not_real_path/keystore.jks",
> "spark.ssl.keyStorePassword": "not_a_real_password",
> "spark.ssl.trustStore": "not_real_path/truststore.jks",
> "spark.ssl.trustStorePassword": "not_a_real_password"
> }
> }
> {code}
> and I am getting the following exception:
> ```
> 17/01/26 20:02:31 INFO spark.SecurityManager: Changing view acls to: hadoop
> 17/01/26 20:02:31 INFO spark.SecurityManager: Changing modify acls to: hadoop
> 17/01/26 20:02:31 INFO spark.SecurityManager: SecurityManager: authentication
> disabled; ui acls disabled; users with view permissions: Set(hadoop); users
> with modify permissions: Set(hadoop)
> 17/01/26 20:02:31 INFO yarn.Client: Deleting staging directory
> .sparkStaging/application_1485460802835_0001
> Exception in thread "main" java.security.KeyManagementException: Default
> SSLContext is initialized automatically
> at
> sun.security.ssl.SSLContextImpl$DefaultSSLContext.engineInit(SSLContextImpl.java:749)
> at javax.net.ssl.SSLContext.init(SSLContext.java:282)
> at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:284)
> at
> org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:881)
> at
> org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:142)
> at org.apache.spark.deploy.yarn.Client.run(Client.scala:1021)
> at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1081)
> at org.apache.spark.deploy.yarn.Client.main(Client.scala)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
> at
> org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
> at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> 17/01/26 20:02:31 INFO util.ShutdownHookManager: Shutdown hook called
> ```
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
