Re: Apache Spark security.NosuchAlgorithm exception on changing from java 7 to java 8

2016-06-06 Thread Marcelo Vanzin
There should be a spark-defaults.conf file somewhere in your machine; that's where the config is. You can try to change it, but if you're using some tool to manage configuration for you, your changes might end up being overwritten, so be careful with that. You can also try "--properties-file

Re: Apache Spark security.NosuchAlgorithm exception on changing from java 7 to java 8

2016-06-06 Thread verylucky...@gmail.com
Thank you Marcelo. I don't know how to remove it. Could you please tell me how I can remove that configuration? On Mon, Jun 6, 2016 at 5:04 PM, Marcelo Vanzin wrote: > This sounds like your default Spark configuration has an > "enabledAlgorithms" config in the SSL

Re: Apache Spark security.NosuchAlgorithm exception on changing from java 7 to java 8

2016-06-06 Thread Marcelo Vanzin
This sounds like your default Spark configuration has an "enabledAlgorithms" config in the SSL settings, and that is listing an algorithm name that is not available in jdk8. Either remove that configuration (to use the JDK's default algorithm list), or change it so that it lists algorithms

Re: Apache Spark security.NosuchAlgorithm exception on changing from java 7 to java 8

2016-06-06 Thread verylucky...@gmail.com
Thank you Ted for the reference. I am going through it in detail. Thank you Marco for your suggestion. I created a properties file with these two lines spark.driver.extraJavaOptions -Djsse.enableSNIExtension=false spark.executor.extraJavaOptions -Djsse.enableSNIExtension=false and gave this

Re: Apache Spark security.NosuchAlgorithm exception on changing from java 7 to java 8

2016-06-06 Thread Marco Mistroni
HI have you tried to add this flag? -Djsse.enableSNIExtension=false i had similar issues in another standalone application when i switched to java8 from java7 hth marco On Mon, Jun 6, 2016 at 9:58 PM, Koert Kuipers wrote: > mhh i would not be very happy if the implication

Re: Apache Spark security.NosuchAlgorithm exception on changing from java 7 to java 8

2016-06-06 Thread Koert Kuipers
mhh i would not be very happy if the implication is that i have to start maintaining separate spark builds for client clusters that use java 8... On Mon, Jun 6, 2016 at 4:34 PM, Ted Yu wrote: > Please see: > https://spark.apache.org/docs/latest/security.html > > w.r.t. Java

Re: Apache Spark security.NosuchAlgorithm exception on changing from java 7 to java 8

2016-06-06 Thread Ted Yu
Please see: https://spark.apache.org/docs/latest/security.html w.r.t. Java 8, probably you need to rebuild 1.5.2 using Java 8. Cheers On Mon, Jun 6, 2016 at 1:19 PM, verylucky...@gmail.com < verylucky...@gmail.com> wrote: > Thank you for your response. > > I have seen this and couple of other

Re: Apache Spark security.NosuchAlgorithm exception on changing from java 7 to java 8

2016-06-06 Thread verylucky...@gmail.com
Thank you for your response. I have seen this and couple of other similar ones about java ssl in general. However, I am not sure how it applies to Spark and specifically to my case. This error I mention above occurs when I switch from java 7 to java 8 by changing the env variable JAVA_HOME. The

Re: Apache Spark security.NosuchAlgorithm exception on changing from java 7 to java 8

2016-06-06 Thread Ted Yu
Have you seen this ? http://stackoverflow.com/questions/22423063/java-exception-on-sslsocket-creation On Mon, Jun 6, 2016 at 12:31 PM, verylucky Man wrote: > Hi, > > I have a cluster (Hortonworks supported system) running Apache spark on > 1.5.2 on Java 7, installed by

Apache Spark security.NosuchAlgorithm exception on changing from java 7 to java 8

2016-06-06 Thread verylucky Man
Hi, I have a cluster (Hortonworks supported system) running Apache spark on 1.5.2 on Java 7, installed by admin. Java 8 is also installed. I don't have admin access to this cluster and would like to run spark (1.5.2 and later versions) on java 8. I come from HPC/MPI background. So I naively