Re: Creating RDD using swebhdfs with truststore

[Denis Bolshakov]

Hello,

I would also set java opts for driver.

Best regards,
Denis

4 Сен 2016 г. 0:31 пользователь "Sourav Mazumder" <
sourav.mazumde...@gmail.com> написал:

> Hi,
>
> I am trying to create a RDD by using swebhdfs to a remote hadoop cluster
> which is protected by Knox and uses SSL.
>
> The code looks like this -
>
> sc.textFile("swebhdfs:/host:port/gateway/default/webhdfs/
> v1/").count.
>
> I'm passing the truststore and trustorepassword through extra java options
> while starting the spark shell as -
>
> spark-shell --conf 
> "spark.executor.extraJavaOptions=-Djavax.net.ssl.trustStore=truststor.jks
> -Djavax.net.ssl.trustStorePassword=" --conf "spark.driver.
> extraJavaOptions=-Djavax.net.ssl.trustStore=truststore.jks
> -Djavax.net.ssl.trustStorePassword="
>
> But I'm always getting the error that -
>
> Name: javax.net.ssl.SSLHandshakeException
> Message: Remote host closed connection during handshake
>
> Am I passing the truststore and truststore password in right way ?
>
> Regards,
>
> Sourav
>
>

Creating RDD using swebhdfs with truststore

[Sourav Mazumder]

Hi,

I am trying to create a RDD by using swebhdfs to a remote hadoop cluster
which is protected by Knox and uses SSL.

The code looks like this -

sc.textFile("swebhdfs:/host:port/gateway/default/webhdfs/v1/").count.

I'm passing the truststore and trustorepassword through extra java options
while starting the spark shell as -

spark-shell --conf
"spark.executor.extraJavaOptions=-Djavax.net.ssl.trustStore=truststor.jks
-Djavax.net.ssl.trustStorePassword=" --conf
"spark.driver.extraJavaOptions=-Djavax.net.ssl.trustStore=truststore.jks
-Djavax.net.ssl.trustStorePassword="

But I'm always getting the error that -

Name: javax.net.ssl.SSLHandshakeException
Message: Remote host closed connection during handshake

Am I passing the truststore and truststore password in right way ?

Regards,

Sourav