Re: Spark 1.6.0 - token renew failure

2016-04-14 Thread Marcelo Vanzin
You can set "spark.yarn.security.tokens.hive.enabled=false" in your config, although your app won't work if you actually need Hive delegation tokens. On Thu, Apr 14, 2016 at 12:21 AM, Luca Rea wrote: > Hi Jeff, > > > > Thank you for your support, I’ve removed both the parameters > (principal/keyt

Re: Spark 1.6.0 - token renew failure

2016-04-13 Thread Jeff Zhang
It is not supported in spark to specify both principal and proxy-user. You need to either use proxy-user or use principal. Seems currently spark only check that from spark submit arguments but ignore the configuration in spark-defaults.xml if (proxyUser != null && principal != null) { SparkSub

Spark 1.6.0 - token renew failure

2016-04-13 Thread Luca Rea
Hi, I'm testing Livy server with Hue 3.9 and Spark 1.6.0 inside a kerberized cluster (HDP 2.4), when I run the command /usr/java/jdk1.7.0_71//bin/java -Dhdp.version=2.4.0.0-169 -cp /usr/hdp/2.4.0.0-169/spark/conf/:/usr/hdp/2.4.0.0-169/spark/lib/spark-assembly-1.6.0.2.4.0.0-169-hadoop2.7.1.2.4.0