[GitHub] spark issue #9168: [SPARK-11182] HDFS Delegation Token will be expired when ...

2018-09-28 Thread Tianny
Github user Tianny commented on the issue: https://github.com/apache/spark/pull/9168 @jackiehff My Hadoop cluster version is 2.6.0-cdh5.13.1. But still have the problem. I'm working on it trying to upgrade the spark version to latest version 2.3.2. By the way,I sent a email

[GitHub] spark issue #9168: [SPARK-11182] HDFS Delegation Token will be expired when ...

2018-09-28 Thread Tianny
Github user Tianny commented on the issue: https://github.com/apache/spark/pull/9168 > @Tianny,we just upgrade our hadoop cluster version to 2.6.0-cdh5.11.2 then the error disappered! My Hadoop cluster version is 2.6.0-cdh5.13.1. But still have the problem. I'm working on

[GitHub] spark issue #9168: [SPARK-11182] HDFS Delegation Token will be expired when ...

2018-09-28 Thread jackiehff
Github user jackiehff commented on the issue: https://github.com/apache/spark/pull/9168 @Tianny,we just upgrade our hadoop cluster version to 2.6.0-cdh5.11.2 then the error disappered! --- - To unsubscribe,

[GitHub] spark issue #9168: [SPARK-11182] HDFS Delegation Token will be expired when ...

2018-09-27 Thread Tianny
Github user Tianny commented on the issue: https://github.com/apache/spark/pull/9168 @jackiehff Have you solved the problem?I met the error same as you. --- - To unsubscribe, e-mail:

[GitHub] spark issue #9168: [SPARK-11182] HDFS Delegation Token will be expired when ...

2017-09-12 Thread jackiehff
Github user jackiehff commented on the issue: https://github.com/apache/spark/pull/9168 @marsishandsome, the patch file in jira HDFS-9276 has been introduced into hadoop-2.6.0-cdh5.7.3 which is our hadoop cluster version, but I still got token can't be found in cache error when I

[GitHub] spark issue #9168: [SPARK-11182] HDFS Delegation Token will be expired when ...

2017-07-17 Thread jzhuge
Github user jzhuge commented on the issue: https://github.com/apache/spark/pull/9168 @marsishandsome and @steveloughran HDFS-9276 has been backported to Hadoop 2.8.2 (in branch-2.8.1 as well, but 2.8.1 became a security release). --- If your project is set up for it, you can reply

[GitHub] spark issue #9168: [SPARK-11182] HDFS Delegation Token will be expired when ...

2017-01-23 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/9168 looking at the HDFS patch, it's in branch-2.9. We could backport to branch-2.8, though it's too late to get into the 2.8.0 RC --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #9168: [SPARK-11182] HDFS Delegation Token will be expired when ...

2017-01-19 Thread leocook
Github user leocook commented on the issue: https://github.com/apache/spark/pull/9168 I just add principal conf when submit my job like blow: ``` --principal=@yy \ --keytab=a.keytab \ ``` And spark.hadoop.fs.hdfs.impl.disable.cache=true is not