[
https://issues.apache.org/jira/browse/SPARK-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533755#comment-14533755
]
gu-chi commented on SPARK-7110:
-------------------------------
As I analyzed the exception stack trace again, I found the exception was thown
at NewHadoopRDD.getPartitions, when invoke inputFormat.getSplits, so I add the
similar modification as SPARK-1203 there, as running for so long time, never
occur again.
> when use saveAsNewAPIHadoopFile, sometimes it throws "Delegation Token can be
> issued only with kerberos or web authentication"
> ------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-7110
> URL: https://issues.apache.org/jira/browse/SPARK-7110
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.1.0
> Reporter: gu-chi
>
> Under yarn-client mode, this issue random occurs. Authentication method is
> set to kerberos, and use "saveAsNewAPIHadoopFile" in PairRDDFunctions to save
> data to HDFS, then exception comes as:
> org.apache.hadoop.ipc.RemoteException(java.io.IOException): Delegation Token
> can be issued only with kerberos or web authentication
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
