[
https://issues.apache.org/jira/browse/SLIDER-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487108#comment-14487108
]
Steve Loughran commented on SLIDER-742:
---------------------------------------
# Slider 0.70 has a no-keytab option; the application will be unable to
continue after 72 hours and the HDFS tokens expire.
# Spark streaming does not do what you think it does. If you look at SPARK-5342
they are working to address this, with the experience we have in Slider helping
guide it. What they are proposing is that the AM gets a keytab, the executors
in the containers ask the AM for fresh tokens before the old ones expire. This
works because the processes executed in the containers are part of spark and
can be set up to do this. We can't do the same for things like HBase, which
expect a keytab for refreshes.
> Slider AM secure configuration
> ------------------------------
>
> Key: SLIDER-742
> URL: https://issues.apache.org/jira/browse/SLIDER-742
> Project: Slider
> Issue Type: Bug
> Components: appmaster
> Affects Versions: Slider 0.60
> Environment: Secured Hadoop
> Reporter: Yang Hao
>
> Running in secured Hadoop cluster, when I don't set secured-related
> configuration for SliderAM, an error is out:
> "hdfs://lgtst-xiaomi/user/h_yanghao3/.slider/cluster/hbase1/keytabs': No
> such file or directory".
> For the token has been sent to SliderAM working dir as file container_tokens.
> Can we use the feature what MapReduceAM deals with this situation, which
> don't need the keytab file?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
