Thanks a lot Marcelo and Sandy. I will try spark on yarn . Xiaowei
From: Sandy Ryza [mailto:sandy.r...@cloudera.com] Sent: Wednesday, July 09, 2014 4:20 AM To: user@spark.apache.org Subject: Re: error when spark access hdfs with Kerberos enable That's correct. Only Spark on YARN supports Kerberos. -Sandy On Tue, Jul 8, 2014 at 12:04 PM, Marcelo Vanzin <van...@cloudera.com<mailto:van...@cloudera.com>> wrote: Someone might be able to correct me if I'm wrong, but I don't believe standalone mode supports kerberos. You'd have to use Yarn for that. On Tue, Jul 8, 2014 at 1:40 AM, 许晓炜 <xuxiao...@qiyi.com<mailto:xuxiao...@qiyi.com>> wrote: > Hi all, > > > > I encounter a strange issue when using spark 1.0 to access hdfs with > Kerberos > > I just have one spark test node for spark and HADOOP_CONF_DIR is set to the > location containing the hdfs configuration files(hdfs-site.xml and > core-site.xml) > > When I use spark-shell with local mode, the access to hdfs is successfully . > > However, If I use spark-shell which connects to the stand alone cluster (I > configured the spark as standalone cluster mode with only one node). > > The access to the hdfs fails with the following error: “Can't get Master > Kerberos principal for use as renewer” > > > > Anyone have any ideas on this ? > > Thanks a lot. > > > > Regards, > Xiaowei > > -- Marcelo
