Re: submitting spark job with kerberized Hadoop issue

Any update on this? On Tuesday, 16 August 2016, Aneela Saleem <ane...@platalytics.com> wrote: > Thanks Steve, > > I went through this but still not able to fix the issue > > On Mon, Aug 15, 2016 at 2:01 AM, Steve Loughran <ste...@hortonworks.com > <ja

Re: Accessing HBase through Spark with Security enabled

Any update on this? On Tuesday, 16 August 2016, Aneela Saleem <ane...@platalytics.com> wrote: > Thanks Steve, > > I have gone through it's documentation, i did not get any idea how to > install it. Can you help me? > > On Mon, Aug 15, 2016 at 4:23 PM, Steve Loughran

Re: submitting spark job with kerberized Hadoop issue

fix this? > > 1. There's some notes I've taken on this topic: > https://www.gitbook.com/book/steveloughran/kerberos_and_hadoop/details > > -look at "Error messages to fear" to see if this one has surfaced; > otherwise look at "low level secrets" to see how t

Re: Accessing HBase through Spark with Security enabled

Thanks Steve, I have gone through it's documentation, i did not get any idea how to install it. Can you help me? On Mon, Aug 15, 2016 at 4:23 PM, Steve Loughran <ste...@hortonworks.com> wrote: > > On 15 Aug 2016, at 08:29, Aneela Saleem <ane...@platalytics.com> wrote: >

Re: Accessing HBase through Spark with Security enabled

new SparkContext(conf) > > val hbaseContext = new HBaseContext(sc, hconf) > > > > val scan = new Scan() > > scan.addColumn(columnName, "column1") > > scan.setTimeRange(0L, 141608330L) > > val rdd = hbaseContext.hbaseRDD("emp", scan) > >

Re: Accessing HBase through Spark with Security enabled

on HBase community as well, they recommended me to use SparkOnHbase cloudera library. And asked to try the above cod but nothing works. I'm stuck here. On Sat, Aug 13, 2016 at 7:07 AM, Jacek Laskowski <ja...@japila.pl> wrote: > Hi, > > How do you access HBase? What's the version of Sp

Re: submitting spark job with kerberized Hadoop issue

; > wrote: > >> 1. Standalone mode doesn't support accessing kerberized Hadoop, simply >> because it lacks the mechanism to distribute delegation tokens via cluster >> manager. >> 2. For the HBase token fetching failure, I think you have to do kinit to >>

Re: submitting spark job with kerberized Hadoop issue

Thanks Wojciech and Jacek! I tried with Spark on Yarn with kerberized cluster it works fine now. But now when i try to access Hbase through spark i get the following error: 2016-08-07 20:43:57,617 WARN [hconnection-0x24b5fa45-metaLookup-shared--pool2-t1] ipc.RpcClientImpl: Exception encountered

Accessing HBase through Spark with Security enabled

Hi all, I'm trying to run a spark job that accesses HBase with security enabled. When i run the following command: */usr/local/spark-2/bin/spark-submit --keytab /etc/hadoop/conf/spark.keytab --principal spark/hadoop-master@platalyticsrealm --class com.platalytics.example.spark.App --master yarn

Re: submitting spark job with kerberized Hadoop issue

r.com/jaceklaskowski > > > On Fri, Aug 5, 2016 at 3:54 PM, Aneela Saleem <ane...@platalytics.com> > wrote: > > Hi all, > > > > I'm trying to connect to Kerberized Hadoop cluster using spark job. I > have > > kinit'd from command line. When i ru

submitting spark job with kerberized Hadoop issue

Hi all, I'm trying to connect to Kerberized Hadoop cluster using spark job. I have kinit'd from command line. When i run the following job i.e., *./bin/spark-submit --keytab /etc/hadoop/conf/spark.keytab --principal spark/hadoop-master@platalyticsrealm --class com.platalytics.example.spark.App