All I'm saying is that if the zk client finds the system property set, it will think that you want to authenticate. You could also try setting zookeeper.sasl.client to false.
-Flavio > On 19 Oct 2015, at 10:16, sagar shukla <[email protected]> wrote: > > Thanks for the prompt response. Since i am running MapReduce on hadoop node, > i feel i should use default jaas file, else my MapReduce auth might break ... > right? > > Exception indicates issue at zookeeper side. > > I tried with non-secure hadoop cluster which works as expected. > > Regards, > Sagar > > Sent from Yahoo Mail on Android > <https://overview.mail.yahoo.com/mobile/?.src=Android> > On Mon, 19 Oct, 2015 at 2:33 pm, Flavio Junqueira > <[email protected]> wrote: > Do you have the jaas config property set which is causing your client to > believe you want to authenticate? You may also want to ask that same question > on the Kafka list. > > -Flavio > > > On 19 Oct 2015, at 09:56, sagar shukla <[email protected] > > <javascript:return>> wrote: > > > > Hi All, > > I have a zookeeper cluster configured with Kafka without any SASL security > > configuration. Also I have a hadoop cluster configured with security which > > uses a different zookeeper cluster. So overall, I have two zookeeper > > clusters - one with security and one without security. > > > > Now when I try to run a mapreduce program to fetch data from Kafka using > > non-secure zookeeper, I get following error message of SASL though my read > > zookeeper cluster does not have security configured. > > : org.I0Itec.zkclient.exception.ZkException: > > org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = > > AuthFailed for /consumers/myGroup/ids/myGroup_server-1445242267846-420b8826 > > at > > org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:68) > > at > > org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685) > > at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304) > > at org.I0Itec.zkclient.ZkClient.createEphemeral(ZkClient.java:328) > > at kafka.utils.ZkUtils$.createEphemeralPath(ZkUtils.scala:222) > > at > > kafka.utils.ZkUtils$.createEphemeralPathExpectConflict(ZkUtils.scala:237) > > at > > kafka.utils.ZkUtils$.createEphemeralPathExpectConflictHandleZKBug(ZkUtils.scala:275) > > at > > kafka.consumer.ZookeeperConsumerConnector.kafka$consumer$ZookeeperConsumerConnector$$registerConsumerInZK(ZookeeperConsumerConnector.scala:254) > > at > > kafka.consumer.ZookeeperConsumerConnector.consume(ZookeeperConsumerConnector.scala:239) > > at > > kafka.consumer.ZookeeperConsumerConnector.createMessageStreams(ZookeeperConsumerConnector.scala:153) > > at > > org.apache.spark.streaming.kafka.KafkaReceiver.onStart(KafkaInputDStream.scala:111) > > at > > org.apache.spark.streaming.receiver.ReceiverSupervisor.startReceiver(ReceiverSupervisor.scala:125) > > at > > org.apache.spark.streaming.receiver.ReceiverSupervisor.start(ReceiverSupervisor.scala:109) > > at > > org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverLauncher$$anonfun$8.apply(ReceiverTracker.scala:308) > > at > > org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverLauncher$$anonfun$8.apply(ReceiverTracker.scala:300) > > at > > org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1767) > > at > > org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1767) > > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:63) > > at org.apache.spark.scheduler.Task.run(Task.scala:70) > > at > > org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213) > > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > at java.lang.Thread.run(Thread.java:745) > > Caused by: org.apache.zookeeper.KeeperException$AuthFailedException: > > KeeperErrorCode = AuthFailed for > > /consumers/myGroup/ids/myGroup_server-1445242267846-420b8826 > > at > > org.apache.zookeeper.KeeperException.create(KeeperException.java:123) > > at > > org.apache.zookeeper.KeeperException.create(KeeperException.java:51) > > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) > > at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87) > > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308) > > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304) > > at > > org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675) > > ... 21 more > > > > I did try setting up parameter -Djava.security.auth.login.config=none while > > trying to run the mapreduce program. > > > > Any thoughts on how I can get rid of this security warning? > > Regards,Sagar > >
