Issue while Spark Job fetching data from Cassandra DB
HI All, I am getting "*.UnauthorizedException: User has no SELECT permission on or any of its parents*" error while Spark job is fetching data from Cassandra but could able to save data into Cassandra with out any issues Note: With the same user , I could able to access and query the table in CQL UI and code used in Spark Job has been tested in Spark Shell and it is working fine Please find the below stack trace WARN 2015-11-17 07:24:23 org.apache.spark.scheduler.DAGScheduler: Creating new stage failed due to exception - job: 0 com.datastax.driver.core.exceptions.UnauthorizedException:* User <* *UserIDXYZ**> has no SELECT permission on or any of its parents* at com.datastax.driver.core.exceptions.UnauthorizedException.copy(UnauthorizedException.java:36) ~[cassandra-driver-core-2.1.7.1.jar:na] at com.datastax.driver.core.DefaultResultSetFuture.extractCauseFromExecutionException(DefaultResultSetFuture.java:269) ~[cassandra-driver-core-2.1.7.1.jar:na] at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:183) ~[cassandra-driver-core-2.1.7.1.jar:na] at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:52) ~[cassandra-driver-core-2.1.7.1.jar:na] at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:44) ~[cassandra-driver-core-2.1.7.1.jar:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_51] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_51] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_51] at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_51] at com.datastax.spark.connector.cql.SessionProxy.invoke(SessionProxy.scala:33) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.sun.proxy.$Proxy10.execute(Unknown Source) ~[na:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_51] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_51] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_51] at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_51] at com.datastax.spark.connector.cql.SessionProxy.invoke(SessionProxy.scala:33) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.sun.proxy.$Proxy10.execute(Unknown Source) ~[na:na] at com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates$$anonfun$tokenRanges$1.apply(DataSizeEstimates.scala:40) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates$$anonfun$tokenRanges$1.apply(DataSizeEstimates.scala:38) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.cql.CassandraConnector$$anonfun$withSessionDo$1.apply(CassandraConnector.scala:110) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.cql.CassandraConnector$$anonfun$withSessionDo$1.apply(CassandraConnector.scala:109) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.cql.CassandraConnector.closeResourceAfterUse(CassandraConnector.scala:139) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.cql.CassandraConnector.withSessionDo(CassandraConnector.scala:109) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates.tokenRanges$lzycompute(DataSizeEstimates.scala:38) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates.tokenRanges(DataSizeEstimates.scala:37) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates.dataSizeInBytes$lzycompute(DataSizeEstimates.scala:81) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates.dataSizeInBytes(DataSizeEstimates.scala:80) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.rdd.partitioner.CassandraRDDPartitioner.(CassandraRDDPartitioner.scala:39) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.rdd.partitioner.CassandraRDDPartitioner$.apply(CassandraRDDPartitioner.scala:176) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at com.datastax.spark.connector.rdd.CassandraTableScanRDD.getPartitions(CassandraTableScanRDD.scala:144) ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:219) ~[spark-core_2.10-1.4.1.1.jar:1.4.1.1] at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:217)
Re: Issue while Spark Job fetching data from Cassandra DB
HI All, I am getting "*.UnauthorizedException: User has no SELECT permission on or any of its parents*" error while Spark job is fetching data from Cassandra but could able to save data into Cassandra with out any issues Note: With the same user , I could able to access and query the table in CQL UI and code used in Spark Job has been tested in Spark Shell and it is working fine Regards, Satish Chandra On Tue, Nov 17, 2015 at 11:45 PM, satish chandra jwrote: > HI All, > I am getting "*.UnauthorizedException: User has no SELECT > permission on or any of its parents*" error > while Spark job is fetching data from Cassandra but could able to save data > into Cassandra with out any issues > > Note: With the same user , I could able to access and query > the table in CQL UI and code used in Spark Job has been tested in Spark > Shell and it is working fine > > Please find the below stack trace > > WARN 2015-11-17 07:24:23 org.apache.spark.scheduler.DAGScheduler: > Creating new stage failed due to exception - job: 0 > > com.datastax.driver.core.exceptions.UnauthorizedException:* User <* > *UserIDXYZ**> has no SELECT permission on > or any of its parents* > > at > com.datastax.driver.core.exceptions.UnauthorizedException.copy(UnauthorizedException.java:36) > ~[cassandra-driver-core-2.1.7.1.jar:na] > > at > com.datastax.driver.core.DefaultResultSetFuture.extractCauseFromExecutionException(DefaultResultSetFuture.java:269) > ~[cassandra-driver-core-2.1.7.1.jar:na] > > at > com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:183) > ~[cassandra-driver-core-2.1.7.1.jar:na] > > at > com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:52) > ~[cassandra-driver-core-2.1.7.1.jar:na] > > at > com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:44) > ~[cassandra-driver-core-2.1.7.1.jar:na] > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ~[na:1.8.0_51] > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > ~[na:1.8.0_51] > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[na:1.8.0_51] > > at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_51] > > at > com.datastax.spark.connector.cql.SessionProxy.invoke(SessionProxy.scala:33) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at com.sun.proxy.$Proxy10.execute(Unknown Source) ~[na:na] > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ~[na:1.8.0_51] > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > ~[na:1.8.0_51] > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[na:1.8.0_51] > >at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_51] > > at > com.datastax.spark.connector.cql.SessionProxy.invoke(SessionProxy.scala:33) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at com.sun.proxy.$Proxy10.execute(Unknown Source) ~[na:na] > > at > com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates$$anonfun$tokenRanges$1.apply(DataSizeEstimates.scala:40) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at > com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates$$anonfun$tokenRanges$1.apply(DataSizeEstimates.scala:38) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at > com.datastax.spark.connector.cql.CassandraConnector$$anonfun$withSessionDo$1.apply(CassandraConnector.scala:110) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at > com.datastax.spark.connector.cql.CassandraConnector$$anonfun$withSessionDo$1.apply(CassandraConnector.scala:109) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at > com.datastax.spark.connector.cql.CassandraConnector.closeResourceAfterUse(CassandraConnector.scala:139) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at > com.datastax.spark.connector.cql.CassandraConnector.withSessionDo(CassandraConnector.scala:109) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at > com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates.tokenRanges$lzycompute(DataSizeEstimates.scala:38) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at > com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates.tokenRanges(DataSizeEstimates.scala:37) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at > com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates.dataSizeInBytes$lzycompute(DataSizeEstimates.scala:81) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > > at > com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates.dataSizeInBytes(DataSizeEstimates.scala:80) > ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] > >
Re: Issue while Spark Job fetching data from Cassandra DB
Have you considered polling Cassandra mailing list ? A brief search led to CASSANDRA-7894 FYI On Tue, Nov 17, 2015 at 7:24 PM, satish chandra jwrote: > HI All, > I am getting "*.UnauthorizedException: User has no SELECT > permission on or any of its parents*" error > while Spark job is fetching data from Cassandra but could able to save data > into Cassandra with out any issues > > Note: With the same user , I could able to access and query > the table in CQL UI and code used in Spark Job has been tested in Spark > Shell and it is working fine > > Regards, > Satish Chandra > > On Tue, Nov 17, 2015 at 11:45 PM, satish chandra j < > jsatishchan...@gmail.com> wrote: > >> HI All, >> I am getting "*.UnauthorizedException: User has no SELECT >> permission on or any of its parents*" >> error while Spark job is fetching data from Cassandra but could able to >> save data into Cassandra with out any issues >> >> Note: With the same user , I could able to access and query >> the table in CQL UI and code used in Spark Job has been tested in Spark >> Shell and it is working fine >> >> Please find the below stack trace >> >> WARN 2015-11-17 07:24:23 org.apache.spark.scheduler.DAGScheduler: >> Creating new stage failed due to exception - job: 0 >> >> com.datastax.driver.core.exceptions.UnauthorizedException:* User <* >> *UserIDXYZ**> has no SELECT permission on >> or any of its parents* >> >> at >> com.datastax.driver.core.exceptions.UnauthorizedException.copy(UnauthorizedException.java:36) >> ~[cassandra-driver-core-2.1.7.1.jar:na] >> >> at >> com.datastax.driver.core.DefaultResultSetFuture.extractCauseFromExecutionException(DefaultResultSetFuture.java:269) >> ~[cassandra-driver-core-2.1.7.1.jar:na] >> >> at >> com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:183) >> ~[cassandra-driver-core-2.1.7.1.jar:na] >> >> at >> com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:52) >> ~[cassandra-driver-core-2.1.7.1.jar:na] >> >> at >> com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:44) >> ~[cassandra-driver-core-2.1.7.1.jar:na] >> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> ~[na:1.8.0_51] >> >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> ~[na:1.8.0_51] >> >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> ~[na:1.8.0_51] >> >> at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_51] >> >> at >> com.datastax.spark.connector.cql.SessionProxy.invoke(SessionProxy.scala:33) >> ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] >> >> at com.sun.proxy.$Proxy10.execute(Unknown Source) ~[na:na] >> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> ~[na:1.8.0_51] >> >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> ~[na:1.8.0_51] >> >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> ~[na:1.8.0_51] >> >>at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_51] >> >> at >> com.datastax.spark.connector.cql.SessionProxy.invoke(SessionProxy.scala:33) >> ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] >> >> at com.sun.proxy.$Proxy10.execute(Unknown Source) ~[na:na] >> >> at >> com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates$$anonfun$tokenRanges$1.apply(DataSizeEstimates.scala:40) >> ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] >> >> at >> com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates$$anonfun$tokenRanges$1.apply(DataSizeEstimates.scala:38) >> ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] >> >> at >> com.datastax.spark.connector.cql.CassandraConnector$$anonfun$withSessionDo$1.apply(CassandraConnector.scala:110) >> ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] >> >> at >> com.datastax.spark.connector.cql.CassandraConnector$$anonfun$withSessionDo$1.apply(CassandraConnector.scala:109) >> ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] >> >> at >> com.datastax.spark.connector.cql.CassandraConnector.closeResourceAfterUse(CassandraConnector.scala:139) >> ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] >> >> at >> com.datastax.spark.connector.cql.CassandraConnector.withSessionDo(CassandraConnector.scala:109) >> ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] >> >> at >> com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates.tokenRanges$lzycompute(DataSizeEstimates.scala:38) >> ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] >> >> at >> com.datastax.spark.connector.rdd.partitioner.DataSizeEstimates.tokenRanges(DataSizeEstimates.scala:37) >> ~[spark-cassandra-connector_2.10-1.4.0.jar:1.4.0] >> >> at >>