Hi Guru, I am executing this on DataStax Enterprise Spark node and ~/.dserc file exists which consists Cassandra credentials but still getting the error
Below is the given command dse spark-submit --master spark://10.246.43.15:7077 --class HelloWorld --jars ///home/missingmerch/postgresql-9.4-1201.jdbc41.jar ///home/missingmerch/etl-0.0.1-SNAPSHOT.jar Please find the error log details below INFO 2015-07-31 05:15:17 org.apache.spark.executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT] INFO 2015-07-31 05:15:18 org.apache.spark.SecurityManager: Changing view acls to: cassandra,missingmerch INFO 2015-07-31 05:15:18 org.apache.spark.SecurityManager: Changing modify acls to: cassandra,missingmerch INFO 2015-07-31 05:15:18 org.apache.spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(cassandra, missingmerch); users with modify permissions: Set(cassandra, missingmerch) INFO 2015-07-31 05:15:22 akka.event.slf4j.Slf4jLogger: Slf4jLogger started INFO 2015-07-31 05:15:22 Remoting: Starting remoting INFO 2015-07-31 05:15:22 Remoting: Remoting started; listening on addresses :[akka.tcp:// driverPropsFetcher@10.246.43.14<mailto://driverPropsFetcher@10.246.43.14 >:48952] INFO 2015-07-31 05:15:22 org.apache.spark.util.Utils: Successfully started service 'driverPropsFetcher' on port 48952. INFO 2015-07-31 05:15:24 akka.remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon. INFO 2015-07-31 05:15:24 akka.remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports. INFO 2015-07-31 05:15:24 org.apache.spark.SecurityManager: Changing view acls to: cassandra,missingmerch INFO 2015-07-31 05:15:24 org.apache.spark.SecurityManager: Changing modify acls to: cassandra,missingmerch INFO 2015-07-31 05:15:24 org.apache.spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(cassandra, missingmerch); users with modify permissions: Set(cassandra, missingmerch) INFO 2015-07-31 05:15:24 akka.event.slf4j.Slf4jLogger: Slf4jLogger started INFO 2015-07-31 05:15:24 akka.remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down. INFO 2015-07-31 05:15:24 Remoting: Starting remoting INFO 2015-07-31 05:15:24 Remoting: Remoting started; listening on addresses :[akka.tcp:// sparkExecutor@10.246.43.14<mailto://sparkExecutor@10.246.43.14>:56358] INFO 2015-07-31 05:15:24 org.apache.spark.util.Utils: Successfully started service 'sparkExecutor' on port 56358. INFO 2015-07-31 05:15:24 org.apache.spark.executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkdri...@tstl400029.wal-mart.com<mailto:// sparkdri...@tstl400029.wal-mart.com>:60525/user/CoarseGrainedScheduler INFO 2015-07-31 05:15:24 org.apache.spark.deploy.worker.WorkerWatcher: Connecting to worker akka.tcp://sparkWorker@10.246.43.14<mailto:// sparkWorker@10.246.43.14>:51552/user/Worker INFO 2015-07-31 05:15:24 org.apache.spark.deploy.worker.WorkerWatcher: Successfully connected to akka.tcp://sparkWorker@10.246.43.14<mailto:// sparkWorker@10.246.43.14>:51552/user/Worker INFO 2015-07-31 05:15:24 org.apache.spark.executor.CoarseGrainedExecutorBackend: Successfully registered with driver INFO 2015-07-31 05:15:24 org.apache.spark.executor.Executor: Starting executor ID 0 on host 10.246.43.14 INFO 2015-07-31 05:15:24 org.apache.spark.SecurityManager: Changing view acls to: cassandra,missingmerch INFO 2015-07-31 05:15:24 org.apache.spark.SecurityManager: Changing modify acls to: cassandra,missingmerch INFO 2015-07-31 05:15:24 org.apache.spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(cassandra, missingmerch); users with modify permissions: Set(cassandra, missingmerch) INFO 2015-07-31 05:15:24 org.apache.spark.util.AkkaUtils: Connecting to MapOutputTracker: akka.tcp://sparkdri...@tstl400029.wal-mart.com<mailto:// sparkdri...@tstl400029.wal-mart.com>:60525/user/MapOutputTracker INFO 2015-07-31 05:15:25 org.apache.spark.util.AkkaUtils: Connecting to BlockManagerMaster: akka.tcp://sparkdri...@tstl400029.wal-mart.com<mailto:// sparkdri...@tstl400029.wal-mart.com>:60525/user/BlockManagerMaster INFO 2015-07-31 05:15:25 org.apache.spark.storage.DiskBlockManager: Created local directory at /var/lib/spark/rdd/spark-2ab3a70e-2bdd-4ab5-9aff-fa48224f14d4/spark-c1430eaf-272d-41d5-acd1-ac88dbca4698/spark-b102f621-e107-4684-96cd-910ed4f2c0cf/spark-7e5ab6f6-3433-4e69-adcc-318083c37c4a INFO 2015-07-31 05:15:25 org.apache.spark.storage.MemoryStore: MemoryStore started with capacity 265.4 MB INFO 2015-07-31 05:15:31 org.apache.spark.network.netty.NettyBlockTransferService: Server created on 60707 INFO 2015-07-31 05:15:31 org.apache.spark.storage.BlockManagerMaster: Trying to register BlockManager INFO 2015-07-31 05:15:31 org.apache.spark.storage.BlockManagerMaster: Registered BlockManager INFO 2015-07-31 05:15:31 org.apache.spark.executor.Executor: Using REPL class URI: http://10.246.43.15:48903 INFO 2015-07-31 05:15:31 org.apache.spark.util.AkkaUtils: Connecting to HeartbeatReceiver: akka.tcp://sparkdri...@tstl400029.wal-mart.com<mailto:// sparkdri...@tstl400029.wal-mart.com>:60525/user/HeartbeatReceiver On Tue, Aug 4, 2015 at 8:38 AM, Guru Medasani <gdm...@gmail.com> wrote: > Hi Satish, > > Can you add more error or log info to the email? > > > Guru Medasani > gdm...@gmail.com > > > > On Jul 31, 2015, at 1:06 AM, satish chandra j <jsatishchan...@gmail.com> > wrote: > > HI, > I have submitted a Spark Job with options jars,class,master as *local* > but i am getting an error as below > > *dse spark-submit spark error exception in thread main > java.io.ioexception: Invalid Request Exception(Why you have not logged in)* > > *Note: submitting datastax spark node* > > please let me know if anybody have a solutions for this issue > > > > Regards, > Saish Chandra > > >
