Re: Spark session dies in about 2 days: HDFS_DELEGATION_TOKEN token can'tbe found

Mine is the same scenario. I get the HDFS_DELEGATION_TOKEN issue exactly after the 7 days of the spark job started and it then gets killed. Even I'm also looking for the solution. Regards, Nik. On Fri, Mar 11, 2016 at 8:10 PM, Ruslan Dautkhanov wrote: > [image: Boxbe]

Re: Spark Token Expired Exception

These are my versions cdh version = 5.4.1 spark version, 1.3.0 kafka = KAFKA-0.8.2.0-1.kafka1.3.1.p0.9 hbase versions = 1.0.0 Regards, Nik. On Wed, Jan 6, 2016 at 3:50 PM, Ted Yu wrote: > Which Spark / hadoop release are you using ? > > Thanks > > On Wed, Jan 6, 2016 at 12:1

Spark Token Expired Exception

Hello Team, Thank you for your time in advance. Below are the log lines of my spark job which is used for consuming the messages from Kafka Instance and its loading to Hbase. I have noticed the below Warn lines and later it resulted to errors. But I noticed that, exactly after 7 days the token

Re: Spark Job is getting killed after certain hours

e Loughran wrote: > > On 17 Nov 2015, at 02:00, Nikhil Gs wrote: > > Hello Team, > > Below is the error which we are facing in our cluster after 14 hours of > starting the spark submit job. Not able to understand the issue and why its > facing the below error after certain

Spark Job is getting killed after certain hours

Hello Team, Below is the error which we are facing in our cluster after 14 hours of starting the spark submit job. Not able to understand the issue and why its facing the below error after certain time. If any of you have faced the same scenario or if you have any idea then please guide us. To id

Re: Kafka streaming "at least once" semantics

Hello Everyone, Has anyone worked with Kafka in a scenario where the Streaming data from the Kafka consumer is picked by Spark (Java) functionality and directly placed in Hbase. Please let me know, we are completely new to this scenario. That will be very helpful. Regards, GS. Regards, Nik. On

Kafka and Spark combination

Has anyone worked with Kafka in a scenario where the Streaming data from the Kafka consumer is picked by Spark (Java) functionality and directly placed in Hbase. Regards, Gs.