Re: How to know whether I'm in the first batch of spark streaming

2016-04-21 Thread Praveen Devarao
Sometimes courage is the quiet voice at the end of the day saying I will try again" From: Yu Xie To: Praveen Devarao/India/IBM@IBMIN Cc: user@spark.apache.org Date: 21/04/2016 01:40 pm Subject: Re: How to know whether I'm in the first batch of spark streaming

Re: How to know whether I'm in the first batch of spark streaming

2016-04-21 Thread Yu Xie
- > "Courage doesn't always roar. Sometimes courage is the quiet voice at the > end of the day saying I will try again" > > > > From:Yu Xie > To:user@spark.apache.org > D

Re: How to know whether I'm in the first batch of spark streaming

2016-04-21 Thread Praveen Devarao
park.apache.org Date: 19/04/2016 01:24 pm Subject: How to know whether I'm in the first batch of spark streaming hi spark users I'm running a spark streaming application, with concurrentJobs > 1, so maybe more than one batches could run together. Now I would like to do

How to know whether I'm in the first batch of spark streaming

2016-04-19 Thread Yu Xie
hi spark users I'm running a spark streaming application, with concurrentJobs > 1, so maybe more than one batches could run together. Now I would like to do some init work in the first batch based on the "time" of the first batch. So even the second batch runs faster than the first batch, I still