Re: Spark UI shows Jobs are processing, but the files are already written to S3

2017-05-19 Thread Miles Crawford
of Active jobs and tasks according to > the UI. And my output is correct. > > > > Is there a JIRA item tracking this? > > > > *From:* Kuchekar [mailto:kuchekar.nil...@gmail.com] > *Sent:* Wednesday, November 16, 2016 10:00 AM > *To:* spark users > *Subject:* Spark U

RE: Spark UI shows Jobs are processing, but the files are already written to S3

2016-11-16 Thread Shreya Agarwal
, 2016 10:00 AM To: spark users Subject: Spark UI shows Jobs are processing, but the files are already written to S3 Hi, I am running a spark job, which saves the computed data (massive data) to S3. On the Spark Ui I see the some jobs are active, but no activity in the logs. Also on S3

Spark UI shows Jobs are processing, but the files are already written to S3

2016-11-16 Thread Kuchekar
Hi, I am running a spark job, which saves the computed data (massive data) to S3. On the Spark Ui I see the some jobs are active, but no activity in the logs. Also on S3 all the data has be written (verified each bucket --> it has _SUCCESS file) Am I missing something? Thanks. Kuchekar, Ni