mailto:ste...@hortonworks.com>>
Date: Friday, September 16, 2016 at 3:46 AM
To: Chen Kevin mailto:kevin.c...@neustar.biz>>
Cc: "user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: Missing output partition file
,
Kevin
From: Steve Loughran mailto:ste...@hortonworks.com>>
Date: Friday, September 16, 2016 at 3:46 AM
To: Chen Kevin mailto:kevin.c...@neustar.biz>>
Cc: "user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: Missing o
Sent from my iPhone
> On Sep 15, 2016, at 1:37 PM, Chen, Kevin wrote:
>
> Hi,
>
> Has any one encountered an issue of missing output partition file in S3 ? My
> spark job writes output to a S3 location. Occasionally, I noticed one
> partition file is missing. As a result, one chunk of data
are you using speculation?
On 15 September 2016 at 21:37, Chen, Kevin wrote:
> Hi,
>
> Has any one encountered an issue of missing output partition file in S3 ?
> My spark job writes output to a S3 location. Occasionally, I noticed one
> partition file is missing. As a result, one chunk of data
On 15 Sep 2016, at 19:37, Chen, Kevin
mailto:kevin.c...@neustar.biz>> wrote:
Hi,
Has any one encountered an issue of missing output partition file in S3 ? My
spark job writes output to a S3 location. Occasionally, I noticed one partition
file is missing. As a result, one chunk of data was los
