;
Date: Saturday, 7 February 2015 1:22 am
To: Praveen Garg mailto:praveen.g...@guavus.com>>
Cc: Raghavendra Pandey
mailto:raghavendra.pan...@gmail.com>>,
"user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: Shuffl
.org"
> Subject: Re: Shuffle read/write issue in spark 1.2
>
> Even I observed the same issue.
>
> On Fri, Feb 6, 2015 at 12:19 AM, Praveen Garg
> wrote:
>
>> Hi,
>>
>> While moving from spark 1.1 to spark 1.2, we are facing an issue where
>> Shuf
n Garg mailto:praveen.g...@guavus.com>>
Cc: "user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: Shuffle read/write issue in spark 1.2
Even I observed the same issue.
On Fri, Feb 6, 2015 at 12:19 AM, Praveen Garg
mailto:praveen.g...@gua
Even I observed the same issue.
On Fri, Feb 6, 2015 at 12:19 AM, Praveen Garg
wrote:
> Hi,
>
> While moving from spark 1.1 to spark 1.2, we are facing an issue where
> Shuffle read/write has been increased significantly. We also tried running
> the job by rolling back to spark 1.1 configuratio
Hi,
While moving from spark 1.1 to spark 1.2, we are facing an issue where Shuffle
read/write has been increased significantly. We also tried running the job by
rolling back to spark 1.1 configuration where we set spark.shuffle.manager to
hash and spark.shuffle.blockTransferService to nio. It d
