reduceLocality.enabled is the configuration of Spark, not
>> Spark SQL.
>>
>>
>>
>> From: Todd [mailto:bit1...@163.com]
>> Sent: Friday, September 11, 2015 3:39 PM
>> To: Todd
>> Cc: Cheng, Hao; Jesse F Chen; Michael Armbrust; user@spark.apache.org
>> S
> Davies Liu ---09/11/2015 10:41:23 AM---On Fri, Sep 11, 2015 at 10:31 AM,
> Jesse F Chen wrote: >
>
> From: Davies Liu
> To: Jesse F Chen/San Francisco/IBM@IBMUS
> Cc: "Cheng, Hao" , Todd , Michael
> Armbrust , "user@spark.apache.org"
>
ancisco/IBM@IBMUS
Cc: "Cheng, Hao" , Todd ,
Michael Armbrust ,
"user@spark.apache.org"
Date: 09/11/2015 10:41 AM
Subject: Re: Re:Re:RE: Re:RE: spark 1.5 SQL slows down dramatically by
50%+ compared with spark 1.4.1 SQL
On Fri, Se
n/San Francisco/IBM@IBMUS, Michael Armbrust
> , "user@spark.apache.org"
> Date: 09/11/2015 01:00 AM
> Subject: RE: Re:Re:RE: Re:RE: spark 1.5 SQL slows down dramatically by 50%+
> compared with spark 1.4.1 SQL
>
>
>
>
>
>
;
> From: Todd [mailto:bit1...@163.com]
> Sent: Friday, September 11, 2015 3:39 PM
> To: Todd
> Cc: Cheng, Hao; Jesse F Chen; Michael Armbrust; user@spark.apache.org
> Subject: Re:Re:RE: Re:RE: spark 1.5 SQL slows down dramatically by 50%+
> compared with spark 1.4.1 SQL
>
>
l Armbrust
, "user@spark.apache.org"
Date: 09/11/2015 01:00 AM
Subject: RE: Re:Re:RE: Re:RE: spark 1.5 SQL slows down dramatically by
50%+ compared with spark 1.4.1 SQL
Can you confirm if the query really run in the cluster mode? Not the local
1.5 SQL slows down dramatically by 50%+
compared with spark 1.4.1 SQL
I add the following two options:
spark.sql.planner.sortMergeJoin=false
spark.shuffle.reduceLocality.enabled=false
But it still performs the same as not setting them two.
One thing is that on the spark ui, when I click the
, September 11, 2015 3:39 PM
To: Todd
Cc: Cheng, Hao; Jesse F Chen; Michael Armbrust; user@spark.apache.org
Subject: Re:Re:RE: Re:RE: spark 1.5 SQL slows down dramatically by 50%+
compared with spark 1.4.1 SQL
I add the following two options:
spark.sql.planner.sortMergeJoin=false
I add the following two options:
spark.sql.planner.sortMergeJoin=false
spark.shuffle.reduceLocality.enabled=false
But it still performs the same as not setting them two.
One thing is that on the spark ui, when I click the SQL tab, it shows an empty
page but the header title 'SQL',there is no tab
