Hi German Schiavon,

The property is supported in shuffle hash join strategy too and it was
renamed here https://github.com/apache/spark/pull/29079/files. Try with
*spark.sql.bucketing.coalesceBucketsInJoin.enabled* instead of
spark.sql.bucketing.coalesceBucketsInSortMergeJoin.enabled :)
(You can also find it in this table:
https://spark.apache.org/docs/latest/configuration.html#runtime-sql-configuration
)

Best,
Bartosz.

On Mon, Mar 22, 2021 at 8:52 AM German Schiavon <gschiavonsp...@gmail.com>
wrote:

> Hi all!
>
> In the 3.1.1 release a new bucket property was added in this PR
> <https://github.com/apache/spark/pull/28123>.
>
> I'm trying to check this new behaviour but I'm not getting the same
> physical plan as the one given in the example.
>
> I'm executing the same code snippet from the PR in a 3.1.1 spark-shell.
>
> What am I missing?
>
> Best
>


-- 
Bartosz Konieczny
data engineer
https://www.waitingforcode.com
https://github.com/bartosz25/
https://twitter.com/waitingforcode

Reply via email to