CoalesceShufflePartitions will merge small partitions into bigger
ones. Say, if you set maxShuffledHashJoinLocalMapThreshold to 32MB,
but the advisoryPartitionSize is 64MB, then the final each reducer
partition size will be close to 64MB. It breaks the
maxShuffledHashJoinLocalMapThreshold. So we
dear community,
I want to
setmaxShuffledHashJoinLocalMapThreshold to enable convert smj to
hash join,but I foundmaxShuffledHashJoinLocalMapThreshold must be large
thanadvisoryPartitionSize. I want to know what happend
ifmaxShuffledHashJoinLocalMapThreshold
