jcamachor commented on a change in pull request #877: HIVE-22538: RS
deduplication does not always enforce
hive.optimize.reducededuplication.min.reducer
URL: https://github.com/apache/hive/pull/877#discussion_r371062397
##########
File path:
ql/src/test/results/clientpositive/llap/dynamic_semijoin_reduction_3.q.out
##########
@@ -814,30 +791,20 @@ STAGE PLANS:
Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE
Column stats: NONE
Group By Operator
aggregations: compute_stats(a, 'hll'), compute_stats(b,
'hll')
- minReductionHashAggr: 0.99
- mode: hash
+ mode: complete
Review comment:
It seems this complete mode is only happening for write type INSERT... I am
wondering whether we are setting up the number of reducers to 1 too
aggressively since INSERT does not need a single instance.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
