[ https://issues.apache.org/jira/browse/HIVE-24084?focusedWorklogId=477992&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477992 ]
ASF GitHub Bot logged work on HIVE-24084: ----------------------------------------- Author: ASF GitHub Bot Created on: 02/Sep/20 17:27 Start Date: 02/Sep/20 17:27 Worklog Time Spent: 10m Work Description: jcamachor commented on a change in pull request #1439: URL: https://github.com/apache/hive/pull/1439#discussion_r482243376 ########## File path: ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveAggregateJoinTransposeRule.java ########## @@ -303,6 +305,90 @@ public void onMatch(RelOptRuleCall call) { } } + /** + * Determines weather the give grouping is unique. + * + * Consider a join which might produce non-unique rows; but later the results are aggregated again. + * This method determines if there are sufficient columns in the grouping which have been present previously as unique column(s). + */ + private boolean isGroupingUnique(RelNode input, ImmutableBitSet groups) { + if (groups.isEmpty()) { + return false; + } + RelMetadataQuery mq = input.getCluster().getMetadataQuery(); + Set<ImmutableBitSet> uKeys = mq.getUniqueKeys(input); + for (ImmutableBitSet u : uKeys) { + if (groups.contains(u)) { + return true; + } + } + if (input instanceof Join) { + Join join = (Join) input; + RexBuilder rexBuilder = input.getCluster().getRexBuilder(); + SimpleConditionInfo cond = new SimpleConditionInfo(join.getCondition(), rexBuilder); + + if (cond.valid) { + ImmutableBitSet newGroup = groups.intersect(ImmutableBitSet.fromBitSet(cond.fields)); + RelNode l = join.getLeft(); + RelNode r = join.getRight(); + + int joinFieldCount = join.getRowType().getFieldCount(); + int lFieldCount = l.getRowType().getFieldCount(); + + ImmutableBitSet groupL = newGroup.get(0, lFieldCount); + ImmutableBitSet groupR = newGroup.get(lFieldCount, joinFieldCount).shift(-lFieldCount); + + if (isGroupingUnique(l, groupL)) { Review comment: Could you execute `areColumnsUnique` on the join input then? Wouldn't that simplify this logic? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 477992) Time Spent: 1h 20m (was: 1h 10m) > Enhance cost model to push down more Aggregates > ----------------------------------------------- > > Key: HIVE-24084 > URL: https://issues.apache.org/jira/browse/HIVE-24084 > Project: Hive > Issue Type: Improvement > Reporter: Zoltan Haindrich > Assignee: Zoltan Haindrich > Priority: Major > Labels: pull-request-available > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)