okumin commented on code in PR #5478:
URL: https://github.com/apache/hive/pull/5478#discussion_r2027027151
##########
ql/src/java/org/apache/hadoop/hive/ql/exec/OperatorUtils.java:
##########
@@ -385,17 +385,22 @@ public static int countOperatorsUpstream(Operator<?>
start, Set<Class<? extends
}
public static void setMemoryAvailable(final List<Operator<? extends
OperatorDesc>> operators,
- final long memoryAvailableToTask) {
- if (operators == null) {
+ final long memoryAvailable) {
+ if (operators == null || operators.isEmpty()) {
return;
}
+ final long memoryAvailablePerOperator = memoryAvailable / operators.size();
Review Comment:
In my impression, my naive approach is likely to work in most cases because
SWO is likely to merge similar processing. But it would be nice if we could
find good heuristics to calculate the cost here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscr...@hive.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscr...@hive.apache.org
For additional commands, e-mail: gitbox-h...@hive.apache.org
