ilooner commented on a change in pull request #1409: DRILL-6644: Don't reserve
space for incoming probe batches unnecessarily during the build phase.
URL: https://github.com/apache/drill/pull/1409#discussion_r207436910
##########
File path:
exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/join/HashJoinMemoryCalculatorImpl.java
##########
@@ -391,7 +391,7 @@ private void calculateMemoryUsage()
// probe batch we sniffed.
// TODO when batch sizing project is complete we won't have to sniff
probe batches since
// they will have a well defined size.
- reservedMemory = incompletePartitionsBatchSizes + maxBuildBatchSize +
maxProbeBatchSize;
+ reservedMemory = incompletePartitionsBatchSizes + maxBuildBatchSize +
probeSizePredictor.getBatchSize();
Review comment:
I'm not sure. I think we need to get some clarification for the desired
behavior of operators. If the Drill engine is operating under the assumption
that ownership of VectorContainers passes to a downstream operator after a call
to next, then this is a bug that should be fixed.
I will ask a question on the dev list about this.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
