Hello Anon. E. Moose (1000171), Till Westmann, Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/3350
to look at the new patch set (#5).
Change subject: [NO ISSUE] Changed the minimum number of partitions in
optimized hybrid hash join - user model changes: no - storage format changes :
no - interface changes: no
......................................................................
[NO ISSUE] Changed the minimum number of partitions in optimized hybrid hash
join
- user model changes: no
- storage format changes : no
- interface changes: no
Details:
As asterixdb currently does not have statistics, the formula for calculating
the number of partitions for hybrid hash join does not give an accurate answer.
Also, the minimum number of the partitions to make is set to 2. However, in
case of having a big build relation, we may end up with 2 big partitions which
can cause several rounds of recursions. Simulations showed that setting 20 as
the minimum number of partitions can save more data in the memory and reduce
the rounds of recursions as each partition now holds less amount of data.
Change-Id: I0a92acbe43761121e9851a4f792f561d71eb9f61
---
M
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/PreferToSpillFullyOccupiedFramePolicy.java
M
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/OptimizedHybridHashJoinOperatorDescriptor.java
2 files changed, 9 insertions(+), 9 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb
refs/changes/50/3350/5
--
To view, visit https://asterix-gerrit.ics.uci.edu/3350
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I0a92acbe43761121e9851a4f792f561d71eb9f61
Gerrit-Change-Number: 3350
Gerrit-PatchSet: 5
Gerrit-Owner: Shiva Jahangiri <[email protected]>
Gerrit-Reviewer: Anon. E. Moose (1000171)
Gerrit-Reviewer: Jenkins <[email protected]>
Gerrit-Reviewer: Till Westmann <[email protected]>
