Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Anon. E. Moose #1000171 has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 9: Contrib-2 Analytics Compatibility Tests Failed https://goo.gl/mToR9N : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 9 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][RT] Replace HybridHashJoin with OptimizedHybridHa...
Anon. E. Moose #1000171 has posted comments on this change. Change subject: [NO ISSUE][RT] Replace HybridHashJoin with OptimizedHybridHashJoin .. Patch Set 4: Analytics Compatibility Tests Failed https://goo.gl/n9tYJW : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/3023 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I6ed612cc233af1b78d453c7b711077b82e721e82 Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/5055/ (1/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/10195/ (7/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/4625/ (10/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Hello Anon. E. Moose #1000171, Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1993 to look at the new patch set (#10). Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin - user model changes: no - storage format changes: no - interface changes: no Details: The current SerializableHashTable used in InMemoryHashJoin is too complicated and inefficient for in-memory-join. As the tuple number in in memory join is fixed, we don't need to consider spill or overflow issues. Also, SerializableHashTable will cause extra memory lookup (2 per each entry) and have larger probability to have cache misses. LinearHashTable only needs 1 lookup per each entry and have better chance to be cached. Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 --- M hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/operators/physical/HybridHashJoinPOperator.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/exceptions/ErrorCode.java M hyracks-fullstack/hyracks/hyracks-api/src/main/resources/errormsg/en.properties D hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/HybridHashJoinOperatorDescriptor.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/InMemoryHashJoin.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/OptimizedHybridHashJoin.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/OptimizedHybridHashJoinOperatorDescriptor.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/IntSerDeBuffer.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/LinearProbeHashTable.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/SimpleSerializableHashTable.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/test/java/org/apache/hyracks/dataflow/std/structures/LinearProbeHashTableTest.java D hyracks-fullstack/hyracks/hyracks-examples/hyracks-integration-tests/src/test/java/org/apache/hyracks/tests/integration/TPCHCustomerOptimizedHybridHashJoinTest.java M hyracks-fullstack/hyracks/hyracks-examples/hyracks-integration-tests/src/test/java/org/apache/hyracks/tests/integration/TPCHCustomerOrderHashJoinTest.java 13 files changed, 742 insertions(+), 1,288 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/93/1993/10 -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/4935/ (4/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/5284/ (11/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-stabilization-f69489-compat/144/ (12/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Contrib+1 BAD Compatibility Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/3786/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/7541/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-format/4680/ (6/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/4713/ (5/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-ensure-ancestor/2724/ (3/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/4716/ (9/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/8662/ (2/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/4936/ (5/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-openjdk11/146/ (13/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/3786/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][RT] Replace HybridHashJoin with OptimizedHybridHa...
Anon. E. Moose #1000171 has posted comments on this change. Change subject: [NO ISSUE][RT] Replace HybridHashJoin with OptimizedHybridHashJoin .. Patch Set 4: Analytics Compatibility Tests Failed https://goo.gl/6CyQcN : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/3023 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I6ed612cc233af1b78d453c7b711077b82e721e82 Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/5100/ (8/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-openjdk11/145/ (13/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/7540/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-stabilization-f69489-compat/145/ (12/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Anon. E. Moose #1000171 has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Analytics Compatibility Compilation Successful https://goo.gl/41mgUW : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/7541/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/5101/ (7/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
[jira] [Created] (ASTERIXDB-2478) Feed Ingestion stucks after ingesting millions records.
Taewoo Kim created ASTERIXDB-2478: - Summary: Feed Ingestion stucks after ingesting millions records. Key: ASTERIXDB-2478 URL: https://issues.apache.org/jira/browse/ASTERIXDB-2478 Project: Apache AsterixDB Issue Type: Bug Reporter: Taewoo Kim Assignee: Murtadha Hubail Attachments: logs2.tar.gz This is the new cloudberry cluster that consists of five NUC machines. Originally, about three months ago, we were able to ingest 1.2 billion records to this cluster. The day before yesterday, we started ingesting our tweet records using the current master branch. After ingesting 70 million records, the feed process was not progressing at all. The log record at that moment did not show any particular errors. [~idleft] and [~luochen01] investigated this issue and suggested us to try another commit (b2eb44177e7ac6bd180c7bc325cf007fb925c9e2) to see whether it works. It does not work. The symptom happened again. Here, (1) the log records for the current master and (2) the log records for the commit b2eb44177e7ac6bd180c7bc325cf007fb925c9e2 are attached. (1) [https://drive.google.com/file/d/1LZNPjcIvZXbYYk53wZ4Pc6emfjCwFrUi/view?usp=sharing] (2) logs2.tar.gz (see the attachment) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Hello Anon. E. Moose #1000171, Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1993 to look at the new patch set (#11). Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin - user model changes: no - storage format changes: no - interface changes: no Details: The current SerializableHashTable used in InMemoryHashJoin is too complicated and inefficient for in-memory-join. As the tuple number in in memory join is fixed, we don't need to consider spill or overflow issues. Also, SerializableHashTable will cause extra memory lookup (2 per each entry) and have larger probability to have cache misses. LinearHashTable only needs 1 lookup per each entry and have better chance to be cached. Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 --- M hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/operators/physical/HybridHashJoinPOperator.java M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/exceptions/ErrorCode.java M hyracks-fullstack/hyracks/hyracks-api/src/main/resources/errormsg/en.properties D hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/HybridHashJoinOperatorDescriptor.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/InMemoryHashJoin.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/OptimizedHybridHashJoin.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/OptimizedHybridHashJoinOperatorDescriptor.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/IntSerDeBuffer.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/LinearProbeHashTable.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/SimpleSerializableHashTable.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/test/java/org/apache/hyracks/dataflow/std/structures/LinearProbeHashTableTest.java D hyracks-fullstack/hyracks/hyracks-examples/hyracks-integration-tests/src/test/java/org/apache/hyracks/tests/integration/TPCHCustomerOptimizedHybridHashJoinTest.java M hyracks-fullstack/hyracks/hyracks-examples/hyracks-integration-tests/src/test/java/org/apache/hyracks/tests/integration/TPCHCustomerOrderHashJoinTest.java 13 files changed, 742 insertions(+), 1,288 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/93/1993/11 -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/4717/ (3/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/8663/ (1/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/4714/ (9/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/4626/ (11/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/5285/ (8/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-ensure-ancestor/2725/ (2/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-format/4681/ (6/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/5056/ (10/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 11: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/10196/ (4/13) -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 11 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Jenkins has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/7540/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
Change in asterixdb[master]: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHa...
Anon. E. Moose #1000171 has posted comments on this change. Change subject: [ASTERIXDB-2086][RT] Use LinearProbeHashTable for InMemoryHashJoin .. Patch Set 10: Analytics Compatibility Compilation Successful https://goo.gl/sEdf72 : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1993 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I61e11d8223902cc34e81738660c1b3ed0ab86318 Gerrit-PatchSet: 10 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Xikui Wang Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Xikui Wang Gerrit-HasComments: No
