[jira] [Closed] (ASTERIXDB-1750) Loading Local Data cannot succeed
[ https://issues.apache.org/jira/browse/ASTERIXDB-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Li closed ASTERIXDB-1750. Resolution: Fixed > Loading Local Data cannot succeed > - > > Key: ASTERIXDB-1750 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1750 > Project: Apache AsterixDB > Issue Type: Bug > Environment: cluster with 16 nodes >Reporter: Mingda Li > > Now, I want to load the table catalog_sales in TPC-DS 100g data. There are > about 100 files in the local directory to load to AsterixDB. > But I met the problem: Cannot load an index that is not empty. > org.apache.hyracks.api.exceptions.HyracksException: Job failed on account of: > HYR0002: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load > an index that is not empty > at org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:212) > at > org.apache.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:48) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: HYR0002: > org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index > that is not empty > at > org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:62) > at org.apache.hyracks.control.nc.Task.run(Task.java:331) > ... 3 more > Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: > org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index > that is not empty > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84) > at org.apache.hyracks.control.nc.Task.run(Task.java:274) > ... 3 more > I can load the 100 files of catalog_returns table successfully. > I have checked such issue and find there has been such problem here: > https://www.mail-archive.com/dev@asterixdb.incubator.apache.org/mail2.html > https://www.mail-archive.com/dev@asterixdb.incubator.apache.org/msg03322.html > I am not sure if this has been solved. If so, how to solve the problem? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (ASTERIXDB-1750) Loading Local Data cannot succeed
[ https://issues.apache.org/jira/browse/ASTERIXDB-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Li reopened ASTERIXDB-1750: -- > Loading Local Data cannot succeed > - > > Key: ASTERIXDB-1750 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1750 > Project: Apache AsterixDB > Issue Type: Bug > Environment: cluster with 16 nodes >Reporter: Mingda Li > > Now, I want to load the table catalog_sales in TPC-DS 100g data. There are > about 100 files in the local directory to load to AsterixDB. > But I met the problem: Cannot load an index that is not empty. > org.apache.hyracks.api.exceptions.HyracksException: Job failed on account of: > HYR0002: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load > an index that is not empty > at org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:212) > at > org.apache.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:48) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: HYR0002: > org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index > that is not empty > at > org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:62) > at org.apache.hyracks.control.nc.Task.run(Task.java:331) > ... 3 more > Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: > org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index > that is not empty > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84) > at org.apache.hyracks.control.nc.Task.run(Task.java:274) > ... 3 more > I can load the 100 files of catalog_returns table successfully. > I have checked such issue and find there has been such problem here: > https://www.mail-archive.com/dev@asterixdb.incubator.apache.org/mail2.html > https://www.mail-archive.com/dev@asterixdb.incubator.apache.org/msg03322.html > I am not sure if this has been solved. If so, how to solve the problem? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ASTERIXDB-1750) Loading Local Data cannot succeed
[ https://issues.apache.org/jira/browse/ASTERIXDB-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747215#comment-15747215 ] Mingda Li commented on ASTERIXDB-1750: -- Fixed. I drop the dataset, build dataset again and reload the data. It can work for the second time loading. > Loading Local Data cannot succeed > - > > Key: ASTERIXDB-1750 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1750 > Project: Apache AsterixDB > Issue Type: Bug > Environment: cluster with 16 nodes >Reporter: Mingda Li > > Now, I want to load the table catalog_sales in TPC-DS 100g data. There are > about 100 files in the local directory to load to AsterixDB. > But I met the problem: Cannot load an index that is not empty. > org.apache.hyracks.api.exceptions.HyracksException: Job failed on account of: > HYR0002: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load > an index that is not empty > at org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:212) > at > org.apache.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:48) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: HYR0002: > org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index > that is not empty > at > org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:62) > at org.apache.hyracks.control.nc.Task.run(Task.java:331) > ... 3 more > Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: > org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index > that is not empty > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228) > at > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84) > at org.apache.hyracks.control.nc.Task.run(Task.java:274) > ... 3 more > I can load the 100 files of catalog_returns table successfully. > I have checked such issue and find there has been such problem here: > https://www.mail-archive.com/dev@asterixdb.incubator.apache.org/mail2.html > https://www.mail-archive.com/dev@asterixdb.incubator.apache.org/msg03322.html > I am not sure if this has been solved. If so, how to solve the problem? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ASTERIXDB-1750) Loading Local Data cannot succeed
[ https://issues.apache.org/jira/browse/ASTERIXDB-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingda Li updated ASTERIXDB-1750: - Description: Now, I want to load the table catalog_sales in TPC-DS 100g data. There are about 100 files in the local directory to load to AsterixDB. But I met the problem: Cannot load an index that is not empty. org.apache.hyracks.api.exceptions.HyracksException: Job failed on account of: HYR0002: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index that is not empty at org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:212) at org.apache.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: HYR0002: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index that is not empty at org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:62) at org.apache.hyracks.control.nc.Task.run(Task.java:331) ... 3 more Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index that is not empty at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228) at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84) at org.apache.hyracks.control.nc.Task.run(Task.java:274) ... 3 more I can load the 100 files of catalog_returns table successfully. I have checked such issue and find there has been such problem here: https://www.mail-archive.com/dev@asterixdb.incubator.apache.org/mail2.html https://www.mail-archive.com/dev@asterixdb.incubator.apache.org/msg03322.html I am not sure if this has been solved. If so, how to solve the problem? was: Now, I want to load the table catalog_sales in TPC-DS 100g data. There are about 100 files in the local directory to load to AsterixDB. But I met the problem: Cannot load an index that is not empty. org.apache.hyracks.api.exceptions.HyracksException: Job failed on account of: HYR0002: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index that is not empty at org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:212) at org.apache.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: HYR0002: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index that is not empty at org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:62) at org.apache.hyracks.control.nc.Task.run(Task.java:331) ... 3 more Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index that is not empty at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228) at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84) at org.apache.hyracks.control.nc.Task.run(Task.java:274) ... 3 more I can load the 100 files of catalog_returns table successfully. I have checked such issue and find there has been such problem here: https://www.mail-archive.com/dev@asterixdb.incubator.apache.org/mail2.html I am not sure if this has been solved. If so, how to solve the problem? > Loading Local Data cannot succeed > - > > Key: ASTERIXDB-1750 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1750 > Project: Apache AsterixDB > Issue Type: Bug > Environment: cluster with 16 nodes >Reporter: Mingda Li > > Now, I want to load the table catalog_sales in TPC-DS 100g data. There are > about 100 files in the local directory to load to AsterixDB. > But I met the problem: Cannot load an index that is not empty. > org.apache.hyracks.api.exceptions.HyracksException: Job failed on account of: > HYR0002: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load > an index that
[jira] [Created] (ASTERIXDB-1750) Loading Local Data cannot succeed
Mingda Li created ASTERIXDB-1750: Summary: Loading Local Data cannot succeed Key: ASTERIXDB-1750 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1750 Project: Apache AsterixDB Issue Type: Bug Environment: cluster with 16 nodes Reporter: Mingda Li Now, I want to load the table catalog_sales in TPC-DS 100g data. There are about 100 files in the local directory to load to AsterixDB. But I met the problem: Cannot load an index that is not empty. org.apache.hyracks.api.exceptions.HyracksException: Job failed on account of: HYR0002: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index that is not empty at org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:212) at org.apache.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: HYR0002: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index that is not empty at org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:62) at org.apache.hyracks.control.nc.Task.run(Task.java:331) ... 3 more Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot load an index that is not empty at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228) at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84) at org.apache.hyracks.control.nc.Task.run(Task.java:274) ... 3 more I can load the 100 files of catalog_returns table successfully. I have checked such issue and find there has been such problem here: https://www.mail-archive.com/dev@asterixdb.incubator.apache.org/mail2.html I am not sure if this has been solved. If so, how to solve the problem? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Change in asterixdb[master]: ASTERIXDB-1566, ASTERIXDB-1733: Hash Group By and Hash Join ...
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1566, ASTERIXDB-1733: Hash Group By and Hash Join conform to the memory budget .. Patch Set 41: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3530/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1056 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2b323e9a2141b4c1dd1652a360d2d9354d3bc3f5 Gerrit-PatchSet: 41 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Jianfeng Jia Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Wenhai Li Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1566, ASTERIXDB-1733: Hash Group By and Hash Join ...
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1566, ASTERIXDB-1733: Hash Group By and Hash Join conform to the memory budget .. Patch Set 41: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1056 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2b323e9a2141b4c1dd1652a360d2d9354d3bc3f5 Gerrit-PatchSet: 41 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Jianfeng Jia Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Wenhai Li Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1566, ASTERIXDB-1733: Hash Group By and Hash Join ...
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1566, ASTERIXDB-1733: Hash Group By and Hash Join conform to the memory budget .. Patch Set 41: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3529/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1056 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2b323e9a2141b4c1dd1652a360d2d9354d3bc3f5 Gerrit-PatchSet: 41 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Jianfeng Jia Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Wenhai Li Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1566, ASTERIXDB-1733: Hash Group By and Hash Join ...
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1056 to look at the new patch set (#41). Change subject: ASTERIXDB-1566, ASTERIXDB-1733: Hash Group By and Hash Join conform to the memory budget .. ASTERIXDB-1566, ASTERIXDB-1733: Hash Group By and Hash Join conform to the memory budget - External Hash Group By and Hash Join now conform to the memory budget (compiler.groupmemory and compiler.joinmemory) - For Optimzed Hybrid Hash Join, we calculate the expected hash table size when the build phase is done and try to spill one or more partitions if the freespace can't afford the hash table size. - For External Hash Group By, the number of hash entries (hash table size) is calculated based on an estimation of the aggregated tuple size and possible hash values for the given field size in that tuple. - Garbage Collection feature has been added to SerializableHashTable. For external hash group-by, whenever we spill a data partition to the disk, we also check the ratio of garbage in the hash table. If it's greater than the given threshold, we conduct a GC on Hash Table. Change-Id: I2b323e9a2141b4c1dd1652a360d2d9354d3bc3f5 --- M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/SetAsterixPhysicalOperatorsRule.java M asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml M asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm M hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/operators/physical/ExternalGroupByPOperator.java M hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/operators/physical/HybridHashJoinPOperator.java M hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/operators/physical/InMemoryHashJoinPOperator.java M hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/SetAlgebricksPhysicalOperatorsRule.java M hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/util/JoinUtils.java A hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/comm/IFrameTupleReversibleAppender.java M hyracks-fullstack/hyracks/hyracks-dataflow-common/src/main/java/org/apache/hyracks/dataflow/common/comm/io/FixedSizeFrameTupleAppender.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/FrameBufferManager.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/FramePoolBackedFrameBufferManager.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/IPartitionedTupleBufferManager.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/ISimpleFrameBufferManager.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/PreferToSpillFullyOccupiedFramePolicy.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/TupleInFrameListAccessor.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/VPartitionTupleBufferManager.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/group/HashSpillableTableFactory.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/group/external/ExternalGroupOperatorDescriptor.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/HybridHashJoinOperatorDescriptor.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/InMemoryHashJoin.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/InMemoryHashJoinOperatorDescriptor.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/OptimizedHybridHashJoin.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/join/OptimizedHybridHashJoinOperatorDescriptor.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/ISerializableTable.java M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/SerializableHashTable.java A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/SimpleSerializableHashTable.java M
Change in asterixdb[master]: Index-only plan step 3: Top-down Select and Join transformat...
Jenkins has posted comments on this change. Change subject: Index-only plan step 3: Top-down Select and Join transformation rule .. Patch Set 18: Integration-Tests-1 Integration Tests Timed Out https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1306/ : ABORTED -- To view, visit https://asterix-gerrit.ics.uci.edu/1350 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I60a2a61eb46851d4c16c8f17447e3ac9b0aca779 Gerrit-PatchSet: 18 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
[jira] [Commented] (ASTERIXDB-1711) Clean up class names
[ https://issues.apache.org/jira/browse/ASTERIXDB-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746309#comment-15746309 ] ASF subversion and git services commented on ASTERIXDB-1711: Commit 9267168f78be7faa1c0af495f83fa3eba07ecda5 in asterixdb's branch refs/heads/master from [~tillw] [ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=9267168 ] ASTERIXDB-1711: rename asterix_transaction_log - s/asterix_transaction_log/transaction_log/ - update storage version - remove some dead code Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb Reviewed-on: https://asterix-gerrit.ics.uci.edu/1368 Sonar-Qube: JenkinsTested-by: Jenkins Integration-Tests: Jenkins Reviewed-by: Michael Blow > Clean up class names > > > Key: ASTERIXDB-1711 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1711 > Project: Apache AsterixDB > Issue Type: Task > Components: AsterixDB, Hyracks >Reporter: Till >Assignee: Till > > Some classes have names that include "AQL" (even though they are not language > specific) or "Asterix" (even tough that's part of package names). > We should aim to name classes based on their functionality and clean up class > names that are not named that way. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Change in asterixdb[master]: ASTERIXDB-1711: rename asterix_transaction_log
Till Westmann has submitted this change and it was merged. Change subject: ASTERIXDB-1711: rename asterix_transaction_log .. ASTERIXDB-1711: rename asterix_transaction_log - s/asterix_transaction_log/transaction_log/ - update storage version - remove some dead code Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb Reviewed-on: https://asterix-gerrit.ics.uci.edu/1368 Sonar-Qube: JenkinsTested-by: Jenkins Integration-Tests: Jenkins Reviewed-by: Michael Blow --- M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/LogManagerProperties.java M asterixdb/asterix-yarn/src/main/resources/configs/local.xml M hyracks-fullstack/hyracks/hyracks-storage-am-common/src/main/java/org/apache/hyracks/storage/am/common/api/ITreeIndexMetaDataFrame.java 3 files changed, 8 insertions(+), 21 deletions(-) Approvals: Michael Blow: Looks good to me, approved Jenkins: Verified; No violations found; Verified diff --git a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/LogManagerProperties.java b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/LogManagerProperties.java index 083ccf6..c64bd4a 100644 --- a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/LogManagerProperties.java +++ b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/LogManagerProperties.java @@ -27,32 +27,26 @@ private static final long serialVersionUID = 2084227360840799662L; public static final String lineSeparator = System.getProperty("line.separator"); -public static final int LOG_MAGIC_NUMBER = 123456789; -public static final String LOG_DIR_SUFFIX = ".txnLogDir"; -private static final String DEFAULT_LOG_FILE_PREFIX = "asterix_transaction_log"; +private static final String DEFAULT_LOG_FILE_PREFIX = "transaction_log"; // follow the naming convention _ where number starts from 0 private final String logFilePrefix; private final String logDir; -public String logDirKey; // number of log pages in the log buffer private final int logPageSize; // number of log pages in the log buffer. private final int numLogPages; -// logBufferSize = logPageSize * numLogPages; -private final int logBufferSize; // maximum size of each log file private final long logPartitionSize; public LogManagerProperties(AsterixTransactionProperties txnProperties, String nodeId) { -this.logDirKey = new String(nodeId + LOG_DIR_SUFFIX); this.logPageSize = txnProperties.getLogBufferPageSize(); this.numLogPages = txnProperties.getLogBufferNumPages(); long logPartitionSize = txnProperties.getLogPartitionSize(); this.logDir = txnProperties.getLogDirectory(nodeId); this.logFilePrefix = DEFAULT_LOG_FILE_PREFIX; -this.logBufferSize = logPageSize * numLogPages; +int logBufferSize = logPageSize * numLogPages; //make sure that the log partition size is the multiple of log buffer size. this.logPartitionSize = (logPartitionSize / logBufferSize) * logBufferSize; } @@ -77,14 +71,7 @@ return numLogPages; } -public int getLogBufferSize() { -return logBufferSize; -} - -public String getLogDirKey() { -return logDirKey; -} - +@Override public String toString() { StringBuilder builder = new StringBuilder(); builder.append("log_dir_ : " + logDir + lineSeparator); diff --git a/asterixdb/asterix-yarn/src/main/resources/configs/local.xml b/asterixdb/asterix-yarn/src/main/resources/configs/local.xml index 76979b8..c026aef 100644 --- a/asterixdb/asterix-yarn/src/main/resources/configs/local.xml +++ b/asterixdb/asterix-yarn/src/main/resources/configs/local.xml @@ -21,13 +21,13 @@ local - /tmp/ - /tmp/ + /tmp/asterix-yarn/ + /tmp/asterix-yarn/ - /tmp + /tmp/asterix-yarn storage diff --git a/hyracks-fullstack/hyracks/hyracks-storage-am-common/src/main/java/org/apache/hyracks/storage/am/common/api/ITreeIndexMetaDataFrame.java b/hyracks-fullstack/hyracks/hyracks-storage-am-common/src/main/java/org/apache/hyracks/storage/am/common/api/ITreeIndexMetaDataFrame.java index 21e918d..653f6ae 100644 --- a/hyracks-fullstack/hyracks/hyracks-storage-am-common/src/main/java/org/apache/hyracks/storage/am/common/api/ITreeIndexMetaDataFrame.java +++ b/hyracks-fullstack/hyracks/hyracks-storage-am-common/src/main/java/org/apache/hyracks/storage/am/common/api/ITreeIndexMetaDataFrame.java @@ -23,9 +23,9 @@ public interface ITreeIndexMetaDataFrame { -//Storage version #. Change this if you alter any tree frame formats to stop +// Storage version #. Change this if you alter any
Change in asterixdb[master]: Full-text implementation step 2
Jenkins has posted comments on this change. Change subject: Full-text implementation step 2 .. Patch Set 4: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1305/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1383 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Idec6b602ff7797846fd237a924005031c2395346 Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1711: rename asterix_transaction_log
Michael Blow has posted comments on this change. Change subject: ASTERIXDB-1711: rename asterix_transaction_log .. Patch Set 5: Code-Review+2 -- To view, visit https://asterix-gerrit.ics.uci.edu/1368 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Index-only plan step 3: Top-down Select and Join transformat...
Jenkins has posted comments on this change. Change subject: Index-only plan step 3: Top-down Select and Join transformation rule .. Patch Set 18: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/33/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1350 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I60a2a61eb46851d4c16c8f17447e3ac9b0aca779 Gerrit-PatchSet: 18 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Index-only plan step 3: Top-down Select and Join transformat...
Jenkins has posted comments on this change. Change subject: Index-only plan step 3: Top-down Select and Join transformation rule .. Patch Set 18: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1306/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1350 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I60a2a61eb46851d4c16c8f17447e3ac9b0aca779 Gerrit-PatchSet: 18 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: some WebUI hackery
Jenkins has posted comments on this change. Change subject: some WebUI hackery .. Patch Set 16: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1304/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1097 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I32361a523e656c62a6bc878b1eed9750579097f9 Gerrit-PatchSet: 16 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1711: rename asterix_transaction_log
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1711: rename asterix_transaction_log .. Patch Set 5: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1303/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1368 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Full-text implementation step 2
Jenkins has posted comments on this change. Change subject: Full-text implementation step 2 .. Patch Set 4: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1305/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1383 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Idec6b602ff7797846fd237a924005031c2395346 Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: some WebUI hackery
Jenkins has posted comments on this change. Change subject: some WebUI hackery .. Patch Set 16: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/31/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1097 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I32361a523e656c62a6bc878b1eed9750579097f9 Gerrit-PatchSet: 16 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Introduce CheckpointManager API
Jenkins has posted comments on this change. Change subject: Introduce CheckpointManager API .. Patch Set 5: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1302/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/1380 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Index-only plan step 3: Top-down Select and Join transformat...
Jenkins has posted comments on this change. Change subject: Index-only plan step 3: Top-down Select and Join transformation rule .. Patch Set 18: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3528/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1350 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I60a2a61eb46851d4c16c8f17447e3ac9b0aca779 Gerrit-PatchSet: 18 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Index-only plan step 3: Top-down Select and Join transformat...
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1350 to look at the new patch set (#18). Change subject: Index-only plan step 3: Top-down Select and Join transformation rule .. Index-only plan step 3: Top-down Select and Join transformation rule - Converted IntroduceSelectAccessMethodRule and IntroduceJoinAccessMethodRule from bottom-up approach to top-down approach from the root operator. - Index-only plan needs to verify the variables that are live in the select or join condition are the only variables to be used afterwards unless a variable is generated after the select or join operator. - In order to keep this information, top-down approach needs to be introduced. Change-Id: I60a2a61eb46851d4c16c8f17447e3ac9b0aca779 --- M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodAnalysisContext.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceJoinAccessMethodRule.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IntroduceSelectAccessMethodRule.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexAccessMethod.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableOperatorSubTree.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/RTreeAccessMethod.java 8 files changed, 465 insertions(+), 234 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/50/1350/18 -- To view, visit https://asterix-gerrit.ics.uci.edu/1350 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I60a2a61eb46851d4c16c8f17447e3ac9b0aca779 Gerrit-PatchSet: 18 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Taewoo Kim Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu
Change in asterixdb[master]: some WebUI hackery
Jenkins has posted comments on this change. Change subject: some WebUI hackery .. Patch Set 16: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1304/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1097 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I32361a523e656c62a6bc878b1eed9750579097f9 Gerrit-PatchSet: 16 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1711: rename asterix_transaction_log
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1711: rename asterix_transaction_log .. Patch Set 5: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1303/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1368 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1711: rename asterix_transaction_log
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1711: rename asterix_transaction_log .. Patch Set 5: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/30/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1368 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Full-text implementation step 2
Jenkins has posted comments on this change. Change subject: Full-text implementation step 2 .. Patch Set 4: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3527/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1383 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Idec6b602ff7797846fd237a924005031c2395346 Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: Full-text implementation step 2
Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1383 to look at the new patch set (#4). Change subject: Full-text implementation step 2 .. Full-text implementation step 2 - Parameter checking during the compilation is now applied. Change-Id: Idec6b602ff7797846fd237a924005031c2395346 --- M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/compiler/provider/DefaultRuleSetFactory.java M asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java A asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/FullTextContainsParameterCheckRule.java 3 files changed, 248 insertions(+), 0 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/83/1383/4 -- To view, visit https://asterix-gerrit.ics.uci.edu/1383 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: Idec6b602ff7797846fd237a924005031c2395346 Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Taewoo KimGerrit-Reviewer: Jenkins Gerrit-Reviewer: Yingyi Bu
Change in asterixdb[master]: some WebUI hackery
Jenkins has posted comments on this change. Change subject: some WebUI hackery .. Patch Set 16: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3526/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1097 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I32361a523e656c62a6bc878b1eed9750579097f9 Gerrit-PatchSet: 16 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Yingyi Bu Gerrit-HasComments: No
Change in asterixdb[master]: some WebUI hackery
Hello Michael Blow, Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1097 to look at the new patch set (#16). Change subject: some WebUI hackery .. some WebUI hackery - use query/service endpoint (and SQL++) - add option to display JSON - some code simplification Change-Id: I32361a523e656c62a6bc878b1eed9750579097f9 --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/QueryServiceServlet.java M asterixdb/asterix-app/src/main/resources/queryui/css/master.css M asterixdb/asterix-app/src/main/resources/queryui/js/main.js M asterixdb/asterix-app/src/main/resources/queryui/queryui.html 4 files changed, 62 insertions(+), 57 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/97/1097/16 -- To view, visit https://asterix-gerrit.ics.uci.edu/1097 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I32361a523e656c62a6bc878b1eed9750579097f9 Gerrit-PatchSet: 16 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Yingyi Bu
Change in asterixdb[master]: Introduce CheckpointManager API
Jenkins has posted comments on this change. Change subject: Introduce CheckpointManager API .. Patch Set 5: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1302/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1380 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1711: rename asterix_transaction_log
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1711: rename asterix_transaction_log .. Patch Set 5: WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN: * asterixdb * hyracks-fullstack PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES! -- To view, visit https://asterix-gerrit.ics.uci.edu/1368 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1711: rename asterix_transaction_log
Jenkins has posted comments on this change. Change subject: ASTERIXDB-1711: rename asterix_transaction_log .. Patch Set 5: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3525/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1368 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: ASTERIXDB-1711: rename asterix_transaction_log
Hello abdullah alamoudi, Ian Maxon, Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1368 to look at the new patch set (#5). Change subject: ASTERIXDB-1711: rename asterix_transaction_log .. ASTERIXDB-1711: rename asterix_transaction_log - s/asterix_transaction_log/transaction_log/ - update storage version - remove some dead code Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb --- M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/LogManagerProperties.java M asterixdb/asterix-yarn/src/main/resources/configs/local.xml M hyracks-fullstack/hyracks/hyracks-storage-am-common/src/main/java/org/apache/hyracks/storage/am/common/api/ITreeIndexMetaDataFrame.java 3 files changed, 8 insertions(+), 21 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/68/1368/5 -- To view, visit https://asterix-gerrit.ics.uci.edu/1368 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Till WestmannGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu Gerrit-Reviewer: abdullah alamoudi
Change in asterixdb[master]: Introduce CheckpointManager API
Till Westmann has posted comments on this change. Change subject: Introduce CheckpointManager API .. Patch Set 4: (1 comment) https://asterix-gerrit.ics.uci.edu/#/c/1380/4/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/utils/StorageConstants.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/utils/StorageConstants.java: Line 29: private static final int LOCAL_STORAGE_VERSION = 1; > ITreeIndexMetaDataFrame.VERSION is Hyracks storage version. It shouldn't be Good point :) -- To view, visit https://asterix-gerrit.ics.uci.edu/1380 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: Yes
Change in asterixdb[master]: Introduce CheckpointManager API
Murtadha Hubail has posted comments on this change. Change subject: Introduce CheckpointManager API .. Patch Set 4: (3 comments) https://asterix-gerrit.ics.uci.edu/#/c/1380/4/asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java File asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java: Line 251: if (!pendingFailbackCompletion) { > It's not a checkpoint, but it's checkpointy ;) Done ;) https://asterix-gerrit.ics.uci.edu/#/c/1380/4/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/utils/StorageConstants.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/utils/StorageConstants.java: Line 29: private static final int LOCAL_STORAGE_VERSION = 1; > Why a separate version? ITreeIndexMetaDataFrame.VERSION is Hyracks storage version. It shouldn't be changed just because some Asterix related storage artifact format changed (e.g. checkpoint format). Ideally, even the Hyracks storage version should be passed from the App running on top of Hyracks. The VERSON attribute below combines both the Asterix version as well as the Hyracks storage version to ensure that if any of them changed then a version mismatch is encountered. https://asterix-gerrit.ics.uci.edu/#/c/1380/4/asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/recovery/CheckpointThread.java File asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/recovery/CheckpointThread.java: Line 28: /** > s/demon/daemon Done -- To view, visit https://asterix-gerrit.ics.uci.edu/1380 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d Gerrit-PatchSet: 4 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Murtadha Hubail Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: Yes
Change in asterixdb[master]: Introduce CheckpointManager API
Jenkins has posted comments on this change. Change subject: Introduce CheckpointManager API .. Patch Set 5: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1301/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1380 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Introduce CheckpointManager API
Jenkins has posted comments on this change. Change subject: Introduce CheckpointManager API .. Patch Set 5: Integration-Tests-1 Integration Tests Failed https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1300/ : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/1380 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Introduce CheckpointManager API
Jenkins has posted comments on this change. Change subject: Introduce CheckpointManager API .. Patch Set 5: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/29/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1380 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Introduce CheckpointManager API
Jenkins has posted comments on this change. Change subject: Introduce CheckpointManager API .. Patch Set 5: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/1300/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1380 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Introduce CheckpointManager API
Jenkins has posted comments on this change. Change subject: Introduce CheckpointManager API .. Patch Set 5: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3524/ -- To view, visit https://asterix-gerrit.ics.uci.edu/1380 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi Gerrit-HasComments: No
Change in asterixdb[master]: Introduce CheckpointManager API
Hello Till Westmann, Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/1380 to look at the new patch set (#5). Change subject: Introduce CheckpointManager API .. Introduce CheckpointManager API This change includes the following: - s/CheckpointObject/Checkpoint - Add AsterixDB storage version to checkpoints. - Prevent any txn log access when a storage version mismatch is detected. - Introduce CheckpointManager API and CheckpointProperties. - Properly stop checkpointing thread on instance shutdown. - Separate checkpointing logic when replication enabled/disabled. Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/AsterixNCAppRuntimeContext.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java M asterixdb/asterix-app/src/test/java/org/apache/asterix/test/logging/CheckpointingTest.java A asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/Checkpoint.java A asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/CheckpointProperties.java A asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/ICheckpointManager.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/ILogManager.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/IRecoveryManager.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/ITransactionManager.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/transactions/ITransactionSubsystem.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/utils/StorageConstants.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/logging/LogManager.java A asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/recovery/AbstractCheckpointManager.java A asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/recovery/CheckpointManager.java A asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/recovery/CheckpointManagerFactory.java D asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/recovery/CheckpointObject.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/recovery/CheckpointThread.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/recovery/RecoveryManager.java A asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/recovery/ReplicationCheckpointManager.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/transaction/TransactionManager.java M asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/transaction/TransactionSubsystem.java 21 files changed, 738 insertions(+), 352 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/80/1380/5 -- To view, visit https://asterix-gerrit.ics.uci.edu/1380 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I36c00ca195b93bbe1e53f39bb4a3b5a344657f0d Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha HubailGerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi