Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Murtadha Hubail has submitted this change and it was merged.
Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition
..
[NO ISSUE][CLUS] Add Metadata Cluster Partition
- user model changes: no
- storage format changes: no
- interface changes: yes
Details:
- Add a cluster partition reference to the cluster
partition in which metadata is stored. This allows
the initial metadata node to be removed from the
cluster and another metadata node to be assigned
to that metadata cluster partition. Initially,
it is assigned to the first partition of the first
metadata node.
- Use metadata cluster partition in defining metadata
datasets file splits instead of the assumption of the
first partition on the initial metadata node.
Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8
Reviewed-on: https://asterix-gerrit.ics.uci.edu/2348
Sonar-Qube: Jenkins
Integration-Tests: Jenkins
Reviewed-by: Michael Blow
Tested-by: Jenkins
Contrib: Jenkins
---
M
asterixdb/asterix-app/src/test/java/org/apache/asterix/runtime/ClusterStateManagerTest.java
M
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java
M
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java
M
asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/utils/ClusterStateManager.java
4 files changed, 53 insertions(+), 22 deletions(-)
Approvals:
Anon. E. Moose #1000171:
Jenkins: Verified; No violations found; ; Verified
Michael Blow: Looks good to me, approved
diff --git
a/asterixdb/asterix-app/src/test/java/org/apache/asterix/runtime/ClusterStateManagerTest.java
b/asterixdb/asterix-app/src/test/java/org/apache/asterix/runtime/ClusterStateManagerTest.java
index 4dd7463..4beb44a 100644
---
a/asterixdb/asterix-app/src/test/java/org/apache/asterix/runtime/ClusterStateManagerTest.java
+++
b/asterixdb/asterix-app/src/test/java/org/apache/asterix/runtime/ClusterStateManagerTest.java
@@ -231,6 +231,7 @@
private MetadataProperties mockMetadataProperties() {
SortedMap clusterPartitions =
Collections.synchronizedSortedMap(new TreeMap<>());
Map nodePartitionsMap = new
ConcurrentHashMap<>();
+nodePartitionsMap.put(METADATA_NODE, new ClusterPartition[] { new
ClusterPartition(0, METADATA_NODE, 0) });
MetadataProperties metadataProperties =
Mockito.mock(MetadataProperties.class);
Mockito.when(metadataProperties.getMetadataNodeName()).thenReturn(METADATA_NODE);
Mockito.when(metadataProperties.getClusterPartitions()).thenReturn(clusterPartitions);
diff --git
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java
index 5b7e5a7..0a5707e 100644
---
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java
+++
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java
@@ -224,4 +224,18 @@
boolean cancelRemovePending(String nodeId);
Map> getActiveNcConfiguration();
+
+/**
+ * Sets the cluster partition in which metadata datasets stored
+ *
+ * @param partition
+ */
+void setMetadataPartitionId(ClusterPartition partition);
+
+/**
+ * Gets the cluster partition in which metadata datasets are stored
+ *
+ * @return The metadata cluster partitions
+ */
+ClusterPartition getMetadataPartition();
}
diff --git
a/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java
b/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java
index 2a6d0e8..8ac69e4 100644
---
a/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java
+++
b/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java
@@ -20,6 +20,8 @@
import java.io.File;
import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Collections;
import java.util.List;
import org.apache.asterix.common.cluster.ClusterPartition;
@@ -71,20 +73,11 @@
String indexName, List nodes) {
final String relPath =
StoragePathUtil.prepareDataverseIndexName(dataset.getDataverseName(),
dataset.getDatasetName(), indexName,
dataset.getRebalanceCount());
-List splits = new ArrayList<>();
-for (String nd : nodes) {
-int numPartitions = clusterStateManager.getNodePartitionsCount(nd);
-ClusterPartition[] nodePartitions =
clusterStateManager.getNodePartitions(nd);
-// currently this case is never executed since the metadata group
doesn't exists
-if
(dataset.getNodeGroupName().compareTo
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Contrib+1 BAD Compatibility Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/2619/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: BAD Compatibility Tests Started https://asterix-jenkins.ics.uci.edu/job/asterixbad-compat/2619/ -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/2521/ (12/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/2517/ (12/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/2515/ (12/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Michael Blow has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Code-Review+2 (1 comment) https://asterix-gerrit.ics.uci.edu/#/c/2348/3/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java File asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java: Line 229: * Sets the cluster partition in which metadata datasets stored ^ are -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: Yes
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/2511/ (12/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Integration-Tests+1 Integration Tests Successful https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/5482/ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Anon. E. Moose #1000171 has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Contrib+1 Analytics Compatibility Tests Successful https://goo.gl/7cM8eJ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/3073/ (12/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/3054/ (11/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/3306/ (10/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/5482/ -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Anon. E. Moose #1000171 has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Analytics Compatibility Compilation Successful https://goo.gl/SnuuzH : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/2786/ (1/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/6507/ (5/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/3087/ (4/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/2510/ (9/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-format/2515/ (3/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Hello Anon. E. Moose #1000171, Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/2348 to look at the new patch set (#3). Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. [NO ISSUE][CLUS] Add Metadata Cluster Partition - user model changes: no - storage format changes: no - interface changes: yes Details: - Add a cluster partition reference to the cluster partition in which metadata is stored. This allows the initial metadata node to be removed from the cluster and another metadata node to be assigned to that metadata cluster partition. Initially, it is assigned to the first partition of the first metadata node. - Use metadata cluster partition in defining metadata datasets file splits instead of the assumption of the first partition on the initial metadata node. Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 --- M asterixdb/asterix-app/src/test/java/org/apache/asterix/runtime/ClusterStateManagerTest.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/utils/ClusterStateManager.java 4 files changed, 53 insertions(+), 22 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/48/2348/3 -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/2458/ (6/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/2498/ (8/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/8011/ (7/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 3: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-ensure-ancestor/564/ (2/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 3 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-asterix-app/3071/ (12/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-verify-no-installer-app/3052/ (11/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/3304/ (10/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Integration Tests Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/5480/ -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Anon. E. Moose #1000171 has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Contrib+1 Analytics Compatibility Tests Successful https://goo.gl/mX8MLZ : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/2508/ (9/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Anon. E. Moose #1000171 has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Analytics Compatibility Compilation Successful https://goo.gl/831Hvs : SUCCESS -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Hello Anon. E. Moose #1000171, Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/2348 to look at the new patch set (#2). Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. [NO ISSUE][CLUS] Add Metadata Cluster Partition - user model changes: no - storage format changes: no - interface changes: yes Details: - Add a cluster partition reference to the cluster partition in which metadata is stored. This allows the initial metadata node to be removed from the cluster and another metadata node to be assigned to that metadata cluster partition. Initially, it is assigned to the first partition of the first metadata node. - Use metadata cluster partition in defining metadata datasets file splits instead of the assumption of the first partition on the initial metadata node. Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/message/MetadataNodeResponseMessage.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java M asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/utils/ClusterStateManager.java 4 files changed, 54 insertions(+), 24 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/48/2348/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-format/2513/ (3/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/2784/ (1/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-ensure-ancestor/562/ (4/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/3085/ (5/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/2496/ (7/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/8009/ (8/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/2456/ (2/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 2: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/6505/ (6/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Anon. E. Moose #1000171 has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 1: Contrib-2 Analytics Compatibility Compilation Failed https://goo.gl/PN8uti : UNSTABLE -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-sonar/6503/ (5/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/2782/ (7/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-ensure-ancestor/560/ (4/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Murtadha Hubail has uploaded a new change for review.
https://asterix-gerrit.ics.uci.edu/2348
Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition
..
[NO ISSUE][CLUS] Add Metadata Cluster Partition
- user model changes: no
- storage format changes: no
- interface changes: yes
Details:
- Add a cluster partition reference to the cluster
partition in which metadata is stored. This allows
the initial metadata node to be removed from the
cluster and another metadata node to be assigned
to that metadata cluster partition. Initially,
it is assigned to the first partition of the first
metadata node.
- Use metadata cluster partition in defining metadata
datasets file splits instead of the assumption of the
first partition on the initial metadata node.
Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8
---
M
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/message/MetadataNodeResponseMessage.java
M
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java
M
asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java
M
asterixdb/asterix-runtime/src/main/java/org/apache/asterix/runtime/utils/ClusterStateManager.java
4 files changed, 60 insertions(+), 33 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb
refs/changes/48/2348/1
diff --git
a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/message/MetadataNodeResponseMessage.java
b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/message/MetadataNodeResponseMessage.java
index 815d878..1d4a0a9 100644
---
a/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/message/MetadataNodeResponseMessage.java
+++
b/asterixdb/asterix-app/src/main/java/org/apache/asterix/app/replication/message/MetadataNodeResponseMessage.java
@@ -40,8 +40,8 @@
}
@Override
-public void handle(ICcApplicationContext appCtx) throws
HyracksDataException, InterruptedException {
-((CcApplicationContext)
appCtx).getNcLifecycleCoordinator().process(this);
+public void handle(ICcApplicationContext appCtx) throws
HyracksDataException {
+appCtx.getNcLifecycleCoordinator().process(this);
}
@Override
diff --git
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java
index 5b7e5a7..ba647b8 100644
---
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java
+++
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/cluster/IClusterStateManager.java
@@ -92,7 +92,7 @@
/**
* @return A copy of the current state of the cluster partitions.
*/
-ClusterPartition[] getClusterPartitons();
+ClusterPartition[] getClusterPartitions();
/**
* Blocks until the cluster state becomes {@code state}
@@ -139,8 +139,7 @@
/**
* Returns the IO devices configured for a Node Controller
*
- * @param nodeId
- *unique identifier of the Node Controller
+ * @param nodeId unique identifier of the Node Controller
* @return a list of IO devices.
*/
String[] getIODevices(String nodeId);
@@ -151,15 +150,13 @@
AlgebricksAbsolutePartitionConstraint getClusterLocations();
/**
- * @param excludePendingRemoval
- *true, if the desired set shouldn't have pending removal nodes
+ * @param excludePendingRemoval true, if the desired set shouldn't have
pending removal nodes
* @return the set of participant nodes
*/
Set getParticipantNodes(boolean excludePendingRemoval);
/**
- * @param node
- *the node id
+ * @param node the node id
* @return the number of partitions on that node
*/
int getNodePartitionsCount(String node);
@@ -224,4 +221,18 @@
boolean cancelRemovePending(String nodeId);
Map> getActiveNcConfiguration();
+
+/**
+ * Sets the cluster partition in which metadata datasets stored
+ *
+ * @param partition
+ */
+void setMetadataPartitionId(ClusterPartition partition);
+
+/**
+ * Gets the cluster partition in which metadata datasets are stored
+ *
+ * @return The metadata cluster partitions
+ */
+ClusterPartition getMetadataPartition();
}
diff --git
a/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java
b/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java
index 2a6d0e8..5fde7e6 100644
---
a/asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java
+++
b/asterixdb/asterix-metadata/src/main/ja
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-cancellation-test/2494/ (2/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/hyracks-gerrit/2454/ (3/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app-sql-execution/2506/ (1/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-format/2511/ (9/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/8007/ (8/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
Change in asterixdb[master]: [NO ISSUE][CLUS] Add Metadata Cluster Partition
Jenkins has posted comments on this change. Change subject: [NO ISSUE][CLUS] Add Metadata Cluster Partition .. Patch Set 1: Build Started https://asterix-jenkins.ics.uci.edu/job/asterix-verify-storage/3083/ (6/12) -- To view, visit https://asterix-gerrit.ics.uci.edu/2348 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I2ac99252cacba92b4c4484c0d34cdc77fee307e8 Gerrit-PatchSet: 1 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Jenkins Gerrit-HasComments: No
