[accumulo] branch 1451-external-compactions-feature updated: Persist external compactions in metadata table
This is an automated email from the ASF dual-hosted git repository.
kturner pushed a commit to branch 1451-external-compactions-feature
in repository https://gitbox.apache.org/repos/asf/accumulo.git
The following commit(s) were added to
refs/heads/1451-external-compactions-feature by this push:
new 81fee5c Persist external compactions in metadata table
81fee5c is described below
commit 81fee5c19340c8cd794178365263b661365425b1
Author: Keith Turner
AuthorDate: Fri Mar 19 19:58:48 2021 -0400
Persist external compactions in metadata table
---
.../accumulo/core/metadata/schema/Ample.java | 5 +
.../metadata/schema}/ExternalCompactionId.java | 2 +-
.../schema/ExternalCompactionMetadata.java | 121 +
.../core/metadata/schema/MetadataSchema.java | 5 +
.../core/metadata/schema/TabletMetadata.java | 18 ++-
.../core/metadata/schema/TabletsMetadata.java | 4 +
.../core/spi/compaction/CompactionExecutorId.java | 1 +
.../core/util/compaction/CompactionJobImpl.java| 20 +++-
.../server/constraints/MetadataConstraints.java| 4 +-
.../server/metadata/TabletMutatorBase.java | 17 +++
.../accumulo/server/util/ManagerMetadataUtil.java | 7 +-
.../coordinator/CompactionCoordinator.java | 2 +-
.../accumulo/tserver/ThriftClientHandler.java | 2 +-
.../accumulo/tserver/compactions/Compactable.java | 2 +-
.../tserver/compactions/CompactionManager.java | 6 +-
.../tserver/compactions/ExternalCompactionJob.java | 2 +-
.../accumulo/tserver/tablet/CompactableImpl.java | 105 --
.../accumulo/tserver/tablet/CompactableUtils.java | 2 +-
.../accumulo/tserver/tablet/DatafileManager.java | 8 +-
.../org/apache/accumulo/tserver/tablet/Tablet.java | 20 +++-
.../apache/accumulo/tserver/tablet/TabletData.java | 10 ++
21 files changed, 312 insertions(+), 51 deletions(-)
diff --git
a/core/src/main/java/org/apache/accumulo/core/metadata/schema/Ample.java
b/core/src/main/java/org/apache/accumulo/core/metadata/schema/Ample.java
index 1860122..334dac2 100644
--- a/core/src/main/java/org/apache/accumulo/core/metadata/schema/Ample.java
+++ b/core/src/main/java/org/apache/accumulo/core/metadata/schema/Ample.java
@@ -270,6 +270,11 @@ public interface Ample {
TabletMutator deleteSuspension();
+TabletMutator putExternalCompaction(ExternalCompactionId ecid,
+ExternalCompactionMetadata ecMeta);
+
+TabletMutator deleteExternalCompaction(ExternalCompactionId ecid);
+
/**
* This method persist (or queues for persisting) previous put and deletes
against this object.
* Unless this method is called, previous calls will never be persisted.
The purpose of this
diff --git
a/server/base/src/main/java/org/apache/accumulo/server/compaction/ExternalCompactionId.java
b/core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionId.java
similarity index 97%
rename from
server/base/src/main/java/org/apache/accumulo/server/compaction/ExternalCompactionId.java
rename to
core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionId.java
index e6880c4..c5ae588 100644
---
a/server/base/src/main/java/org/apache/accumulo/server/compaction/ExternalCompactionId.java
+++
b/core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionId.java
@@ -16,7 +16,7 @@
* specific language governing permissions and limitations
* under the License.
*/
-package org.apache.accumulo.server.compaction;
+package org.apache.accumulo.core.metadata.schema;
import java.util.UUID;
diff --git
a/core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionMetadata.java
b/core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionMetadata.java
new file mode 100644
index 000..6398bf7
--- /dev/null
+++
b/core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionMetadata.java
@@ -0,0 +1,121 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.accumulo.core.metadata.schema;
+
+import static java.util.stream.Collectors.toList;
+import static java.util.stream.Collectors.toSet;
+
[accumulo-website] branch asf-site updated (acf6c02 -> 6c56a7c)
This is an automated email from the ASF dual-hosted git repository. ctubbsii pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/accumulo-website.git. from acf6c02 Automatic Site Publish by Buildbot add 6c56a7c Automatic Site Publish by Buildbot No new revisions were added by this update. Summary of changes: output/feed.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[accumulo-website] branch main updated: Remove unused gem and tighten version constraints
This is an automated email from the ASF dual-hosted git repository. ctubbsii pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/accumulo-website.git The following commit(s) were added to refs/heads/main by this push: new 7bdfd93 Remove unused gem and tighten version constraints 7bdfd93 is described below commit 7bdfd93197d7e1fa02143bb14071672d38f87a93 Author: Christopher Tubbs AuthorDate: Fri Mar 19 15:59:58 2021 -0400 Remove unused gem and tighten version constraints * Remove unused rubyracer gem * Enforce at least jekyll 4.2 and jekyll-redirect-from 0.16 --- Gemfile | 5 ++--- Gemfile.lock | 10 ++ 2 files changed, 4 insertions(+), 11 deletions(-) diff --git a/Gemfile b/Gemfile index 53a5559..07a0c60 100644 --- a/Gemfile +++ b/Gemfile @@ -1,5 +1,4 @@ ruby '>=2.5.1' source 'https://rubygems.org' -gem 'jekyll', '>= 3.7.4' -gem 'jekyll-redirect-from', '>= 0.13.0' -gem 'therubyracer' +gem 'jekyll', '>= 4.2.0' +gem 'jekyll-redirect-from', '>= 0.16.0' diff --git a/Gemfile.lock b/Gemfile.lock index d28c152..2a4e808 100644 --- a/Gemfile.lock +++ b/Gemfile.lock @@ -39,7 +39,6 @@ GEM rexml kramdown-parser-gfm (1.1.0) kramdown (~> 2.0) -libv8 (3.16.14.19) liquid (4.0.3) listen (3.4.1) rb-fsevent (~> 0.10, >= 0.10.3) @@ -51,7 +50,6 @@ GEM rb-fsevent (0.10.4) rb-inotify (0.10.1) ffi (~> 1.0) -ref (2.0.0) rexml (3.2.4) rouge (3.26.0) safe_yaml (1.0.5) @@ -59,18 +57,14 @@ GEM ffi (~> 1.9) terminal-table (2.0.0) unicode-display_width (~> 1.1, >= 1.1.1) -therubyracer (0.12.3) - libv8 (~> 3.16.14.15) - ref unicode-display_width (1.7.0) PLATFORMS ruby DEPENDENCIES - jekyll (>= 3.7.4) - jekyll-redirect-from (>= 0.13.0) - therubyracer + jekyll (>= 4.2.0) + jekyll-redirect-from (>= 0.16.0) RUBY VERSION ruby 2.7.1p83
Buildbot success in on jekyll_websites
The Buildbot has detected a passing build on builder jekyll_websites while building accumulo. Full details are available at: https://ci2.apache.org/#builders/7/builds/431 Buildbot URL: https://ci2.apache.org/ Worker for this Build: bb_slave10_ubuntu Build Reason: Triggered jekyll auto-build via .asf.yaml by ctubbsii Blamelist: asfinfra, commits@accumulo.apache.org Build succeeded! Sincerely, -The Buildbot
[accumulo-website] branch asf-staging updated: Automatic Site Publish by Buildbot
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-staging in repository https://gitbox.apache.org/repos/asf/accumulo-website.git The following commit(s) were added to refs/heads/asf-staging by this push: new 6c56a7c Automatic Site Publish by Buildbot 6c56a7c is described below commit 6c56a7c2cb9ebdf00a055d6882f1bfcecf0290e5 Author: buildbot AuthorDate: Fri Mar 19 20:01:06 2021 + Automatic Site Publish by Buildbot --- output/feed.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/output/feed.xml b/output/feed.xml index 69a0738..7dad099 100644 --- a/output/feed.xml +++ b/output/feed.xml @@ -6,8 +6,8 @@ https://accumulo.apache.org/ https://accumulo.apache.org/feed.xml; rel="self" type="application/rss+xml"/> -Fri, 19 Mar 2021 05:00:09 + -Fri, 19 Mar 2021 05:00:09 + +Fri, 19 Mar 2021 20:01:01 + +Fri, 19 Mar 2021 20:01:01 + Jekyll v4.2.0
