[accumulo] branch 1451-external-compactions-feature updated: Persist external compactions in metadata table
This is an automated email from the ASF dual-hosted git repository. kturner pushed a commit to branch 1451-external-compactions-feature in repository https://gitbox.apache.org/repos/asf/accumulo.git The following commit(s) were added to refs/heads/1451-external-compactions-feature by this push: new 81fee5c Persist external compactions in metadata table 81fee5c is described below commit 81fee5c19340c8cd794178365263b661365425b1 Author: Keith Turner AuthorDate: Fri Mar 19 19:58:48 2021 -0400 Persist external compactions in metadata table --- .../accumulo/core/metadata/schema/Ample.java | 5 + .../metadata/schema}/ExternalCompactionId.java | 2 +- .../schema/ExternalCompactionMetadata.java | 121 + .../core/metadata/schema/MetadataSchema.java | 5 + .../core/metadata/schema/TabletMetadata.java | 18 ++- .../core/metadata/schema/TabletsMetadata.java | 4 + .../core/spi/compaction/CompactionExecutorId.java | 1 + .../core/util/compaction/CompactionJobImpl.java| 20 +++- .../server/constraints/MetadataConstraints.java| 4 +- .../server/metadata/TabletMutatorBase.java | 17 +++ .../accumulo/server/util/ManagerMetadataUtil.java | 7 +- .../coordinator/CompactionCoordinator.java | 2 +- .../accumulo/tserver/ThriftClientHandler.java | 2 +- .../accumulo/tserver/compactions/Compactable.java | 2 +- .../tserver/compactions/CompactionManager.java | 6 +- .../tserver/compactions/ExternalCompactionJob.java | 2 +- .../accumulo/tserver/tablet/CompactableImpl.java | 105 -- .../accumulo/tserver/tablet/CompactableUtils.java | 2 +- .../accumulo/tserver/tablet/DatafileManager.java | 8 +- .../org/apache/accumulo/tserver/tablet/Tablet.java | 20 +++- .../apache/accumulo/tserver/tablet/TabletData.java | 10 ++ 21 files changed, 312 insertions(+), 51 deletions(-) diff --git a/core/src/main/java/org/apache/accumulo/core/metadata/schema/Ample.java b/core/src/main/java/org/apache/accumulo/core/metadata/schema/Ample.java index 1860122..334dac2 100644 --- a/core/src/main/java/org/apache/accumulo/core/metadata/schema/Ample.java +++ b/core/src/main/java/org/apache/accumulo/core/metadata/schema/Ample.java @@ -270,6 +270,11 @@ public interface Ample { TabletMutator deleteSuspension(); +TabletMutator putExternalCompaction(ExternalCompactionId ecid, +ExternalCompactionMetadata ecMeta); + +TabletMutator deleteExternalCompaction(ExternalCompactionId ecid); + /** * This method persist (or queues for persisting) previous put and deletes against this object. * Unless this method is called, previous calls will never be persisted. The purpose of this diff --git a/server/base/src/main/java/org/apache/accumulo/server/compaction/ExternalCompactionId.java b/core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionId.java similarity index 97% rename from server/base/src/main/java/org/apache/accumulo/server/compaction/ExternalCompactionId.java rename to core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionId.java index e6880c4..c5ae588 100644 --- a/server/base/src/main/java/org/apache/accumulo/server/compaction/ExternalCompactionId.java +++ b/core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionId.java @@ -16,7 +16,7 @@ * specific language governing permissions and limitations * under the License. */ -package org.apache.accumulo.server.compaction; +package org.apache.accumulo.core.metadata.schema; import java.util.UUID; diff --git a/core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionMetadata.java b/core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionMetadata.java new file mode 100644 index 000..6398bf7 --- /dev/null +++ b/core/src/main/java/org/apache/accumulo/core/metadata/schema/ExternalCompactionMetadata.java @@ -0,0 +1,121 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or implied. See the License for the + * specific language governing permissions and limitations + * under the License. + */ +package org.apache.accumulo.core.metadata.schema; + +import static java.util.stream.Collectors.toList; +import static java.util.stream.Collectors.toSet; + +impor
[accumulo-website] branch asf-site updated (acf6c02 -> 6c56a7c)
This is an automated email from the ASF dual-hosted git repository. ctubbsii pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/accumulo-website.git. from acf6c02 Automatic Site Publish by Buildbot add 6c56a7c Automatic Site Publish by Buildbot No new revisions were added by this update. Summary of changes: output/feed.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[accumulo-website] branch main updated: Remove unused gem and tighten version constraints
This is an automated email from the ASF dual-hosted git repository. ctubbsii pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/accumulo-website.git The following commit(s) were added to refs/heads/main by this push: new 7bdfd93 Remove unused gem and tighten version constraints 7bdfd93 is described below commit 7bdfd93197d7e1fa02143bb14071672d38f87a93 Author: Christopher Tubbs AuthorDate: Fri Mar 19 15:59:58 2021 -0400 Remove unused gem and tighten version constraints * Remove unused rubyracer gem * Enforce at least jekyll 4.2 and jekyll-redirect-from 0.16 --- Gemfile | 5 ++--- Gemfile.lock | 10 ++ 2 files changed, 4 insertions(+), 11 deletions(-) diff --git a/Gemfile b/Gemfile index 53a5559..07a0c60 100644 --- a/Gemfile +++ b/Gemfile @@ -1,5 +1,4 @@ ruby '>=2.5.1' source 'https://rubygems.org' -gem 'jekyll', '>= 3.7.4' -gem 'jekyll-redirect-from', '>= 0.13.0' -gem 'therubyracer' +gem 'jekyll', '>= 4.2.0' +gem 'jekyll-redirect-from', '>= 0.16.0' diff --git a/Gemfile.lock b/Gemfile.lock index d28c152..2a4e808 100644 --- a/Gemfile.lock +++ b/Gemfile.lock @@ -39,7 +39,6 @@ GEM rexml kramdown-parser-gfm (1.1.0) kramdown (~> 2.0) -libv8 (3.16.14.19) liquid (4.0.3) listen (3.4.1) rb-fsevent (~> 0.10, >= 0.10.3) @@ -51,7 +50,6 @@ GEM rb-fsevent (0.10.4) rb-inotify (0.10.1) ffi (~> 1.0) -ref (2.0.0) rexml (3.2.4) rouge (3.26.0) safe_yaml (1.0.5) @@ -59,18 +57,14 @@ GEM ffi (~> 1.9) terminal-table (2.0.0) unicode-display_width (~> 1.1, >= 1.1.1) -therubyracer (0.12.3) - libv8 (~> 3.16.14.15) - ref unicode-display_width (1.7.0) PLATFORMS ruby DEPENDENCIES - jekyll (>= 3.7.4) - jekyll-redirect-from (>= 0.13.0) - therubyracer + jekyll (>= 4.2.0) + jekyll-redirect-from (>= 0.16.0) RUBY VERSION ruby 2.7.1p83
Buildbot success in on jekyll_websites
The Buildbot has detected a passing build on builder jekyll_websites while building accumulo. Full details are available at: https://ci2.apache.org/#builders/7/builds/431 Buildbot URL: https://ci2.apache.org/ Worker for this Build: bb_slave10_ubuntu Build Reason: Triggered jekyll auto-build via .asf.yaml by ctubbsii Blamelist: asfinfra, commits@accumulo.apache.org Build succeeded! Sincerely, -The Buildbot
[accumulo-website] branch asf-staging updated: Automatic Site Publish by Buildbot
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-staging in repository https://gitbox.apache.org/repos/asf/accumulo-website.git The following commit(s) were added to refs/heads/asf-staging by this push: new 6c56a7c Automatic Site Publish by Buildbot 6c56a7c is described below commit 6c56a7c2cb9ebdf00a055d6882f1bfcecf0290e5 Author: buildbot AuthorDate: Fri Mar 19 20:01:06 2021 + Automatic Site Publish by Buildbot --- output/feed.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/output/feed.xml b/output/feed.xml index 69a0738..7dad099 100644 --- a/output/feed.xml +++ b/output/feed.xml @@ -6,8 +6,8 @@ https://accumulo.apache.org/ https://accumulo.apache.org/feed.xml"; rel="self" type="application/rss+xml"/> -Fri, 19 Mar 2021 05:00:09 + -Fri, 19 Mar 2021 05:00:09 + +Fri, 19 Mar 2021 20:01:01 + +Fri, 19 Mar 2021 20:01:01 + Jekyll v4.2.0