Buildbot success in on jekyll_websites

2021-02-02 Thread buildbot 
The Buildbot has detected a passing build on builder jekyll_websites while 
building accumulo.
Full details are available at:
https://ci2.apache.org/#builders/7/builds/363

Buildbot URL: https://ci2.apache.org/

Worker for this Build: bb_slave10_ubuntu

Build Reason: Triggered jekyll auto-build via .asf.yaml by kturner
Blamelist: asfinfra, commits@accumulo.apache.org

Build succeeded!

Sincerely,
 -The Buildbot

[accumulo-website] branch asf-staging updated: Automatic Site Publish by Buildbot

2021-02-02 Thread git-site-role 
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/accumulo-website.git


The following commit(s) were added to refs/heads/asf-staging by this push:
 new 1ecd555  Automatic Site Publish by Buildbot
1ecd555 is described below

commit 1ecd555a62d1ba7c62b94260f3303b655023aad2
Author: buildbot 
AuthorDate: Tue Feb 2 15:17:27 2021 +

Automatic Site Publish by Buildbot
---
 output/feed.xml  |  4 ++--
 output/release/accumulo-2.1.0/index.html | 37 +++-
 output/search_data.json  |  2 +-
 3 files changed, 39 insertions(+), 4 deletions(-)

diff --git a/output/feed.xml b/output/feed.xml
index fb2e984..e5919d0 100644
--- a/output/feed.xml
+++ b/output/feed.xml
@@ -6,8 +6,8 @@
 
 https://accumulo.apache.org/
 https://accumulo.apache.org/feed.xml"; rel="self" 
type="application/rss+xml"/>
-Mon, 25 Jan 2021 16:26:24 +
-Mon, 25 Jan 2021 16:26:24 +
+Tue, 02 Feb 2021 15:17:20 +
+Tue, 02 Feb 2021 15:17:20 +
 Jekyll v4.1.1
 
 
diff --git a/output/release/accumulo-2.1.0/index.html 
b/output/release/accumulo-2.1.0/index.html
index f118c4e..d87a05a 100644
--- a/output/release/accumulo-2.1.0/index.html
+++ b/output/release/accumulo-2.1.0/index.html
@@ -168,11 +168,46 @@
 
 Notable Changes
 
+Compaction Changes
+
+Significant changes were made to how Accumulo compacts files in this 
release.  See 
+compaction  for details, 
below are some highlights.
+
+
+  Multiple concurrent compactions per tablet on disjoint files is now
+supported.  Previously only a single compaction could run on a tablet.  This
+allows tablets that are running long compactions on large files to
+concurrently compact new smaller files that arrive.
+  Multiple compaction thread pools per tablet server are now supported.
+Previously only a single thread pool existed within a tablet server for
+compactions.  With a single thread pool, if all threads are working on long
+compactions it can starve quick compactions.  Now compactions with little
+data can be processed by dedicated thread pools.
+  Accumulo’s default algorithm for selecting files to compact was modified 
to
+select the smallest set of files that meet the compaction ratio criteria
+instead of the largest set.  This change makes tablets more aggressive about
+reducing their number files while still doing logarithmic compaction work.
+This change also enables efficiently compacting new small files that arrive
+during a long running compaction.
+  Having dedicated compaction threads pools for tables is now supported
+through configuration.  The default configuration for Accumulo sets up
+dedicated thread pools for compacting the Accumulo metadata table.
+  Merging minor compactions were dropped.  These were added to Accumulo to
+address the problem of new files arriving while a long running compaction
+was running.  Merging minor compactions could cause O(N^2) compaction work.
+The new compaction changes in this release can satisfy this use case while
+doing a logarithmic amount of work.
+
+
+CompactionStrategy was deprecated in favor of new public APIs.
+See its https://static.javadoc.io/org.apache.accumulo/accumulo-tserver/2.0.1/org/apache/accumulo/tserver/compaction/CompactionStrategy.html";>javadoc
 
+for more information.
+
 Fixed GC Metadata hotspots
 
 Prior to this release, Accumulo stored GC file candidates in the metadata 
table
 using rows of the form ~del. This row schema lead to uneven load 
on
-the metadata table and metadata tablets that were eventually never used. In https://github.com/apache/accumulo/issues/1043";>#1043 the row fromat 
was changed to ~del resulting in
+the metadata table and metadata tablets that were eventually never used. In https://github.com/apache/accumulo/issues/1043";>#1043 the row format 
was changed to ~del resulting in
 even load on the metadata table and even data spread in the tablets. After
 upgrading, there may still be splits in the metadata table using the old row
 format. These splits can be merged away as shown in the example below which
diff --git a/output/search_data.json b/output/search_data.json
index bbd21fe..81e3bc8 100644
--- a/output/search_data.json
+++ b/output/search_data.json
@@ -336,7 +336,7 @@
   
 "release-accumulo-2-1-0": {
   "title": "Apache Accumulo 2.1.0",
-  "content" : "** DRAFT RELEASE NOTES **Notable ChangesFixed GC 
Metadata hotspotsPrior to this release, Accumulo stored GC file candidates in 
the metadata tableusing rows of the form ~del<URI>. This row 
schema lead to uneven load onthe metadata table and metadata tablets that were 
eventually never used. In #1043 the row fromat was changed to 
~del<hash(URI)><URI> resulting ineven load on the 
metadata table and even data spread in the tablets. [...]
+

[accumulo-website] branch main updated: Describes 2.1.0 compaction changes in rel notes (#261)

2021-02-02 Thread kturner 
This is an automated email from the ASF dual-hosted git repository.

kturner pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/accumulo-website.git


The following commit(s) were added to refs/heads/main by this push:
 new 6f1922b  Describes 2.1.0 compaction changes in rel notes (#261)
6f1922b is described below

commit 6f1922b00a398ccb2b134c7d359ecee0866d1164
Author: Keith Turner 
AuthorDate: Tue Feb 2 10:17:00 2021 -0500

Describes 2.1.0 compaction changes in rel notes (#261)
---
 _posts/release/2020-01-19-accumulo-2.1.0.md | 35 -
 1 file changed, 34 insertions(+), 1 deletion(-)

diff --git a/_posts/release/2020-01-19-accumulo-2.1.0.md 
b/_posts/release/2020-01-19-accumulo-2.1.0.md
index 3a587c6..460c339 100644
--- a/_posts/release/2020-01-19-accumulo-2.1.0.md
+++ b/_posts/release/2020-01-19-accumulo-2.1.0.md
@@ -7,12 +7,45 @@ draft: true
 
 ## Notable Changes
 
+### Compaction Changes
+
+Significant changes were made to how Accumulo compacts files in this release.  
See 
+{% dlink administration/compaction %} for details, below are some highlights.
+
+ * Multiple concurrent compactions per tablet on disjoint files is now
+   supported.  Previously only a single compaction could run on a tablet.  This
+   allows tablets that are running long compactions on large files to
+   concurrently compact new smaller files that arrive.
+ * Multiple compaction thread pools per tablet server are now supported.
+   Previously only a single thread pool existed within a tablet server for
+   compactions.  With a single thread pool, if all threads are working on long
+   compactions it can starve quick compactions.  Now compactions with little
+   data can be processed by dedicated thread pools.
+ * Accumulo's default algorithm for selecting files to compact was modified to
+   select the smallest set of files that meet the compaction ratio criteria
+   instead of the largest set.  This change makes tablets more aggressive about
+   reducing their number files while still doing logarithmic compaction work.
+   This change also enables efficiently compacting new small files that arrive
+   during a long running compaction. 
+ * Having dedicated compaction threads pools for tables is now supported
+   through configuration.  The default configuration for Accumulo sets up
+   dedicated thread pools for compacting the Accumulo metadata table.
+ * Merging minor compactions were dropped.  These were added to Accumulo to
+   address the problem of new files arriving while a long running compaction
+   was running.  Merging minor compactions could cause O(N^2) compaction work.
+   The new compaction changes in this release can satisfy this use case while
+   doing a logarithmic amount of work.
+
+CompactionStrategy was deprecated in favor of new public APIs.
+See its [javadoc]({% jurl 
org.apache.accumulo.tserver.compaction.CompactionStrategy %}) 
+for more information.
+
 ### Fixed GC Metadata hotspots
 
 Prior to this release, Accumulo stored GC file candidates in the metadata table
 using rows of the form `~del`. This row schema lead to uneven load on
 the metadata table and metadata tablets that were eventually never used. In {%
-ghi 1043 %} the row fromat was changed to `~del` resulting in
+ghi 1043 %} the row format was changed to `~del` resulting in
 even load on the metadata table and even data spread in the tablets. After
 upgrading, there may still be splits in the metadata table using the old row
 format. These splits can be merged away as shown in the example below which

[accumulo] branch main updated (27ed66b -> eb6f5ef)

2021-02-02 Thread jmanno 
This is an automated email from the ASF dual-hosted git repository.

jmanno pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/accumulo.git.


from 27ed66b  Merge branch '1.10' into main
 add eb6f5ef  Add userExistsTest to ShellIT (#1894)

No new revisions were added by this update.

Summary of changes:
 test/src/main/java/org/apache/accumulo/test/ShellIT.java | 9 ++---
 1 file changed, 6 insertions(+), 3 deletions(-)