This is an automated email from the ASF dual-hosted git repository.
zhangduo pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new ba26a3e HBASE-22799 Addendum add new changes after RC0
ba26a3e is described below
commit ba26a3e1fd5bda8a84f99111d9471f62bb29ed1d
Author: Duo Zhang <[email protected]>
AuthorDate: Mon Aug 26 16:54:43 2019 +0800
HBASE-22799 Addendum add new changes after RC0
---
CHANGES.md | 29 +++++++++++++++++++++++--
RELEASENOTES.md | 67 +++++++++++++++++++++++++++++++++++++++++++++++++--------
2 files changed, 85 insertions(+), 11 deletions(-)
diff --git a/CHANGES.md b/CHANGES.md
index 622b57a..dfc7338 100755
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -20,7 +20,7 @@
# Be careful doing manual edits in this file. Do not change format
# of release header or remove the below marker. This file is generated.
# DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!-->
-## Release 2.1.6 - Unreleased (as of 2019-08-14)
+## Release 2.1.6 - Unreleased (as of 2019-08-26)
### INCOMPATIBLE CHANGES:
@@ -40,6 +40,13 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-20509](https://issues.apache.org/jira/browse/HBASE-20509) | Put List
in HashSet directly without using addAll function to improve performance |
Trivial | Performance |
+| [HBASE-21996](https://issues.apache.org/jira/browse/HBASE-21996) | Set
locale for javadoc | Major | documentation |
+| [HBASE-22464](https://issues.apache.org/jira/browse/HBASE-22464) |
Improvements to hbase-vote script | Trivial | scripts |
+| [HBASE-22810](https://issues.apache.org/jira/browse/HBASE-22810) |
Initialize an separate ThreadPoolExecutor for taking/restoring snapshot |
Major | . |
+| [HBASE-22844](https://issues.apache.org/jira/browse/HBASE-22844) | Fix
Checkstyle issues in client snapshot exceptions | Minor | Client |
+| [HBASE-22871](https://issues.apache.org/jira/browse/HBASE-22871) | Move the
DirScanPool out and do not use static field | Major | master |
+| [HBASE-22841](https://issues.apache.org/jira/browse/HBASE-22841) |
TimeRange's factory functions do not support ranges, only \`allTime\` and
\`at\` | Major | Client |
| [HBASE-22828](https://issues.apache.org/jira/browse/HBASE-22828) | Log a
region close journal | Minor | . |
| [HBASE-22812](https://issues.apache.org/jira/browse/HBASE-22812) |
InterfaceAudience annotation in CatalogJanitor uses fully-qualified name |
Minor | . |
| [HBASE-22800](https://issues.apache.org/jira/browse/HBASE-22800) | Add
mapreduce dependencies to hbase-shaded-testing-util | Major | . |
@@ -83,6 +90,15 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22867](https://issues.apache.org/jira/browse/HBASE-22867) | The
ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster
with thousands table | Critical | master |
+| [HBASE-22904](https://issues.apache.org/jira/browse/HBASE-22904) | NPE
occurs when RS send space quota usage report during HMaster init | Minor | . |
+| [HBASE-22806](https://issues.apache.org/jira/browse/HBASE-22806) | Deleted
CF are not cleared if memstore contain entries | Major | API |
+| [HBASE-22601](https://issues.apache.org/jira/browse/HBASE-22601) |
Misconfigured addition of peers leads to cluster shutdown. | Major | . |
+| [HBASE-22863](https://issues.apache.org/jira/browse/HBASE-22863) | Avoid
Jackson versions and dependencies with known CVEs | Major | dependencies |
+| [HBASE-22882](https://issues.apache.org/jira/browse/HBASE-22882) |
TestFlushSnapshotFromClient#testConcurrentSnapshottingAttempts is flakey (was
written flakey) | Major | test |
+| [HBASE-22870](https://issues.apache.org/jira/browse/HBASE-22870) |
reflection fails to access a private nested class | Major | master |
+| [HBASE-22860](https://issues.apache.org/jira/browse/HBASE-22860) | Master's
webui returns NPE/HTTP 500 under maintenance mode | Major | master, UI |
+| [HBASE-22856](https://issues.apache.org/jira/browse/HBASE-22856) |
HBASE-Find-Flaky-Tests fails with pip error | Major | build, test |
| [HBASE-22632](https://issues.apache.org/jira/browse/HBASE-22632) |
SplitTableRegionProcedure and MergeTableRegionsProcedure should skip store
files for unknown column families | Major | proc-v2 |
| [HBASE-22838](https://issues.apache.org/jira/browse/HBASE-22838) |
assembly:single failure: user id or group id 'xxxxx' is too big | Major |
build |
| [HBASE-22840](https://issues.apache.org/jira/browse/HBASE-22840) | Fix
backport of HBASE-21325 | Major | regionserver |
@@ -147,6 +163,7 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22894](https://issues.apache.org/jira/browse/HBASE-22894) | Move
testOpenRegionFailedMemoryLeak to dedicated class | Major | test |
| [HBASE-22725](https://issues.apache.org/jira/browse/HBASE-22725) | Remove
all remaining javadoc warnings | Trivial | test |
| [HBASE-22615](https://issues.apache.org/jira/browse/HBASE-22615) | Make
TestChoreService more robust to timing | Minor | test |
@@ -155,6 +172,9 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22858](https://issues.apache.org/jira/browse/HBASE-22858) | Add HBCK
Report to master's header.jsp | Minor | master |
+| [HBASE-22891](https://issues.apache.org/jira/browse/HBASE-22891) | Use
HBaseQA in HBase-PreCommit-GitHub-PR job | Major | build, scripts |
+| [HBASE-22771](https://issues.apache.org/jira/browse/HBASE-22771) | [HBCK2]
fixMeta method and server-side support | Major | hbck2 |
| [HBASE-22848](https://issues.apache.org/jira/browse/HBASE-22848) | Set
version as 2.1.6 in branch-2.1 in prep for first RC of 2.1.6 | Major | build |
| [HBASE-22799](https://issues.apache.org/jira/browse/HBASE-22799) | Generate
CHANGES.md and RELEASENOTES.md for 2.1.6 | Major | documentation |
| [HBASE-22845](https://issues.apache.org/jira/browse/HBASE-22845) | Revert
MetaTableAccessor#makePutFromTableState access to public | Blocker | . |
@@ -164,7 +184,6 @@
| [HBASE-22808](https://issues.apache.org/jira/browse/HBASE-22808) | HBCK
Report showed the offline regions which belong to disabled table | Major | . |
| [HBASE-22807](https://issues.apache.org/jira/browse/HBASE-22807) | HBCK
Report showed wrong orphans regions on FileSystem | Major | . |
| [HBASE-22805](https://issues.apache.org/jira/browse/HBASE-22805) | Fix
broken unit test, TestCatalogJanitorCluster on branch-2.1 and branch-2.0 |
Major | . |
-| [HBASE-22771](https://issues.apache.org/jira/browse/HBASE-22771) | [HBCK2]
fixMeta method and server-side support | Major | hbck2 |
| [HBASE-22737](https://issues.apache.org/jira/browse/HBASE-22737) | Add a new
admin method and shell cmd to trigger the hbck chore to run | Major | . |
| [HBASE-22741](https://issues.apache.org/jira/browse/HBASE-22741) | Show
catalogjanitor consistency complaints in new 'HBCK Report' page | Major |
hbck2, UI |
| [HBASE-22723](https://issues.apache.org/jira/browse/HBASE-22723) | Have
CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its
regular scan of hbase:meta | Major | . |
@@ -183,6 +202,12 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22833](https://issues.apache.org/jira/browse/HBASE-22833) |
MultiRowRangeFilter should provide a method for creating a filter which is
functionally equivalent to multiple prefix filters | Minor | Client |
+| [HBASE-22895](https://issues.apache.org/jira/browse/HBASE-22895) | Fix the
flakey TestSpaceQuotas | Major | Quotas, test |
+| [HBASE-22910](https://issues.apache.org/jira/browse/HBASE-22910) | Enable
TestMultiVersionConcurrencyControl | Major | test |
+| [HBASE-22913](https://issues.apache.org/jira/browse/HBASE-22913) | Use
Hadoop label for nightly builds | Major | build |
+| [HBASE-22911](https://issues.apache.org/jira/browse/HBASE-22911) | fewer
concurrent github PR builds | Critical | build |
+| [HBASE-21400](https://issues.apache.org/jira/browse/HBASE-21400) | correct
spelling error of 'initilize' in comment | Trivial | documentation |
| [HBASE-22382](https://issues.apache.org/jira/browse/HBASE-22382) | Refactor
tests in TestFromClientSide | Major | test |
| [HBASE-21606](https://issues.apache.org/jira/browse/HBASE-21606) | Document
use of the meta table load metrics added in HBASE-19722 | Critical |
documentation, meta, metrics, Operability |
| [HBASE-19230](https://issues.apache.org/jira/browse/HBASE-19230) | Write up
fixVersion policy from dev discussion in refguide | Major | documentation |
diff --git a/RELEASENOTES.md b/RELEASENOTES.md
index 03a47c2..1604d8f 100755
--- a/RELEASENOTES.md
+++ b/RELEASENOTES.md
@@ -27,6 +27,64 @@ These release notes cover new developer and user-facing
incompatibilities, impor
---
+* [HBASE-22867](https://issues.apache.org/jira/browse/HBASE-22867) |
*Critical* | **The ForkJoinPool in CleanerChore will spawn thousands of threads
in our cluster with thousands table**
+
+Replace the ForkJoinPool in CleanerChore by ThreadPoolExecutor which can limit
the spawn thread size and avoid the master GC frequently. The replacement is
an internal implementation in CleanerChore, so no config key change, the
upstream users can just upgrade the hbase master without any other change.
+
+
+---
+
+* [HBASE-22810](https://issues.apache.org/jira/browse/HBASE-22810) | *Major* |
**Initialize an separate ThreadPoolExecutor for taking/restoring snapshot**
+
+Introduced a new config key for the snapshot taking/restoring operations at
master side: hbase.master.executor.snapshot.threads, its default value is 3.
means we can have 3 snapshot operations running at the same time.
+
+
+---
+
+* [HBASE-22863](https://issues.apache.org/jira/browse/HBASE-22863) | *Major* |
**Avoid Jackson versions and dependencies with known CVEs**
+
+1. Stopped exposing vulnerable Jackson1 dependencies so that downstreamers
would not pull it in from HBase.
+2. However, since Hadoop requires some Jackson1 dependencies, put vulnerable
Jackson mapper at test scope in some HBase modules and hence, HBase tarball
created by hbase-assembly contains Jackson1 mapper jar in lib. Still, downsteam
applications can't pull in Jackson1 from HBase.
+
+
+---
+
+* [HBASE-22841](https://issues.apache.org/jira/browse/HBASE-22841) | *Major* |
**TimeRange's factory functions do not support ranges, only \`allTime\` and
\`at\`**
+
+Add serveral API in TimeRange class for avoiding using the deprecated
TimeRange constructor:
+\* TimeRange#from: Represents the time interval [minStamp, Long.MAX\_VALUE)
+\* TimeRange#until: Represents the time interval [0, maxStamp)
+\* TimeRange#between: Represents the time interval [minStamp, maxStamp)
+
+
+---
+
+* [HBASE-22833](https://issues.apache.org/jira/browse/HBASE-22833) | *Minor* |
**MultiRowRangeFilter should provide a method for creating a filter which is
functionally equivalent to multiple prefix filters**
+
+Provide a public method in MultiRowRangeFilter class to speed the requirement
of filtering with multiple row prefixes, it will expand the row prefixes as
multiple rowkey ranges by MultiRowRangeFilter, it's more efficient.
+{code}
+public MultiRowRangeFilter(byte[][] rowKeyPrefixes);
+{code}
+
+
+---
+
+* [HBASE-22856](https://issues.apache.org/jira/browse/HBASE-22856) | *Major* |
**HBASE-Find-Flaky-Tests fails with pip error**
+
+Update the base docker image to ubuntu 18.04 for the find flaky tests jenkins
job.
+
+
+---
+
+* [HBASE-22771](https://issues.apache.org/jira/browse/HBASE-22771) | *Major* |
**[HBCK2] fixMeta method and server-side support**
+
+Adds a fixMeta method to hbck Service. Fixes holes in hbase:meta. Follow-up to
fix overlaps.
+
+Follow-on is adding a client-side to hbase-operator-tools that can exploit
this new addition (HBASE-22825)
+
+
+---
+
* [HBASE-22777](https://issues.apache.org/jira/browse/HBASE-22777) | *Major* |
**Add a multi-region merge (for fixing overlaps, etc.)**
Changes merge so you can merge more than two regions at a time. Currently
only available inside HBase. HBASE-22827, a follow-on, is about exposing the
facility in the Admin API (and then via the shell).
@@ -68,15 +126,6 @@ The problem only effects the 2.x releases, all users are
highly recommand to upg
---
-* [HBASE-22771](https://issues.apache.org/jira/browse/HBASE-22771) | *Major* |
**[HBCK2] fixMeta method and server-side support**
-
-Adds a fixMeta method to hbck Service. Fixes holes in hbase:meta. Follow-up to
fix overlaps.
-
-Follow-on is adding a client-side to hbase-operator-tools that can exploit
this new addition (HBASE-22825)
-
-
----
-
* [HBASE-22737](https://issues.apache.org/jira/browse/HBASE-22737) | *Major* |
**Add a new admin method and shell cmd to trigger the hbck chore to run**
Add a new method runHbckChore in Hbck interface and a new shell cmd
hbck\_chore\_run to request HBCK chore to run at master side.
