This is an automated email from the ASF dual-hosted git repository.
zhangduo pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/hbase.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new fb7e7d8 HBASE-22799 Generate CHANGES.md and RELEASENOTES.md for 2.1.6
(#491)
fb7e7d8 is described below
commit fb7e7d810df6a84ef2cec1cc509e98bc0ab1798c
Author: Duo Zhang <[email protected]>
AuthorDate: Wed Aug 14 11:28:55 2019 +0800
HBASE-22799 Generate CHANGES.md and RELEASENOTES.md for 2.1.6 (#491)
Signed-off-by: Guanghao Zhang <[email protected]>
---
CHANGES.md | 172 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++
RELEASENOTES.md | 166 ++++++++++++++++++++++++++++++++++++++++++++++++++++++
2 files changed, 338 insertions(+)
diff --git a/CHANGES.md b/CHANGES.md
index a1939fb..128d202 100755
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -20,6 +20,175 @@
# Be careful doing manual edits in this file. Do not change format
# of release header or remove the below marker. This file is generated.
# DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!-->
+## Release 2.1.6 - Unreleased (as of 2019-08-14)
+
+### INCOMPATIBLE CHANGES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-22690](https://issues.apache.org/jira/browse/HBASE-22690) | Deprecate
/ Remove OfflineMetaRepair in hbase-2+ | Major | hbck2 |
+
+
+### NEW FEATURES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-15666](https://issues.apache.org/jira/browse/HBASE-15666) | shaded
dependencies for hbase-testing-util | Critical | test |
+
+
+### IMPROVEMENTS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-22828](https://issues.apache.org/jira/browse/HBASE-22828) | Log a
region close journal | Minor | . |
+| [HBASE-22812](https://issues.apache.org/jira/browse/HBASE-22812) |
InterfaceAudience annotation in CatalogJanitor uses fully-qualified name |
Minor | . |
+| [HBASE-22800](https://issues.apache.org/jira/browse/HBASE-22800) | Add
mapreduce dependencies to hbase-shaded-testing-util | Major | . |
+| [HBASE-22731](https://issues.apache.org/jira/browse/HBASE-22731) |
ReplicationSource and HBaseInterClusterReplicationEndpoint log messages should
include a target Peer identifier | Minor | Replication |
+| [HBASE-22759](https://issues.apache.org/jira/browse/HBASE-22759) | Add user
info to AUDITLOG events when doing grant/revoke | Major | logging, security |
+| [HBASE-22785](https://issues.apache.org/jira/browse/HBASE-22785) | Reduce
number of Checkstyle issues in client exceptions | Minor | Client |
+| [HBASE-22786](https://issues.apache.org/jira/browse/HBASE-22786) | Fix
Checkstyle issues in tests of hbase-client | Minor | Client |
+| [HBASE-22677](https://issues.apache.org/jira/browse/HBASE-22677) | Add unit
tests for org.apache.hadoop.hbase.util.ByteRangeUtils and
org.apache.hadoop.hbase.util.Classes | Major | java, test |
+| [HBASE-22787](https://issues.apache.org/jira/browse/HBASE-22787) | Clean up
of tests in hbase-zookeeper | Minor | Zookeeper |
+| [HBASE-22363](https://issues.apache.org/jira/browse/HBASE-22363) | Remove
hardcoded number of read cache block buckets | Trivial | BlockCache,
BucketCache |
+| [HBASE-22764](https://issues.apache.org/jira/browse/HBASE-22764) | Fix
remaining Checkstyle issues in hbase-rsgroup | Trivial | rsgroup |
+| [HBASE-22763](https://issues.apache.org/jira/browse/HBASE-22763) | Fix
remaining Checkstyle issue in hbase-procedure | Trivial | . |
+| [HBASE-22743](https://issues.apache.org/jira/browse/HBASE-22743) |
ClientUtils for hbase-examples | Minor | . |
+| [HBASE-22750](https://issues.apache.org/jira/browse/HBASE-22750) | Correct
@throws in comment | Trivial | Client, rpc |
+| [HBASE-22702](https://issues.apache.org/jira/browse/HBASE-22702) | [Log]
'Group not found for table' is chatty | Trivial | . |
+| [HBASE-22721](https://issues.apache.org/jira/browse/HBASE-22721) | Refactor
HBaseFsck: move the inner class out | Major | . |
+| [HBASE-22692](https://issues.apache.org/jira/browse/HBASE-22692) | Rubocop
definition is not used in the /bin directory | Minor | . |
+| [HBASE-22610](https://issues.apache.org/jira/browse/HBASE-22610) |
[BucketCache] Rename "hbase.offheapcache.minblocksize" | Trivial | . |
+| [HBASE-22704](https://issues.apache.org/jira/browse/HBASE-22704) | Avoid NPE
when access table.jsp and snapshot.jsp but master not finish initialization |
Minor | . |
+| [HBASE-22643](https://issues.apache.org/jira/browse/HBASE-22643) | Delete
region without archiving only if regiondir is present | Major | HFile |
+| [HBASE-22689](https://issues.apache.org/jira/browse/HBASE-22689) | Line
break for fix version in documentation | Trivial | documentation |
+| [HBASE-22638](https://issues.apache.org/jira/browse/HBASE-22638) | Zookeeper
Utility enhancements | Minor | Zookeeper |
+| [HBASE-22669](https://issues.apache.org/jira/browse/HBASE-22669) | Add unit
tests for org.apache.hadoop.hbase.util.Strings | Major | java |
+| [HBASE-22604](https://issues.apache.org/jira/browse/HBASE-22604) | fix the
link in the docs to "Understanding HBase and BigTable" by Jim R. Wilson |
Trivial | documentation |
+| [HBASE-22633](https://issues.apache.org/jira/browse/HBASE-22633) | Remove
redundant call to substring for ZKReplicationQueueStorage | Minor | . |
+| [HBASE-22595](https://issues.apache.org/jira/browse/HBASE-22595) | Use full
qualified name in Checkstyle suppressions | Trivial | . |
+| [HBASE-22616](https://issues.apache.org/jira/browse/HBASE-22616) |
responseTooXXX logging for Multi should characterize the component ops | Minor
| . |
+| [HBASE-22596](https://issues.apache.org/jira/browse/HBASE-22596) | [Chore]
Separate the execution period between CompactionChecker and
PeriodicMemStoreFlusher | Minor | Compaction |
+| [HBASE-22561](https://issues.apache.org/jira/browse/HBASE-22561) | modify
HFilePrettyPrinter to accept non-hbase.rootdir directories | Minor | . |
+| [HBASE-22344](https://issues.apache.org/jira/browse/HBASE-22344) | Document
deprecated public APIs | Major | API, community, documentation |
+| [HBASE-22593](https://issues.apache.org/jira/browse/HBASE-22593) | Add local
Jenv file to gitignore | Trivial | . |
+| [HBASE-22160](https://issues.apache.org/jira/browse/HBASE-22160) | Add
sorting functionality in regionserver web UI for user regions | Minor |
monitoring, regionserver, UI, Usability |
+| [HBASE-22284](https://issues.apache.org/jira/browse/HBASE-22284) |
optimization StringBuilder.append of AbstractMemStore.toString | Trivial | . |
+| [HBASE-22523](https://issues.apache.org/jira/browse/HBASE-22523) | Refactor
RegionStates#getAssignmentsByTable to make it easy to understand | Major | . |
+| [HBASE-22511](https://issues.apache.org/jira/browse/HBASE-22511) | More
missing /rs-status links | Minor | UI |
+| [HBASE-22496](https://issues.apache.org/jira/browse/HBASE-22496) |
UnsafeAccess.unsafeCopy should not copy more than UNSAFE\_COPY\_THRESHOLD on
each iteration | Major | . |
+| [HBASE-22488](https://issues.apache.org/jira/browse/HBASE-22488) | Cleanup
the explicit timeout value for test methods | Major | . |
+
+
+### BUG FIXES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-22632](https://issues.apache.org/jira/browse/HBASE-22632) |
SplitTableRegionProcedure and MergeTableRegionsProcedure should skip store
files for unknown column families | Major | proc-v2 |
+| [HBASE-22838](https://issues.apache.org/jira/browse/HBASE-22838) |
assembly:single failure: user id or group id 'xxxxx' is too big | Major |
build |
+| [HBASE-22840](https://issues.apache.org/jira/browse/HBASE-22840) | Fix
backport of HBASE-21325 | Major | regionserver |
+| [HBASE-22417](https://issues.apache.org/jira/browse/HBASE-22417) |
DeleteTableProcedure.deleteFromMeta method should remove table from Master's
table descriptors cache | Major | . |
+| [HBASE-22115](https://issues.apache.org/jira/browse/HBASE-22115) | HBase RPC
aspires to grow an infinite tree of trace scopes; some other places are also
unsafe | Critical | rpc, tracing |
+| [HBASE-22539](https://issues.apache.org/jira/browse/HBASE-22539) | WAL
corruption due to early DBBs re-use when Durability.ASYNC\_WAL is used |
Blocker | rpc, wal |
+| [HBASE-22801](https://issues.apache.org/jira/browse/HBASE-22801) | Maven
build issue on Github PRs | Major | build |
+| [HBASE-22793](https://issues.apache.org/jira/browse/HBASE-22793) | RPC
server connection is logging user as NULL principal | Minor | rpc |
+| [HBASE-22778](https://issues.apache.org/jira/browse/HBASE-22778) | Upgrade
jasckson databind to 2.9.9.2 | Blocker | dependencies |
+| [HBASE-22773](https://issues.apache.org/jira/browse/HBASE-22773) | when set
blockSize option in Performance Evaluation tool, error occurs:ERROR:
Unrecognized option/command: --blockSize=131072 | Minor | mapreduce |
+| [HBASE-22735](https://issues.apache.org/jira/browse/HBASE-22735) |
list\_regions may throw an error if a region is RIT | Minor | shell |
+| [HBASE-22145](https://issues.apache.org/jira/browse/HBASE-22145) | windows
hbase-env causes hbase cli/etc to ignore HBASE\_OPTS | Major | . |
+| [HBASE-22758](https://issues.apache.org/jira/browse/HBASE-22758) | Remove
the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMeta |
Major | . |
+| [HBASE-22751](https://issues.apache.org/jira/browse/HBASE-22751) | table.jsp
fails if ugly regions in table | Major | UI |
+| [HBASE-22733](https://issues.apache.org/jira/browse/HBASE-22733) |
TestSplitTransactionOnCluster.testMasterRestartAtRegionSplitPendingCatalogJanitor
is flakey | Major | . |
+| [HBASE-22715](https://issues.apache.org/jira/browse/HBASE-22715) | All scan
requests should be handled by scan handler threads in RWQueueRpcExecutor |
Minor | . |
+| [HBASE-22722](https://issues.apache.org/jira/browse/HBASE-22722) | Upgrade
jackson databind dependencies to 2.9.9.1 | Blocker | dependencies |
+| [HBASE-22603](https://issues.apache.org/jira/browse/HBASE-22603) | Javadoc
Warnings related to @link tag | Trivial | documentation |
+| [HBASE-22720](https://issues.apache.org/jira/browse/HBASE-22720) | Incorrect
link for hbase.unittests | Trivial | documentation |
+| [HBASE-22537](https://issues.apache.org/jira/browse/HBASE-22537) | Split
happened Replica region can not be deleted after deleting table successfully
and restarting RegionServer | Minor | Region Assignment |
+| [HBASE-20368](https://issues.apache.org/jira/browse/HBASE-20368) | Fix RIT
stuck when a rsgroup has no online servers but AM's pendingAssginQueue is
cleared | Major | rsgroup |
+| [HBASE-22700](https://issues.apache.org/jira/browse/HBASE-22700) | Incorrect
timeout in recommended ZooKeeper configuration | Minor | documentation |
+| [HBASE-22661](https://issues.apache.org/jira/browse/HBASE-22661) |
list\_regions command in hbase shell is broken | Major | shell |
+| [HBASE-22684](https://issues.apache.org/jira/browse/HBASE-22684) | The log
rolling request maybe canceled immediately in LogRoller due to a race | Major
| wal |
+| [HBASE-22586](https://issues.apache.org/jira/browse/HBASE-22586) | Javadoc
Warnings related to @param tag | Trivial | documentation |
+| [HBASE-22571](https://issues.apache.org/jira/browse/HBASE-22571) | Javadoc
Warnings related to @return tag | Trivial | documentation |
+| [HBASE-22681](https://issues.apache.org/jira/browse/HBASE-22681) | The
'assert highestUnsyncedTxid \< entry.getTxid();' in AbstractFWAL.append may
fail when using AsyncFSWAL | Critical | wal |
+| [HBASE-22686](https://issues.apache.org/jira/browse/HBASE-22686) |
ZkSplitLogWorkerCoordination doesn't allow a regionserver to pick up all of the
split work it is capable of | Major | . |
+| [HBASE-22656](https://issues.apache.org/jira/browse/HBASE-22656) | [Metrics]
Tabe metrics 'BatchPut' and 'BatchDelete' are never updated | Minor | metrics
|
+| [HBASE-22582](https://issues.apache.org/jira/browse/HBASE-22582) | The
Compaction writer may access the lastCell whose memory has been released when
appending fileInfo in the final | Major | Compaction |
+| [HBASE-22652](https://issues.apache.org/jira/browse/HBASE-22652) | Flakey
TestLockManager; test timed out after 780 seconds | Major | proc-v2 |
+| [HBASE-22637](https://issues.apache.org/jira/browse/HBASE-22637) | fix flaky
TestMetaTableMetrics test | Major | metrics, test |
+| [HBASE-13798](https://issues.apache.org/jira/browse/HBASE-13798) |
TestFromClientSide\* don't close the Table | Trivial | test |
+| [HBASE-21751](https://issues.apache.org/jira/browse/HBASE-21751) | WAL
creation fails during region open may cause region assign forever fail | Major
| . |
+| [HBASE-22477](https://issues.apache.org/jira/browse/HBASE-22477) | Throwing
exception when meta region is not in OPEN state in client registry may crash a
master | Major | Client, master, meta |
+| [HBASE-22169](https://issues.apache.org/jira/browse/HBASE-22169) | Open
region failed cause memory leak | Critical | . |
+| [HBASE-22617](https://issues.apache.org/jira/browse/HBASE-22617) | Recovered
WAL directories not getting cleaned up | Blocker | wal |
+| [HBASE-22605](https://issues.apache.org/jira/browse/HBASE-22605) | Ref guide
includes dev guidance only applicable to EOM versions | Trivial |
documentation |
+| [HBASE-22581](https://issues.apache.org/jira/browse/HBASE-22581) | user with
"CREATE" permission can grant, but not revoke permissions on created table |
Major | security |
+| [HBASE-22565](https://issues.apache.org/jira/browse/HBASE-22565) | Javadoc
Warnings: @see cannot be used in inline documentation | Trivial |
documentation |
+| [HBASE-22562](https://issues.apache.org/jira/browse/HBASE-22562) |
PressureAwareThroughputController#skipControl never invoked | Trivial |
Operability |
+| [HBASE-22530](https://issues.apache.org/jira/browse/HBASE-22530) | The
metrics of store files count of region are returned to clients incorrectly |
Minor | metrics, regionserver |
+| [HBASE-22458](https://issues.apache.org/jira/browse/HBASE-22458) |
TestClassFinder fails when run on JDK11 | Minor | java, test |
+| [HBASE-22563](https://issues.apache.org/jira/browse/HBASE-22563) | Reduce
retained jobs for Jenkins pipelines | Major | . |
+| [HBASE-22551](https://issues.apache.org/jira/browse/HBASE-22551) |
TestMasterOperationsForRegionReplicas is flakey | Major | read replicas, test |
+| [HBASE-22481](https://issues.apache.org/jira/browse/HBASE-22481) | Javadoc
Warnings: reference not found | Trivial | documentation |
+| [HBASE-22520](https://issues.apache.org/jira/browse/HBASE-22520) | Avoid
possible NPE in HalfStoreFileReader seekBefore() | Major | . |
+| [HBASE-22546](https://issues.apache.org/jira/browse/HBASE-22546) |
TestRegionServerHostname#testRegionServerHostname fails reliably for me |
Major | . |
+| [HBASE-22534](https://issues.apache.org/jira/browse/HBASE-22534) |
TestCellUtil fails when run on JDK11 | Minor | java, test |
+| [HBASE-22536](https://issues.apache.org/jira/browse/HBASE-22536) |
TestForeignExceptionSerialization fails when run on JDK11 | Minor | java |
+| [HBASE-22535](https://issues.apache.org/jira/browse/HBASE-22535) |
TestShellRSGroups fails when run on JDK11 | Minor | java, shell |
+| [HBASE-22518](https://issues.apache.org/jira/browse/HBASE-22518) | yetus
personality is treating branch-1.4 like earlier branches for hadoopcheck |
Major | test |
+| [HBASE-22522](https://issues.apache.org/jira/browse/HBASE-22522) | The
integration test in master branch's nightly job has error "ERROR: Only found
1050 rows." | Major | . |
+| [HBASE-22490](https://issues.apache.org/jira/browse/HBASE-22490) | Nightly
client integration test fails with hadoop-3 | Major | build |
+| [HBASE-22487](https://issues.apache.org/jira/browse/HBASE-22487) |
getMostLoadedRegions is unused | Trivial | regionserver |
+| [HBASE-22486](https://issues.apache.org/jira/browse/HBASE-22486) | Fix flaky
test TestLockManager | Major | . |
+| [HBASE-22471](https://issues.apache.org/jira/browse/HBASE-22471) | Our
nightly jobs for master and branch-2 are still using hadoop-2.7.1 in
integration test | Major | build |
+| [HBASE-19893](https://issues.apache.org/jira/browse/HBASE-19893) |
restore\_snapshot is broken in master branch when region splits | Critical |
snapshots |
+
+
+### TESTS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-22725](https://issues.apache.org/jira/browse/HBASE-22725) | Remove
all remaining javadoc warnings | Trivial | test |
+| [HBASE-22615](https://issues.apache.org/jira/browse/HBASE-22615) | Make
TestChoreService more robust to timing | Minor | test |
+
+
+### SUB-TASKS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-22845](https://issues.apache.org/jira/browse/HBASE-22845) | Revert
MetaTableAccessor#makePutFromTableState access to public | Blocker | . |
+| [HBASE-22777](https://issues.apache.org/jira/browse/HBASE-22777) | Add a
multi-region merge (for fixing overlaps, etc.) | Major | hbck2, proc-v2 |
+| [HBASE-22803](https://issues.apache.org/jira/browse/HBASE-22803) | Modify
config value range to enable turning off of the hbck chore | Major | . |
+| [HBASE-22824](https://issues.apache.org/jira/browse/HBASE-22824) | Show
filesystem path for the orphans regions on filesystem | Major | . |
+| [HBASE-22808](https://issues.apache.org/jira/browse/HBASE-22808) | HBCK
Report showed the offline regions which belong to disabled table | Major | . |
+| [HBASE-22807](https://issues.apache.org/jira/browse/HBASE-22807) | HBCK
Report showed wrong orphans regions on FileSystem | Major | . |
+| [HBASE-22805](https://issues.apache.org/jira/browse/HBASE-22805) | Fix
broken unit test, TestCatalogJanitorCluster on branch-2.1 and branch-2.0 |
Major | . |
+| [HBASE-22771](https://issues.apache.org/jira/browse/HBASE-22771) | [HBCK2]
fixMeta method and server-side support | Major | hbck2 |
+| [HBASE-22737](https://issues.apache.org/jira/browse/HBASE-22737) | Add a new
admin method and shell cmd to trigger the hbck chore to run | Major | . |
+| [HBASE-22741](https://issues.apache.org/jira/browse/HBASE-22741) | Show
catalogjanitor consistency complaints in new 'HBCK Report' page | Major |
hbck2, UI |
+| [HBASE-22723](https://issues.apache.org/jira/browse/HBASE-22723) | Have
CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its
regular scan of hbase:meta | Major | . |
+| [HBASE-22709](https://issues.apache.org/jira/browse/HBASE-22709) | Add a
chore thread in master to do hbck checking and display results in 'HBCK Report'
page | Major | . |
+| [HBASE-22742](https://issues.apache.org/jira/browse/HBASE-22742) | [HBCK2]
Add more log for hbck operations at master side | Minor | . |
+| [HBASE-22527](https://issues.apache.org/jira/browse/HBASE-22527) | [hbck2]
Add a master web ui to show the problematic regions | Major |
hbase-operator-tools, hbck2 |
+| [HBASE-22719](https://issues.apache.org/jira/browse/HBASE-22719) | Add debug
support for github PR pre commit job | Major | build |
+| [HBASE-7191](https://issues.apache.org/jira/browse/HBASE-7191) | HBCK - Add
offline create/fix hbase.version and hbase.id | Major | hbck |
+| [HBASE-22357](https://issues.apache.org/jira/browse/HBASE-22357) | Fix
remaining Checkstyle issues in hbase-replication | Trivial | Replication |
+| [HBASE-22554](https://issues.apache.org/jira/browse/HBASE-22554) | Upgrade
to surefire 2.22.2 | Major | test |
+| [HBASE-22507](https://issues.apache.org/jira/browse/HBASE-22507) | Backport
the pre commit changes in HBASE-22500 to all active branches | Major | build |
+| [HBASE-22316](https://issues.apache.org/jira/browse/HBASE-22316) | Record
the stack trace for current thread in FutureUtils.get | Major | asyncclient,
Client |
+
+
+### OTHER:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-22382](https://issues.apache.org/jira/browse/HBASE-22382) | Refactor
tests in TestFromClientSide | Major | test |
+| [HBASE-21606](https://issues.apache.org/jira/browse/HBASE-21606) | Document
use of the meta table load metrics added in HBASE-19722 | Critical |
documentation, meta, metrics, Operability |
+| [HBASE-19230](https://issues.apache.org/jira/browse/HBASE-19230) | Write up
fixVersion policy from dev discussion in refguide | Major | documentation |
+| [HBASE-22566](https://issues.apache.org/jira/browse/HBASE-22566) | Call out
default compaction throttling for 2.x in Book | Major | documentation |
+| [HBASE-22568](https://issues.apache.org/jira/browse/HBASE-22568) | [2.1]
Upgrade to Jetty 9.3.latest and Jackson 2.9.latest | Major | dependencies |
+| [HBASE-21536](https://issues.apache.org/jira/browse/HBASE-21536) | Fix
completebulkload usage instructions | Trivial | documentation, mapreduce |
+
+
## Release 2.1.5 - Unreleased (as of 2019-05-28)
### INCOMPATIBLE CHANGES:
@@ -33,6 +202,7 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22148](https://issues.apache.org/jira/browse/HBASE-22148) | Provide
an alternative to CellUtil.setTimestamp | Blocker | API, Coprocessors |
| [HBASE-21815](https://issues.apache.org/jira/browse/HBASE-21815) | Make
isTrackingMetrics and getMetrics of ScannerContext public | Minor | . |
@@ -68,6 +238,7 @@
| [HBASE-22003](https://issues.apache.org/jira/browse/HBASE-22003) | Fix flaky
test TestVerifyReplication.testHBase14905 | Major | . |
| [HBASE-22441](https://issues.apache.org/jira/browse/HBASE-22441) |
BucketCache NullPointerException in cacheBlock | Major | BucketCache |
| [HBASE-22462](https://issues.apache.org/jira/browse/HBASE-22462) | Should
run a 'mvn install' at the end of hadoop check in pre commit job | Major |
build |
+| [HBASE-22440](https://issues.apache.org/jira/browse/HBASE-22440) |
HRegionServer#getWalGroupsReplicationStatus() throws NPE | Major |
regionserver, Replication |
| [HBASE-22289](https://issues.apache.org/jira/browse/HBASE-22289) | WAL-based
log splitting resubmit threshold may result in a task being stuck forever |
Major | . |
| [HBASE-22226](https://issues.apache.org/jira/browse/HBASE-22226) | Incorrect
level for headings in asciidoc | Trivial | documentation |
| [HBASE-22442](https://issues.apache.org/jira/browse/HBASE-22442) | Nightly
build is failing with hadoop 3.x | Major | build, hadoop3 |
@@ -130,6 +301,7 @@
| JIRA | Summary | Priority | Component |
|:---- |:---- | :--- |:---- |
+| [HBASE-22419](https://issues.apache.org/jira/browse/HBASE-22419) | Backport
hbase-personality changes in HBASE-22399 and HBASE-20970 to all active branches
| Major | build |
| [HBASE-22445](https://issues.apache.org/jira/browse/HBASE-22445) | Add file
info when throw exceptions in HFileReaderImpl | Major | . |
| [HBASE-22447](https://issues.apache.org/jira/browse/HBASE-22447) | Check
refCount before free block in BucketCache | Major | BucketCache |
| [HBASE-22325](https://issues.apache.org/jira/browse/HBASE-22325) |
AsyncRpcRetryingCaller will not schedule retry if we hit a
NotServingRegionException but there is no TableName provided | Major |
asyncclient, Client |
diff --git a/RELEASENOTES.md b/RELEASENOTES.md
index f6083f6..03a47c2 100755
--- a/RELEASENOTES.md
+++ b/RELEASENOTES.md
@@ -20,6 +20,161 @@
# Be careful doing manual edits in this file. Do not change format
# of release header or remove the below marker. This file is generated.
# DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!-->
+# HBASE 2.1.6 Release Notes
+
+These release notes cover new developer and user-facing incompatibilities,
important issues, features, and major improvements.
+
+
+---
+
+* [HBASE-22777](https://issues.apache.org/jira/browse/HBASE-22777) | *Major* |
**Add a multi-region merge (for fixing overlaps, etc.)**
+
+Changes merge so you can merge more than two regions at a time. Currently
only available inside HBase. HBASE-22827, a follow-on, is about exposing the
facility in the Admin API (and then via the shell).
+
+
+---
+
+* [HBASE-15666](https://issues.apache.org/jira/browse/HBASE-15666) |
*Critical* | **shaded dependencies for hbase-testing-util**
+
+New shaded artifact for testing: hbase-shaded-testing-util.
+
+
+---
+
+* [HBASE-22539](https://issues.apache.org/jira/browse/HBASE-22539) | *Blocker*
| **WAL corruption due to early DBBs re-use when Durability.ASYNC\_WAL is used**
+
+We found a critical bug which can lead to WAL corruption when
Durability.ASYNC\_WAL is used. The reason is that we release a ByteBuffer
before actually persist the content into WAL file.
+
+The problem maybe lead to several errors, for example, ArrayIndexOfOutBounds
when replaying WAL. This is because that the ByteBuffer is reused by others.
+
+ERROR org.apache.hadoop.hbase.executor.EventHandler: Caught throwable while
processing event RS\_LOG\_REPLAY
+java.lang.ArrayIndexOutOfBoundsException: 18056
+ at org.apache.hadoop.hbase.KeyValue.getFamilyLength(KeyValue.java:1365)
+ at org.apache.hadoop.hbase.KeyValue.getFamilyLength(KeyValue.java:1358)
+ at
org.apache.hadoop.hbase.PrivateCellUtil.matchingFamily(PrivateCellUtil.java:735)
+ at org.apache.hadoop.hbase.CellUtil.matchingFamily(CellUtil.java:816)
+ at
org.apache.hadoop.hbase.wal.WALEdit.isMetaEditFamily(WALEdit.java:143)
+ at org.apache.hadoop.hbase.wal.WALEdit.isMetaEdit(WALEdit.java:148)
+ at
org.apache.hadoop.hbase.wal.WALSplitter.splitLogFile(WALSplitter.java:297)
+ at
org.apache.hadoop.hbase.wal.WALSplitter.splitLogFile(WALSplitter.java:195)
+ at
org.apache.hadoop.hbase.regionserver.SplitLogWorker$1.exec(SplitLogWorker.java:100)
+
+And may even cause segmentation fault and crash the JVM directly. You will see
a hs\_err\_pidXXX.log file and usually the problem is SIGSEGV. This is usually
because that the ByteBuffer has already been returned to the OS and used for
other purpose.
+
+The problem has been reported several times in the past and this time
Wellington Ramos Chevreuil provided the full logs and deeply analyzed the logs
so we can find the root cause. And Lijin Bin figured out that the problem may
only happen when Durability.ASYNC\_WAL is used. Thanks to them.
+
+The problem only effects the 2.x releases, all users are highly recommand to
upgrade to a release which has this fix in, especially that if you use
Durability.ASYNC\_WAL.
+
+
+---
+
+* [HBASE-22771](https://issues.apache.org/jira/browse/HBASE-22771) | *Major* |
**[HBCK2] fixMeta method and server-side support**
+
+Adds a fixMeta method to hbck Service. Fixes holes in hbase:meta. Follow-up to
fix overlaps.
+
+Follow-on is adding a client-side to hbase-operator-tools that can exploit
this new addition (HBASE-22825)
+
+
+---
+
+* [HBASE-22737](https://issues.apache.org/jira/browse/HBASE-22737) | *Major* |
**Add a new admin method and shell cmd to trigger the hbck chore to run**
+
+Add a new method runHbckChore in Hbck interface and a new shell cmd
hbck\_chore\_run to request HBCK chore to run at master side.
+
+
+---
+
+* [HBASE-22741](https://issues.apache.org/jira/browse/HBASE-22741) | *Major* |
**Show catalogjanitor consistency complaints in new 'HBCK Report' page**
+
+Adds a "CatalogJanitor hbase:meta Consistency Issues" section to the new 'HBCK
Report' page added by HBASE-22709. This section is empty unless the most recent
CatalogJanitor scan turned up problems. If so, will show table of issues found.
+
+
+---
+
+* [HBASE-22723](https://issues.apache.org/jira/browse/HBASE-22723) | *Major* |
**Have CatalogJanitor report holes and overlaps; i.e. problems it sees when
doing its regular scan of hbase:meta**
+
+When CatalogJanitor runs, it now checks for holes, overlaps, empty
info:regioninfo columns and bad servers. Dumps findings into log. Follow-up
adds report to new 'HBCK Report' linked off the Master UI.
+
+NOTE: All features but the badserver check made it into branch-2.1 and
branch-2.0 backports.
+
+
+---
+
+* [HBASE-22709](https://issues.apache.org/jira/browse/HBASE-22709) | *Major* |
**Add a chore thread in master to do hbck checking and display results in 'HBCK
Report' page**
+
+1. Add a new chore thread in master to do hbck checking
+2. Add a new web ui "HBCK Report" page to display checking results.
+
+This feature is enabled by default. And the hbck chore run per 60 minutes by
default. You can config "hbase.master.hbck.checker.interval" to a value lesser
than or equal to 0 for disabling the chore.
+
+Notice: the config "hbase.master.hbck.checker.interval" was renamed to
"hbase.master.hbck.chore.interval" in HBASE-22737.
+
+
+---
+
+* [HBASE-22722](https://issues.apache.org/jira/browse/HBASE-22722) | *Blocker*
| **Upgrade jackson databind dependencies to 2.9.9.1**
+
+Upgrade jackson databind dependency to 2.9.9.1 due to CVEs
+
+https://nvd.nist.gov/vuln/detail/CVE-2019-12814
+
+https://nvd.nist.gov/vuln/detail/CVE-2019-12384
+
+
+---
+
+* [HBASE-22527](https://issues.apache.org/jira/browse/HBASE-22527) | *Major* |
**[hbck2] Add a master web ui to show the problematic regions**
+
+Add a new master web UI to show the potentially problematic opened regions.
There are three case:
+1. Master thought this region opened, but no regionserver reported it.
+2. Master thought this region opened on Server1, but regionserver reported
Server2
+3. More than one regionservers reported opened this region
+
+
+---
+
+* [HBASE-22610](https://issues.apache.org/jira/browse/HBASE-22610) | *Trivial*
| **[BucketCache] Rename "hbase.offheapcache.minblocksize"**
+
+The config point "hbase.offheapcache.minblocksize" was wrong and is now
deprecated. The new config point is "hbase.blockcache.minblocksize".
+
+
+---
+
+* [HBASE-22690](https://issues.apache.org/jira/browse/HBASE-22690) | *Major* |
**Deprecate / Remove OfflineMetaRepair in hbase-2+**
+
+OfflineMetaRepair is no longer supported in HBase-2+. Please refer to
https://hbase.apache.org/book.html#HBCK2
+
+This tool is deprecated in 2.x and will be removed in 3.0.
+
+
+---
+
+* [HBASE-22617](https://issues.apache.org/jira/browse/HBASE-22617) | *Blocker*
| **Recovered WAL directories not getting cleaned up**
+
+In HBASE-20734 we moved the recovered.edits onto the wal file system but when
constructing the directory we missed the BASE\_NAMESPACE\_DIR('data'). So when
using the default config, you will find that there are lots of new directories
at the same level with the 'data' directory.
+
+In this issue, we add the BASE\_NAMESPACE\_DIR back, and also try our best to
clean up the wrong directories. But we can only clean up the region level
directories, so if you want a clean fs layout on HDFS you still need to
manually delete the empty directories at the same level with 'data'.
+
+The effect versions are 2.2.0, 2.1.[1-5], 1.4.[8-10], 1.3.[3-5].
+
+
+---
+
+* [HBASE-22596](https://issues.apache.org/jira/browse/HBASE-22596) | *Minor* |
**[Chore] Separate the execution period between CompactionChecker and
PeriodicMemStoreFlusher**
+
+hbase.regionserver.compaction.check.period is used for controlling how often
the compaction checker runs. If unset, will use
hbase.server.thread.wakefrequency as default value.
+
+hbase.regionserver.flush.check.period is used for controlling how ofter the
flush checker runs. If unset, will use hbase.server.thread.wakefrequency as
default value.
+
+
+---
+
+* [HBASE-21536](https://issues.apache.org/jira/browse/HBASE-21536) | *Trivial*
| **Fix completebulkload usage instructions**
+
+Added completebulkload short name for BulkLoadHFilesTool to bin/hbase.
+
+
+
# HBASE 2.1.5 Release Notes
These release notes cover new developer and user-facing incompatibilities,
important issues, features, and major improvements.
@@ -27,6 +182,17 @@ These release notes cover new developer and user-facing
incompatibilities, impor
---
+* [HBASE-22148](https://issues.apache.org/jira/browse/HBASE-22148) | *Blocker*
| **Provide an alternative to CellUtil.setTimestamp**
+
+<!-- markdown -->
+
+The `CellUtil.setTimestamp` method changes to be an API with audience
`LimitedPrivate(COPROC)` in HBase 3.0. With that designation the API should
remain stable within a given minor release line, but may change between minor
releases.
+
+Previously, this method was deprecated in HBase 2.0 for removal in HBase 3.0.
Deprecation messages in HBase 2.y releases have been updated to indicate the
expected API audience change.
+
+
+---
+
* [HBASE-21991](https://issues.apache.org/jira/browse/HBASE-21991) | *Major* |
**Fix MetaMetrics issues - [Race condition, Faulty remove logic], few
improvements**
The class LossyCounting was unintentionally marked Public but was never
intended to be part of our public API. This oversight has been corrected and
LossyCounting is now marked as Private and going forward may be subject to
additional breaking changes or removal without notice. If you have taken a
dependency on this class we recommend cloning it locally into your project
before upgrading to this release.
