This is an automated email from the ASF dual-hosted git repository.
zghao pushed a change to branch HBASE-24666
in repository https://gitbox.apache.org/repos/asf/hbase.git.
omit 7e9baa2 HBASE-24684 Fetch ReplicationSink servers list from HMaster
instead o… (#2077)
omit 2325696 HBASE-24998 Introduce a ReplicationSourceOverallController
interface and decouple ReplicationSourceManager and ReplicationSource (#2364)
omit c302a9e HBASE-24982 Disassemble the method replicateWALEntry from
AdminService to a new interface ReplicationServerService (#2360)
omit 2e95e75 HBASE-24683 Add a basic ReplicationServer which only
implement ReplicationSink Service (#2111)
omit d490870 HBASE-24735: Refactor ReplicationSourceManager: move
logPositionAndCleanOldLogs/cleanUpHFileRefs to ReplicationSource inside (#2064)
omit d90c20e HBASE-24681 Remove the cache walsById/walsByIdRecoveredQueues
from ReplicationSourceManager (#2019)
omit 8e1bf74 HBASE-24682 Refactor ReplicationSource#addHFileRefs method:
move it to ReplicationSourceManager (#2020)
add dcba493 HBASE-25016 addendum: should also close the Table which is
returned by calling getMetaHTable
add 2042523 HBASE-24877 Add option to avoid aborting RS process upon
uncaught exc… (#2255)
add 724a0e5 HBASE-25022 Remove 'hbase.testing.nocluster' config (#2394)
add a3f4028 HBASE-25002 Create simple pattern matching query for
retrieving metri… (#2370)
add 325317f HBASE-24831 : Addendum for source compatibility
add ca96f96 HBASE-25014 ScheduledChore is never triggered when
initalDelay > 1.5*period (#2395)
add 6d985dd HBASE-25009: Hbck chore logs wrong message when loading
regions from RS (#2379)
add c5ca191 HBASE-24875 Remove the force param for unassign since it dose
not take effect any more (#2254)
add a918bf0 HBASE-25012 HBASE-24359 causes replication missed log of some
RemoteException (#2384)
add bfdc96e HBASE-25035 Add 2.2.6 to download page (#2405)
add 1bb19e0 HBASE-25037 Lots of thread pool are changed to non daemon
after HBASE-24750 which causes trouble when shutting down (#2407)
add 35d59dc HBASE-24528 : BalancerDecision queue implementation in
HMaster with Admin API
add b3dfc8f HBASE-25021 Nightly job should skip hadoop-2 integration test
for master (#2409)
add 9fc586a HBASE-25047 WAL split edits number is negative in
RegionServerUI (#2408)
add e386ec5 HBASE-25054 Do not add non shaded protobuf as dependency in
TableMapReduceUtil for master (#2412)
add 5e12c0a HBASE-25061 Update default URL to KEYS file in
`hbase-vote.sh` (#2416)
add 16831ec HBASE-24857:Fix several problems when starting webUI (#2245)
add 6371914 HBASE-25057: Fix typo memeber (#2414)
add 58618e3 HBASE-24991 Replace MovedRegionsCleaner with guava cache
(#2357)
add 4c9a92d HBASE-24481 REST - Fix incorrect response code of get-regions
in rest api
add fd7260b HBASE-25069: Display region name instead of encoded region
name in HBCK report page. (#2428)
add 0956c34 HBASE-25066 Use FutureUtils.rethrow in
AsyncTableResultScanner to better catch the stack trace (#2420)
add 3e13b3f HBASE-24896 'Stuck' in static initialization creating
RegionInfo instance
add d41eb4f HBASE-24896 : Jira number correction in comment (ADDENDUM)
add b5adfe1 HBASE-25072 Remove the unnecessary System.out.println in
MasterRegistry (#2429)
add 8efd250 HBASE-24976 Printing the swallowed exception
add 8c11007 Revert "HBASE-24976 Printing the swallowed exception"
add 7731856 HBASE-24976 REST Server failes to start without any error
message
add 36e8b0b HBASE-25075 Fix typo in ReplicationProtobufUtil (#2431)
add 8a6299b HBASE-25076 fix typo in MasterRegion java doc (#2432)
add d1a3b66 HBASE-25081 Up the container nproc uplimit to 30000 (#2439)
add 70a947d HBASE-25067 Edit of log messages around async WAL
Replication; checkstyle fixes; and a bugfix (#2435)
add 17ebf91 HBASE-25068 Pass WALFactory to Replication so it knows of all
WALProviders, not just default/user-space
add 2c5055f HBASE-25068 Pass WALFactory to Replication so it knows of all
WALProviders, not just default/user-space (#2434)
add 7e910a5 HBASE-25074 Refactor ReplicationSinkManager: reduce code and
make it easy to understand (#2430)
new f54d2ab HBASE-24682 Refactor ReplicationSource#addHFileRefs method:
move it to ReplicationSourceManager (#2020)
new e2bdc6d HBASE-24681 Remove the cache walsById/walsByIdRecoveredQueues
from ReplicationSourceManager (#2019)
new 8ebcd7f HBASE-24735: Refactor ReplicationSourceManager: move
logPositionAndCleanOldLogs/cleanUpHFileRefs to ReplicationSource inside (#2064)
new f92f853 HBASE-24683 Add a basic ReplicationServer which only
implement ReplicationSink Service (#2111)
new 788772c HBASE-24982 Disassemble the method replicateWALEntry from
AdminService to a new interface ReplicationServerService (#2360)
new 28f025d HBASE-24998 Introduce a ReplicationSourceOverallController
interface and decouple ReplicationSourceManager and ReplicationSource (#2364)
new 8dd91f4 HBASE-24684 Fetch ReplicationSink servers list from HMaster
instead o… (#2077)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (7e9baa2)
\
N -- N -- N refs/heads/HBASE-24666 (8dd91f4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 7 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
bin/hbase | 2 +-
dev-support/Jenkinsfile | 107 ++++----
dev-support/hbase-personality.sh | 4 +-
dev-support/hbase-vote.sh | 4 +-
.../hbase_nightly_pseudo-distributed-test.sh | 2 +-
.../LogRollBackupSubprocedurePool.java | 8 +-
.../LogRollRegionServerProcedureManager.java | 2 +-
.../org/apache/hadoop/hbase/MetaTableAccessor.java | 3 +-
.../java/org/apache/hadoop/hbase/client/Admin.java | 59 +++-
.../hadoop/hbase/client/AdminOverAsyncAdmin.java | 17 +-
.../org/apache/hadoop/hbase/client/AsyncAdmin.java | 57 +++-
.../hadoop/hbase/client/AsyncConnectionImpl.java | 6 +-
.../hadoop/hbase/client/AsyncHBaseAdmin.java | 17 +-
.../hbase/client/AsyncTableResultScanner.java | 9 +-
.../hadoop/hbase/client/BalancerDecision.java | 152 +++++++++++
.../hadoop/hbase/client/ClusterStatusListener.java | 2 +-
.../org/apache/hadoop/hbase/client/LogEntry.java | 26 +-
.../apache/hadoop/hbase/client/LogQueryFilter.java | 9 +-
.../apache/hadoop/hbase/client/MasterRegistry.java | 3 +-
.../hadoop/hbase/client/OnlineLogRecord.java | 35 +--
.../hadoop/hbase/client/RawAsyncHBaseAdmin.java | 93 ++++---
.../org/apache/hadoop/hbase/client/RegionInfo.java | 9 +-
.../hbase/client/{Row.java => ServerType.java} | 16 +-
.../apache/hadoop/hbase/ipc/AbstractRpcClient.java | 12 +-
.../hadoop/hbase/ipc/NettyRpcConnection.java | 2 +-
.../hadoop/hbase/shaded/protobuf/ProtobufUtil.java | 76 +++++-
.../hbase/shaded/protobuf/RequestConverter.java | 88 +++---
.../org/apache/hadoop/hbase/ScheduledChore.java | 2 +-
.../org/apache/hadoop/hbase/util/FutureUtils.java | 32 ++-
hbase-common/src/main/resources/hbase-default.xml | 11 +-
.../org/apache/hadoop/hbase/TestChoreService.java | 25 +-
.../apache/hadoop/hbase/util/TestFutureUtils.java | 2 +-
.../hbase/client/example/AsyncClientExample.java | 2 +-
.../MetricsStochasticBalancerSourceImpl.java | 4 +-
.../hadoop/hbase/http/jmx/JMXJsonServlet.java | 15 ++
.../org/apache/hadoop/hbase/util/JSONBean.java | 52 +++-
.../hadoop/hbase/http/jmx/TestJMXJsonServlet.java | 38 +++
.../chaos/policies/TwoConcurrentActionPolicy.java | 2 +-
.../hadoop/hbase/mapreduce/TableMapReduceUtil.java | 1 -
.../hbase/mapreduce/TableRecordReaderImpl.java | 32 +++
.../procedure2/RemoteProcedureDispatcher.java | 2 +-
.../src/main/protobuf/HBase.proto | 12 +-
.../src/main/protobuf/server/master/Master.proto | 27 ++
.../protobuf/server/master/MasterProcedure.proto | 1 +
.../master/RecentLogs.proto} | 23 +-
.../src/main/protobuf/server/region/Admin.proto | 18 ++
.../hbase/replication/ReplicationPeerImpl.java | 4 +-
.../org/apache/hadoop/hbase/rest/RESTServer.java | 10 +-
.../apache/hadoop/hbase/rest/RegionsResource.java | 3 +
.../hadoop/hbase/rest/TestTableResource.java | 9 +
.../AsyncRegionReplicaReplayRetryingCaller.java | 4 +-
.../hadoop/hbase/coprocessor/MasterObserver.java | 10 +-
.../apache/hadoop/hbase/ipc/FifoRpcScheduler.java | 2 +-
.../hadoop/hbase/ipc/MasterFifoRpcScheduler.java | 13 +-
.../hbase/master/ClusterStatusPublisher.java | 2 +-
.../org/apache/hadoop/hbase/master/HMaster.java | 41 ++-
.../org/apache/hadoop/hbase/master/HbckChore.java | 2 +-
.../hadoop/hbase/master/MasterCoprocessorHost.java | 9 +-
.../hadoop/hbase/master/MasterRpcServices.java | 60 ++++-
.../assignment/SplitTableRegionProcedure.java | 2 +-
.../hbase/master/assignment/UnassignProcedure.java | 6 -
.../hbase/master/balancer/BaseLoadBalancer.java | 11 +
.../master/balancer/StochasticLoadBalancer.java | 88 ++++--
.../hadoop/hbase/master/cleaner/DirScanPool.java | 2 +-
.../master/procedure/EnableTableProcedure.java | 4 +-
.../hadoop/hbase/master/region/MasterRegion.java | 4 +-
...onHandler.java => BalancerDecisionDetails.java} | 31 +--
.../hadoop/hbase/namequeues/NamedQueuePayload.java | 35 ++-
.../hbase/namequeues/NamedQueueRecorder.java | 8 +-
.../hbase/namequeues/RingBufferEnvelope.java | 2 +-
.../hadoop/hbase/namequeues/RpcLogDetails.java | 4 +-
.../impl/BalancerDecisionQueueService.java | 150 +++++++++++
.../hbase/namequeues/impl/SlowLogQueueService.java | 29 +-
.../namequeues/request/NamedQueueGetRequest.java | 17 +-
.../namequeues/response/NamedQueueGetResponse.java | 15 +-
.../hbase/procedure/ProcedureCoordinator.java | 2 +-
.../hadoop/hbase/procedure/ProcedureMember.java | 2 +-
.../hadoop/hbase/procedure/Subprocedure.java | 4 +-
.../RegionServerFlushTableProcedureManager.java | 4 +-
...otbufUtil.java => ReplicationProtobufUtil.java} | 2 +-
.../apache/hadoop/hbase/regionserver/HRegion.java | 23 +-
.../hadoop/hbase/regionserver/HRegionServer.java | 200 +++++---------
.../hadoop/hbase/regionserver/MemStoreFlusher.java | 2 +-
.../hadoop/hbase/regionserver/RSRpcServices.java | 51 +++-
.../hbase/regionserver/ReplicationService.java | 11 +-
.../regionserver/handler/AssignRegionHandler.java | 11 +-
.../handler/RegionReplicaFlushHandler.java | 31 +--
.../handler/UnassignRegionHandler.java | 14 +-
.../snapshot/RegionServerSnapshotManager.java | 4 +-
.../hadoop/hbase/regionserver/wal/FSHLog.java | 5 +-
.../hbase/regionserver/wal/ProtobufLogReader.java | 4 +-
.../replication/HBaseReplicationEndpoint.java | 298 +++++++++++++++------
.../HBaseInterClusterReplicationEndpoint.java | 83 ++----
.../ReplaySyncReplicationWALCallable.java | 4 +-
.../replication/regionserver/Replication.java | 8 +-
.../regionserver/ReplicationSinkManager.java | 237 ----------------
.../regionserver/ReplicationSource.java | 113 +++++---
.../regionserver/ReplicationSourceShipper.java | 3 +-
.../regionserver/ReplicationSyncUp.java | 6 +-
.../replication/regionserver/WALEntryStream.java | 12 +-
.../hbase/security/access/AccessController.java | 4 +-
.../hbase/security/access/ZKPermissionWatcher.java | 2 +-
.../hadoop/hbase/snapshot/SnapshotManifest.java | 2 +-
.../org/apache/hadoop/hbase/tool/CanaryTool.java | 8 +-
.../hadoop/hbase/tool/HFileContentValidator.java | 2 +-
.../java/org/apache/hadoop/hbase/util/FSUtils.java | 2 +-
.../org/apache/hadoop/hbase/util/HBaseFsck.java | 2 +-
.../hadoop/hbase/util/ModifyRegionUtils.java | 13 +-
.../org/apache/hadoop/hbase/wal/OutputSink.java | 2 +-
.../org/apache/hadoop/hbase/wal/WALSplitter.java | 2 +-
.../main/resources/hbase-webapps/master/hbck.jsp | 14 +-
.../hadoop/hbase/AcidGuaranteesTestTool.java | 2 +-
.../apache/hadoop/hbase/TestMovedRegionCache.java | 104 +++++++
.../hadoop/hbase/TestMovedRegionsCleaner.java | 95 -------
.../org/apache/hadoop/hbase/client/TestAdmin2.java | 9 +-
.../client/TestAsyncTableGetMultiThreaded.java | 18 +-
.../coprocessor/TestCoprocessorInterface.java | 9 +-
.../hbase/coprocessor/TestMasterObserver.java | 4 +-
.../coprocessor/TestOpenTableInCoprocessor.java | 6 +-
.../hadoop/hbase/master/MockRegionServer.java | 7 +
.../hbase/master/assignment/TestRegionStates.java | 2 +-
.../master/balancer/TestBalancerDecision.java | 105 ++++++++
.../balancer/TestStochasticLoadBalancer.java | 3 +
.../hbase/namequeues/TestNamedQueueRecorder.java | 2 +-
.../hbase/namequeues/TestSlowLogAccessor.java | 2 +-
.../hbase/procedure/SimpleRSProcedureManager.java | 4 +-
.../hbase/procedure/TestProcedureMember.java | 4 +-
.../hbase/protobuf/TestReplicationProtobuf.java | 2 +-
.../hadoop/hbase/regionserver/TestPriorityRpc.java | 55 ++--
.../hbase/regionserver/TestRSChoresScheduled.java | 7 -
.../TestRegionInfoStaticInitialization.java | 70 +++++
.../TestRegionServerReportForDuty.java | 2 +-
.../hbase/regionserver/wal/TestAsyncFSWAL.java | 6 +-
.../hbase/regionserver/wal/TestAsyncWALReplay.java | 2 +-
.../hbase/replication/SyncReplicationTestBase.java | 14 +-
.../replication/TestHBaseReplicationEndpoint.java | 220 +++++++++++++++
.../hbase/replication/TestReplicationBase.java | 2 +-
.../hbase/replication/TestReplicationServer.java | 8 +-
.../regionserver/TestReplicationSinkManager.java | 215 ---------------
.../regionserver/TestReplicationSource.java | 92 +++++++
.../regionserver/TestReplicationSourceManager.java | 3 +-
.../TestSerialReplicationEndpoint.java | 10 +-
.../hbase/rsgroup/VerifyingRSGroupAdmin.java | 14 +-
.../security/access/TestAccessController.java | 2 +-
.../access/TestWithDisabledAuthorization.java | 3 +-
.../apache/hadoop/hbase/util/TestHBaseFsckMOB.java | 7 +-
hbase-shell/src/main/ruby/hbase/admin.rb | 93 ++++---
hbase-shell/src/main/ruby/shell.rb | 1 +
...wlog_responses.rb => get_balancer_decisions.rb} | 30 ++-
.../ruby/shell/commands/get_largelog_responses.rb | 5 +-
.../ruby/shell/commands/get_slowlog_responses.rb | 5 +-
.../src/main/ruby/shell/commands/unassign.rb | 10 +-
hbase-shell/src/test/ruby/hbase/admin_test.rb | 4 +-
.../hadoop/hbase/thrift/IncrementCoalescer.java | 2 +-
.../hadoop/hbase/thrift2/client/ThriftAdmin.java | 12 +-
.../hadoop/hbase/zookeeper/MetaTableLocator.java | 6 +-
src/main/asciidoc/_chapters/developer.adoc | 2 +-
src/main/asciidoc/_chapters/hbase-default.adoc | 14 +
src/site/xdoc/downloads.xml | 18 +-
159 files changed, 2626 insertions(+), 1571 deletions(-)
create mode 100644
hbase-client/src/main/java/org/apache/hadoop/hbase/client/BalancerDecision.java
copy
hbase-metrics-api/src/main/java/org/apache/hadoop/hbase/metrics/MetricSet.java
=> hbase-client/src/main/java/org/apache/hadoop/hbase/client/LogEntry.java (69%)
copy hbase-client/src/main/java/org/apache/hadoop/hbase/client/{Row.java =>
ServerType.java} (78%)
copy hbase-protocol-shaded/src/main/protobuf/{MapReduce.proto =>
server/master/RecentLogs.proto} (69%)
copy
hbase-server/src/main/java/org/apache/hadoop/hbase/namequeues/{DisruptorExceptionHandler.java
=> BalancerDecisionDetails.java} (57%)
create mode 100644
hbase-server/src/main/java/org/apache/hadoop/hbase/namequeues/impl/BalancerDecisionQueueService.java
rename
hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/{ReplicationProtbufUtil.java
=> ReplicationProtobufUtil.java} (99%)
delete mode 100644
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSinkManager.java
create mode 100644
hbase-server/src/test/java/org/apache/hadoop/hbase/TestMovedRegionCache.java
delete mode 100644
hbase-server/src/test/java/org/apache/hadoop/hbase/TestMovedRegionsCleaner.java
create mode 100644
hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestBalancerDecision.java
create mode 100644
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionInfoStaticInitialization.java
create mode 100644
hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestHBaseReplicationEndpoint.java
delete mode 100644
hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSinkManager.java
copy hbase-shell/src/main/ruby/shell/commands/{clear_slowlog_responses.rb =>
get_balancer_decisions.rb} (51%)
