This is an automated email from the ASF dual-hosted git repository.
zhangduo pushed a change to branch HBASE-27109/table_based_rqs
in repository https://gitbox.apache.org/repos/asf/hbase.git
discard ba5488be198 HBASE-27623 Start a new ReplicationSyncUp after the
previous failed (#5150)
omit 49589ef2853 HBASE-27216 Revisit the ReplicationSyncUp tool (#4966)
omit b59ec9baf7c HBASE-27430 Should disable replication log cleaner when
migrating replication queue data (#4901)
omit f1d491205ce HBASE-27429 Add exponential retry backoff support for
MigrateReplicationQueueFromZkToTableProcedure
omit 96f15b3d2d3 HBASE-27217 Revisit the DumpReplicationQueues tool (#4810)
omit 1158247dbbf HBASE-27218 Support rolling upgrading (#4808)
omit 26d6ba2d0ad HBASE-27405 Fix the replication hfile/log cleaner report
that the replication table does not exist (#4811)
omit 31c8f8c40b0 HBASE-27392 Add a new procedure type for implementing some
global operations such as migration (#4803)
omit d24e7cf39f9 HBASE-27215 Add support for sync replication (#4762)
omit a7345b0e301 HBASE-27214 Implement the new replication hfile/log
cleaner (#4722)
omit a38d5744845 HBASE-27213 Add support for claim queue operation (#4708)
omit a878920ad10 HBASE-27212 Implement a new table based replication queue
storage and make the minimum replication system work (#4672)
add 3c2c6858927 HBASE-27729. Missed one parameter when logging exception
in StoreFileListFile. (#5114)
add e6977a95975 HBASE-27718 The regionStateNode only need remove once in
regionOffline (#5106)
add 997d1326013 HBASE-27702 Remove 'hbase.regionserver.hlog.writer.impl'
config (#5096)
add 201846b7264 HBASE-27646 Should not use pread when prefetching in
HFilePreadReader (#5063)
add 0110bf3a6e6 HBASE-27722 Update documentation about how to enable
encryption on WAL (#5120)
add 814f3267d71 HBASE-27651 hbase-daemon.sh foreground_start should
propagate SIGHUP and SIGTERM
add 52e69daaeab HBASE-27737 Add supplemental model for
com.aayushatharva.brotli4j:native-osx-aarch64
add dd3b1630e84 HBASE-27736 HFileSystem.getLocalFs is not used (#5125)
add e6af6e0be9b HBASE-27731 Upgrade commons-validator to 1.7 (#5116)
add 7d6a79b768e HBASE-27676 Scan handlers in the RPC executor should match
at least one scan queues (#5074)
add 18ba51afcb5 HBASE-27745 Document protoc workarounds with Apple Silicon
(#5139)
add 3e08f9230c1 HBASE-27744 Update compression dependencies (#5137)
add 230fdc0b505 HBASE-27732 NPE in
TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119)
add 6cc61826462 Bump jettison from 1.5.2 to 1.5.4 (#5136)
add de91a8d83a9 Revert "Bump jettison from 1.5.2 to 1.5.4 (#5136)"
add 735fb433887 HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136)
add a6dad700dbd HBASE-27750: Update the list of prefetched Hfiles upon
block eviction (#5140)
add c825c960d6b HBASE-27532 Add block bytes scanned metrics (#5067)
add f5437b9cebf HBASE-27333 Abort RS when the hostname is different from
master seen (#4732)
add efb360d33f6 HBASE-27726 Handling of ruby shell SyntaxError exceptions
(#5147)
add c52f4b286cb HBASE-27704 Quotas can drastically overflow configured
limit (#5099)
add e5620e26a27 HBASE-27756 Make request guardrail configs in
RSRpcServices live updatable (#5141)
add 143e9b4ff6a HBASE-27758 Inconsistent synchronization in
MetricsUserSourceImpl (#5149)
add 308cdb08c7f HBASE-27774 Move Dockerfile and python-requirements.txt
used only by flaky-tests job
add a363b76d815 HBASE-27765 Add biggest cell related info into web ui
(#5151)
add f27823e62dd HBASE-27662 Correct the line logged with flag
hbase.procedure.upgrade-to-2-2 in docs (#5159)
new 662d862321f HBASE-27212 Implement a new table based replication queue
storage and make the minimum replication system work (#4672)
new 902ea71b638 HBASE-27213 Add support for claim queue operation (#4708)
new 28318460dab HBASE-27214 Implement the new replication hfile/log
cleaner (#4722)
new 103fe92273a HBASE-27215 Add support for sync replication (#4762)
new ef09ba6d3ea HBASE-27392 Add a new procedure type for implementing some
global operations such as migration (#4803)
new 3a6451ea813 HBASE-27405 Fix the replication hfile/log cleaner report
that the replication table does not exist (#4811)
new c72bdbbab64 HBASE-27218 Support rolling upgrading (#4808)
new 45c1aa1c28d HBASE-27217 Revisit the DumpReplicationQueues tool (#4810)
new 56e6ef4229b HBASE-27429 Add exponential retry backoff support for
MigrateReplicationQueueFromZkToTableProcedure
new f55419a04b7 HBASE-27430 Should disable replication log cleaner when
migrating replication queue data (#4901)
new 851f18639cc HBASE-27216 Revisit the ReplicationSyncUp tool (#4966)
new f78fe5994af HBASE-27623 Start a new ReplicationSyncUp after the
previous failed (#5150)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ba5488be198)
\
N -- N -- N refs/heads/HBASE-27109/table_based_rqs (f78fe5994af)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 12 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
bin/hbase-daemon.sh | 40 ++--
dev-support/{ => flaky-tests}/Dockerfile | 4 +-
.../flaky-tests/flaky-reporting.Jenkinsfile | 2 +-
.../{ => flaky-tests}/python-requirements.txt | 0
.../client/metrics/ServerSideScanMetrics.java | 6 +
hbase-common/src/main/resources/hbase-default.xml | 10 -
.../regionserver/MetricsRegionServerSource.java | 41 ++--
.../MetricsRegionServerSourceImpl.java | 57 +++--
.../hbase/regionserver/MetricsUserSource.java | 10 +-
.../hbase/regionserver/MetricsUserSourceImpl.java | 65 +++---
.../hbase/IntegrationTestIngestWithEncryption.java | 4 -
.../replication/ReplicationStorageFactory.java | 2 +-
.../src/main/resources/supplemental-models.xml | 26 +++
.../hbase/tmpl/regionserver/RegionListTmpl.jamon | 20 ++
.../org/apache/hadoop/hbase/fs/HFileSystem.java | 7 -
.../hadoop/hbase/io/FSDataInputStreamWrapper.java | 9 +
.../java/org/apache/hadoop/hbase/io/FileLink.java | 6 +-
.../apache/hadoop/hbase/io/hfile/HFileInfo.java | 19 ++
.../hadoop/hbase/io/hfile/HFilePreadReader.java | 20 +-
.../hadoop/hbase/io/hfile/HFileWriterImpl.java | 22 +-
.../hbase/io/hfile/ReaderContextBuilder.java | 12 ++
.../hadoop/hbase/io/hfile/bucket/BucketCache.java | 4 +
.../hadoop/hbase/ipc/RWQueueRpcExecutor.java | 8 +-
.../apache/hadoop/hbase/ipc/RpcCallContext.java | 13 +-
.../org/apache/hadoop/hbase/ipc/RpcServer.java | 2 +-
.../org/apache/hadoop/hbase/ipc/ServerCall.java | 4 +-
.../hbase/master/assignment/AssignmentManager.java | 2 -
.../hbase/master/assignment/RegionStates.java | 5 -
.../hbase/quotas/FixedIntervalRateLimiter.java | 18 +-
.../apache/hadoop/hbase/quotas/RateLimiter.java | 7 +-
.../hadoop/hbase/regionserver/HRegionServer.java | 31 ++-
.../hbase/regionserver/MetricsRegionServer.java | 53 +++--
.../hbase/regionserver/MetricsUserAggregate.java | 11 +-
.../regionserver/MetricsUserAggregateFactory.java | 13 +-
.../regionserver/MetricsUserAggregateImpl.java | 25 ++-
.../hadoop/hbase/regionserver/RSRpcServices.java | 104 +++++----
.../hadoop/hbase/regionserver/StoreScanner.java | 2 +-
.../regionserver/metrics/MetricsTableRequests.java | 84 +++++---
.../storefiletracker/StoreFileListFile.java | 3 +-
.../hbase/regionserver/wal/AbstractFSWAL.java | 65 +++++-
.../wal/AbstractProtobufLogWriter.java | 117 +++++------
.../wal/AbstractProtobufWALReader.java | 7 +-
.../hadoop/hbase/regionserver/wal/AsyncFSWAL.java | 50 +++--
.../regionserver/wal/AsyncProtobufLogWriter.java | 9 -
.../hadoop/hbase/regionserver/wal/FSHLog.java | 32 ++-
.../wal/SecureAsyncProtobufLogWriter.java | 65 ------
.../regionserver/wal/SecureProtobufLogWriter.java | 48 -----
.../hadoop/hbase/wal/AbstractFSWALProvider.java | 10 +-
.../hadoop/hbase/wal/AsyncFSWALProvider.java | 2 +-
.../apache/hadoop/hbase/wal/FSHLogProvider.java | 4 +-
.../hbase-webapps/regionserver/region.jsp | 4 +
.../org/apache/hadoop/hbase/client/TestAdmin2.java | 8 +-
.../hbase/client/TestAsyncClusterAdminApi.java | 8 +-
.../apache/hadoop/hbase/io/hfile/TestPrefetch.java | 58 +++++
.../hadoop/hbase/io/hfile/TestPrefetchRSClose.java | 2 +-
.../io/hfile/bucket/TestBucketCachePersister.java | 22 +-
.../hbase/namequeues/TestNamedQueueRecorder.java | 4 +-
.../store/region/TestRegionProcedureStore.java | 4 +-
.../hadoop/hbase/quotas/TestRateLimiter.java | 38 ++--
.../regionserver/TestMetricsRegionServer.java | 19 +-
.../regionserver/TestMetricsTableRequests.java | 10 +-
.../regionserver/TestMetricsUserAggregate.java | 31 ++-
.../regionserver/TestPerColumnFamilyFlush.java | 7 +-
.../regionserver/TestRpcSchedulerFactory.java | 12 ++
.../regionserver/TestScannerBlockSizeLimits.java | 44 ++--
.../hbase/regionserver/wal/AbstractTestFSWAL.java | 199 +++++++++---------
.../regionserver/wal/AbstractTestLogRolling.java | 36 ++--
.../regionserver/wal/InstrumentedLogWriter.java | 5 -
.../regionserver/wal/TestLogRollingNoCluster.java | 3 +-
.../regionserver/wal/TestSecureAsyncWALReplay.java | 3 -
.../regionserver/wal/TestSecureWALReplay.java | 3 -
.../apache/hadoop/hbase/wal/IOTestProvider.java | 5 -
.../hadoop/hbase/wal/TestFSHLogProvider.java | 233 +++++++++++----------
.../org/apache/hadoop/hbase/wal/TestSecureWAL.java | 6 -
.../org/apache/hadoop/hbase/wal/TestWALSplit.java | 3 +-
.../hadoop/hbase/wal/WALPerformanceEvaluation.java | 4 -
hbase-shell/src/main/ruby/irb/hirb.rb | 2 +
pom.xml | 12 +-
src/main/asciidoc/_chapters/developer.adoc | 88 +++-----
src/main/asciidoc/_chapters/hbase-default.adoc | 19 --
src/main/asciidoc/_chapters/security.adoc | 4 +
src/main/asciidoc/_chapters/upgrading.adoc | 8 +-
82 files changed, 1179 insertions(+), 905 deletions(-)
rename dev-support/{ => flaky-tests}/Dockerfile (88%)
rename dev-support/{ => flaky-tests}/python-requirements.txt (100%)
delete mode 100644
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/SecureAsyncProtobufLogWriter.java
delete mode 100644
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/SecureProtobufLogWriter.java
