This is an automated email from the ASF dual-hosted git repository. wchevreuil pushed a change to branch HBASE-28463 in repository https://gitbox.apache.org/repos/asf/hbase.git
discard efa1ba3d498 HBASE-29427 Merge all commits related to custom tiering into the feature branch (#7124) omit 09c8e850393 HBASE-28467: Add time-based priority caching checks for cacheOnRead code paths. (#5905) omit 21c12be600c HBASE-28469: Integration of time-based priority caching into compaction paths (#5866) omit 3e2dcfc9f9e HBASE-28535: Add a region-server wide key to enable data-tiering. (#5856) omit c7c1509171f HBASE-28468: Integrate the data-tiering logic into cache evictions. (#5829) omit 2372ffa147e HBASE-28466 Integration of time-based priority logic of bucket cache in prefetch functionality of HBase (#5808) omit 025f685fa6b HBASE-28505 Implement enforcement to require Date Tiered Compaction for Time Range Data Tiering (#5809) omit 27fe734b61b HBASE-28465 Implementation of framework for time-based priority bucket-cache (#5793) add 3500d6f2e17 HBASE-29340 Add rel/2.6.3 to the downloads page (#7154) add c039e446ed7 HBASE-29398: Server side scan metrics for bytes read from FS vs Block cache vs memstore (#7136) add 052d36b0b26 HBASE-29447 Fix WAL archives cause incremental backup failures (#7151) add f7656a92186 HBASE-29452 Fix broken links in the reference guide (#7155) add 8734f703785 HBASE-29450 Bump org.apache.commons:commons-lang3 from 3.17.0 to 3.18.0 (#7152) add dd33e66af23 HBASE-29454: Update hbase-examples scripts to be compatible with Python 3 (#7161) add 5293b92db03 HBASE-28589: ServerCall.setResponse swallows IOException and leaves client without response (#7156) add c496a7a2f29 HBASE-29471 Update downloads.xml for 2.5.12 add f88a1ce5258 HBASE-29472 Fix splitting algorithms of RegionSplitter tool (#7173) add d76bbe21cf0 HBASE-29467 Redundant conditions in CostFunction.scale() method (#7170) add bdefd1e1249 HBASE-29444 Default to JRE default TLS protcol list (#7142) add 8f5803da347 HBASE-29474 RegionSplitter.rollingSplit is broken (#7174) add a699d303288 HBASE-15625 Make minimum free heap memory percentage configurable (#7076) add cc193701c16 HBASE-29482 Bulkload fails with viewfs authentication error (#7181) add daefb0204f4 HBASE-29481 Make TLS protocols and cipher list configurable for HTTPS InfoServer (#7178) add 2f5cf9a3ebc HBASE-29485 Remove CoprocessorService (#7182) add 4a1f2176481 HBASE-29296 Missing critical snapshot expiration checks (#6970) add 7cdfe0fea77 HBASE-29477 Add configuration support for custom OutputCommitter in TableOutputFormat (#7177) add 55cf6e22d6c HBASE-29496 Fix Javadoc typo: 'DsiableTableProcedure' should be 'DisableTableProcedure' (#7190) new 915a5078f8a HBASE-28465 Implementation of framework for time-based priority bucket-cache (#5793) new 75256820381 HBASE-28505 Implement enforcement to require Date Tiered Compaction for Time Range Data Tiering (#5809) new 1289101b735 HBASE-28466 Integration of time-based priority logic of bucket cache in prefetch functionality of HBase (#5808) new fb0c3155ff0 HBASE-28468: Integrate the data-tiering logic into cache evictions. (#5829) new 6ea61440efb HBASE-28535: Add a region-server wide key to enable data-tiering. (#5856) new 21ff19509b3 HBASE-28469: Integration of time-based priority caching into compaction paths (#5866) new dc71f856708 HBASE-28467: Add time-based priority caching checks for cacheOnRead code paths. (#5905) new 98a0296a4e1 HBASE-29427 Merge all commits related to custom tiering into the feature branch (#7124) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (efa1ba3d498) \ N -- N -- N refs/heads/HBASE-28463 (98a0296a4e1) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 8 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .gitignore | 1 + dev-support/blanks-eol-ignore.txt | 2 +- dev-support/blanks-tabs-ignore.txt | 2 +- .../backup/impl/IncrementalTableBackupClient.java | 10 + .../hadoop/hbase/backup/util/RestoreTool.java | 14 + .../hbase/backup/TestBackupRestoreExpiry.java | 232 ++++++ .../hadoop/hbase/master/balancer/CostFunction.java | 4 - .../client/metrics/ServerSideScanMetrics.java | 19 + .../java/org/apache/hadoop/hbase/HConstants.java | 3 +- .../hadoop/hbase/io/crypto/tls/X509Util.java | 19 +- hbase-common/src/main/resources/hbase-default.xml | 9 + .../hadoop/hbase/io/crypto/tls/TestX509Util.java | 11 +- hbase-examples/README.txt | 10 +- .../src/main/python/thrift1/DemoClient.py | 74 +- .../thrift1/demo_hbase_thrift_over_http_tls.py | 49 +- .../main/python/thrift1/gen-py/hbase/__init__.py | 1 - .../thrift1/{gen-py => gen_py}/hbase/Hbase-remote | 0 .../thrift1/{gen-py => gen_py}/hbase/Hbase.py | 0 .../main/python/thrift1/gen_py/hbase/__init__.py | 18 + .../thrift1/{gen-py => gen_py}/hbase/constants.py | 0 .../thrift1/{gen-py => gen_py}/hbase/ttypes.py | 0 .../src/main/python/thrift2/DemoClient.py | 37 +- .../main/python/thrift2/gen-py/hbase/__init__.py | 1 - .../{gen-py => gen_py}/hbase/THBaseService-remote | 0 .../{gen-py => gen_py}/hbase/THBaseService.py | 0 .../main/python/thrift2/gen_py/hbase/__init__.py | 18 + .../thrift2/{gen-py => gen_py}/hbase/constants.py | 0 .../thrift2/{gen-py => gen_py}/hbase/ttypes.py | 0 .../org/apache/hadoop/hbase/http/HttpServer.java | 40 + .../org/apache/hadoop/hbase/http/InfoServer.java | 11 +- .../hadoop/hbase/mapreduce/TableOutputFormat.java | 24 +- .../hadoop/hbase/mapreduce/WALInputFormat.java | 34 +- .../hbase/mapreduce/TestTableOutputFormat.java | 41 + .../hadoop/hbase/mapreduce/TestWALInputFormat.java | 55 +- .../hbase/coprocessor/CoprocessorService.java | 36 - .../hadoop/hbase/io/hfile/CompoundBloomFilter.java | 18 +- .../hadoop/hbase/io/hfile/FixedFileTrailer.java | 10 +- .../apache/hadoop/hbase/io/hfile/HFileBlock.java | 24 +- .../hadoop/hbase/io/hfile/HFileBlockIndex.java | 7 +- .../hadoop/hbase/io/hfile/HFileReaderImpl.java | 130 +-- .../hadoop/hbase/io/hfile/LruBlockCache.java | 5 +- .../hbase/io/hfile/NoOpIndexBlockEncoder.java | 4 +- .../hadoop/hbase/io/util/MemorySizeUtil.java | 91 ++- .../org/apache/hadoop/hbase/ipc/ServerCall.java | 27 + .../hbase/master/assignment/AssignmentManager.java | 2 +- .../hbase/master/procedure/SnapshotProcedure.java | 8 + .../hbase/master/snapshot/TakeSnapshotHandler.java | 10 + .../ThreadLocalServerSideScanMetrics.java | 160 ++++ .../hadoop/hbase/regionserver/HRegionServer.java | 2 +- .../hbase/regionserver/HeapMemoryManager.java | 73 +- .../hbase/regionserver/RegionScannerImpl.java | 27 +- .../hadoop/hbase/regionserver/SegmentScanner.java | 13 + .../hadoop/hbase/regionserver/StoreFileReader.java | 3 +- .../hadoop/hbase/regionserver/StoreFileWriter.java | 4 +- .../hadoop/hbase/regionserver/StoreScanner.java | 38 + .../regionserver/handler/ParallelSeekHandler.java | 36 + .../hadoop/hbase/tool/BulkLoadHFilesTool.java | 4 +- .../apache/hadoop/hbase/util/RegionSplitter.java | 15 +- hbase-server/src/main/python/hbase/merge_conf.py | 2 +- .../client/TestSnapshotWithTTLFromClient.java | 8 +- .../hadoop/hbase/io/hfile/TestBytesReadFromFs.java | 412 ++++++++++ .../apache/hadoop/hbase/io/hfile/TestHFile.java | 85 ++ .../hadoop/hbase/io/util/TestMemorySizeUtil.java | 89 ++ .../apache/hadoop/hbase/ipc/TestServerCall.java | 174 ++++ .../TestSnapshotProcedureEarlyExpiration.java | 102 +++ .../master/snapshot/TestTakeSnapshotHandler.java | 9 + .../TestBytesReadServerSideScanMetrics.java | 896 +++++++++++++++++++++ .../hbase/regionserver/TestDefaultMemStore.java | 44 + .../hadoop/hbase/util/TestRegionSplitter.java | 32 +- pom.xml | 2 +- src/main/asciidoc/_chapters/architecture.adoc | 58 +- src/main/asciidoc/_chapters/case_studies.adoc | 2 +- src/main/asciidoc/_chapters/community.adoc | 2 +- src/main/asciidoc/_chapters/configuration.adoc | 8 +- src/main/asciidoc/_chapters/cp.adoc | 12 +- src/main/asciidoc/_chapters/datamodel.adoc | 32 +- src/main/asciidoc/_chapters/developer.adoc | 4 +- src/main/asciidoc/_chapters/mapreduce.adoc | 77 +- src/main/asciidoc/_chapters/ops_mgt.adoc | 18 +- src/main/asciidoc/_chapters/performance.adoc | 28 +- src/main/asciidoc/_chapters/rpc.adoc | 2 +- src/main/asciidoc/_chapters/schema_design.adoc | 16 +- src/main/asciidoc/_chapters/security.adoc | 68 +- src/main/asciidoc/_chapters/troubleshooting.adoc | 4 +- src/main/asciidoc/_chapters/unit_testing.adoc | 2 +- src/main/asciidoc/_chapters/upgrading.adoc | 6 +- src/main/asciidoc/_chapters/ycsb.adoc | 3 - src/site/asciidoc/acid-semantics.adoc | 2 +- src/site/xdoc/acid-semantics.xml | 2 +- src/site/xdoc/downloads.xml | 40 +- 90 files changed, 3189 insertions(+), 538 deletions(-) create mode 100644 hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestBackupRestoreExpiry.java delete mode 100644 hbase-examples/src/main/python/thrift1/gen-py/hbase/__init__.py rename hbase-examples/src/main/python/thrift1/{gen-py => gen_py}/hbase/Hbase-remote (100%) rename hbase-examples/src/main/python/thrift1/{gen-py => gen_py}/hbase/Hbase.py (100%) create mode 100644 hbase-examples/src/main/python/thrift1/gen_py/hbase/__init__.py rename hbase-examples/src/main/python/thrift1/{gen-py => gen_py}/hbase/constants.py (100%) rename hbase-examples/src/main/python/thrift1/{gen-py => gen_py}/hbase/ttypes.py (100%) delete mode 100644 hbase-examples/src/main/python/thrift2/gen-py/hbase/__init__.py rename hbase-examples/src/main/python/thrift2/{gen-py => gen_py}/hbase/THBaseService-remote (100%) rename hbase-examples/src/main/python/thrift2/{gen-py => gen_py}/hbase/THBaseService.py (100%) create mode 100644 hbase-examples/src/main/python/thrift2/gen_py/hbase/__init__.py rename hbase-examples/src/main/python/thrift2/{gen-py => gen_py}/hbase/constants.py (100%) rename hbase-examples/src/main/python/thrift2/{gen-py => gen_py}/hbase/ttypes.py (100%) delete mode 100644 hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/CoprocessorService.java create mode 100644 hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/ThreadLocalServerSideScanMetrics.java create mode 100644 hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestBytesReadFromFs.java create mode 100644 hbase-server/src/test/java/org/apache/hadoop/hbase/io/util/TestMemorySizeUtil.java create mode 100644 hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestServerCall.java create mode 100644 hbase-server/src/test/java/org/apache/hadoop/hbase/master/procedure/TestSnapshotProcedureEarlyExpiration.java create mode 100644 hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestBytesReadServerSideScanMetrics.java