HTHou opened a new pull request, #18999:
URL: https://github.com/apache/iotdb/pull/18999

   ## Description
   
   Upgrade TsFile to `2.5.1-261023-SNAPSHOT` and adapt the storage/query 
integration to its file-scoped encryption contexts. This PR adds reusable 
integration points only; it does not add a crypto implementation, wallet, key 
manager, WAL encryption, or a new user configuration option.
   
   ### Reader APIs and Resource Ownership
   
   - Use the reader-reported data start offset and pass chunk ordinals/page 
indexes to page deserialization in query, Pipe, Load, repair, and split paths.
   - Retain file-scoped contexts for lazy pages until their last page is 
consumed, or until query/iterator cleanup. Only page-AEAD chunks enter the 
query ownership registry; ordinary chunks are not strongly tracked.
   - Release cached chunks on eviction, retain returned chunk contexts 
independently, and handle eviction racing with a cache hit.
   - Close partially constructed aligned readers and Pipe iterators on errors 
and early termination.
   
   ### Per-File Writing and Rewrite Policy
   
   - Add the optional `FileEncryptionParameterProvider` SPI. The default uses 
the existing legacy parameters unchanged. No production provider is bundled. 
Ambiguous providers and a custom provider returning null fail explicitly.
   - Create fresh file parameters through shared writer factories and propagate 
the writer's context to memtable/chunk writers, including target-file switches 
during cross compaction.
   - Provide a rewrite-policy hook for compaction and Load. Policies requiring 
new file contexts use the existing read-point/tablet write pipelines instead of 
copying source ciphertext or staging plain chunks. Source deletion remains the 
Load scheduler's responsibility.
   - Preserve existing plain/legacy behavior when no custom policy is 
installed. The test provider is framing-only and lives entirely in test sources.
   
   ### Verification
   
   - Targeted DataNode tests: **110 tests, 0 failures, 0 errors, 3 skipped**. 
Covers file-context lifecycle, aligned/non-aligned lazy readers, cache 
eviction, plain files, memtables/flush, Load/splitting, Pipe, and 
representative read-point/read-chunk/fast compaction cases.
   - Full-reactor English and Chinese test-source compilation, including the 
integration-test module.
   - Spotless and `git diff --check`.
   
   No running-cluster integration test was executed for this PR.
   
   <hr>
   
   This PR has:
   - [x] been self-reviewed, including cache eviction/read ownership.
   - [x] added Javadocs for the new provider contract and resource ownership.
   - [x] updated the TsFile dependency version.
   - [x] added unit tests and exercised existing regression tests.
   - [ ] been tested in a test IoTDB cluster.
   
   ##### Key Changed/Added Classes
   
   `FileEncryptionParameterProvider`, `EncryptDBUtils`, `QueryChunkReaders`, 
`ChunkCache`, `DiskChunkLoader`, `DiskAlignedChunkLoader`, 
`CompactionTsFileWriter`, `AbstractCompactionWriter`, 
`TabletRewriteLoadStrategy`, and TsFile-based Pipe/Load readers.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to