HTHou opened a new pull request, #18999: URL: https://github.com/apache/iotdb/pull/18999
## Description Upgrade TsFile to `2.5.1-261023-SNAPSHOT` and adapt the storage/query integration to its file-scoped encryption contexts. This PR adds reusable integration points only; it does not add a crypto implementation, wallet, key manager, WAL encryption, or a new user configuration option. ### Reader APIs and Resource Ownership - Use the reader-reported data start offset and pass chunk ordinals/page indexes to page deserialization in query, Pipe, Load, repair, and split paths. - Retain file-scoped contexts for lazy pages until their last page is consumed, or until query/iterator cleanup. Only page-AEAD chunks enter the query ownership registry; ordinary chunks are not strongly tracked. - Release cached chunks on eviction, retain returned chunk contexts independently, and handle eviction racing with a cache hit. - Close partially constructed aligned readers and Pipe iterators on errors and early termination. ### Per-File Writing and Rewrite Policy - Add the optional `FileEncryptionParameterProvider` SPI. The default uses the existing legacy parameters unchanged. No production provider is bundled. Ambiguous providers and a custom provider returning null fail explicitly. - Create fresh file parameters through shared writer factories and propagate the writer's context to memtable/chunk writers, including target-file switches during cross compaction. - Provide a rewrite-policy hook for compaction and Load. Policies requiring new file contexts use the existing read-point/tablet write pipelines instead of copying source ciphertext or staging plain chunks. Source deletion remains the Load scheduler's responsibility. - Preserve existing plain/legacy behavior when no custom policy is installed. The test provider is framing-only and lives entirely in test sources. ### Verification - Targeted DataNode tests: **110 tests, 0 failures, 0 errors, 3 skipped**. Covers file-context lifecycle, aligned/non-aligned lazy readers, cache eviction, plain files, memtables/flush, Load/splitting, Pipe, and representative read-point/read-chunk/fast compaction cases. - Full-reactor English and Chinese test-source compilation, including the integration-test module. - Spotless and `git diff --check`. No running-cluster integration test was executed for this PR. <hr> This PR has: - [x] been self-reviewed, including cache eviction/read ownership. - [x] added Javadocs for the new provider contract and resource ownership. - [x] updated the TsFile dependency version. - [x] added unit tests and exercised existing regression tests. - [ ] been tested in a test IoTDB cluster. ##### Key Changed/Added Classes `FileEncryptionParameterProvider`, `EncryptDBUtils`, `QueryChunkReaders`, `ChunkCache`, `DiskChunkLoader`, `DiskAlignedChunkLoader`, `CompactionTsFileWriter`, `AbstractCompactionWriter`, `TabletRewriteLoadStrategy`, and TsFile-based Pipe/Load readers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
