Caideyipi opened a new pull request, #17940: URL: https://github.com/apache/iotdb/pull/17940
## Description ### Progress coverage Add `ProgressIndex.isEqualOrAfter(...)` and use it for pipe progress coverage checks. Historical TsFile selection now checks whether the start index already covers the resource progress by reusing `updateToMinimumEqualOrIsAfterProgressIndex`, which handles Hybrid/Recover partial-dimension cases consistently. ### Diagnostics Add historical TsFile selection summary counters for progress-uncovered selection, unclosed/closing selection, time/path filtering, covered skips, deleted/generated-by-pipe skips, and pin failures. Shutdown progress persistence now logs pipe/meta counts, meta size, heartbeat timing, and reports clearly when shutdown progress is not confirmed by ConfigNode before the deadline. ### Tests Add Hybrid/Recover coverage cases for historical TsFile selection and realtime TsFile epoch progress checks. Validation: - `.\mvnw.cmd -Ddevelocity.off=true -pl iotdb-core/node-commons,iotdb-core/datanode spotless:apply` - `git diff --check origin/master` Targeted tests were attempted locally, but DataNode test compilation is currently blocked by unrelated existing errors in generated query/parser and queue classes. <hr> This PR has: - [x] been self-reviewed. - [x] added Javadocs for most classes and all non-trivial methods. - [x] added comments explaining the why and the intent of the code wherever would not be obvious for an unfamiliar reader. - [x] added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage. <hr> ##### Key changed/added classes (or packages if there are too many classes) in this PR - `ProgressIndex` - `PipeHistoricalDataRegionTsFileAndDeletionSource` - `PipeTsFileEpochProgressIndexKeeper` - `PipeDataNodeTaskAgent` - `DataNodeShutdownHook` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
