slfan1989 opened a new pull request, #13831: URL: https://github.com/apache/iceberg/pull/13831
## Summary: This pull request enhances the DeleteFilesProcessor by adding time metrics for file deletion operations. Additionally, the unit tests for DeleteFilesProcessor are extended with several edge cases and failure scenarios, ensuring the processor works correctly under various conditions, including file deletion failures, large files, batch deletions, and concurrent deletions. ## Main Changes: ### Added Time Metrics: Introduced time metrics to DeleteFilesProcessor to track the time taken for each file deletion operation, helping monitor the performance of delete operations. The Histogram is used to measure and log the time taken for file deletion operations, providing detailed performance data. ### Extended Unit Tests: - Delete Non-Existent File: Tests the scenario where a file does not exist, ensuring the system handles this case without throwing exceptions. - Delete Large File: Simulates the deletion of a large file, ensuring the processor can handle large file deletions correctly and performs well. - Batch Delete Boundary Test: Tests batch file deletion to ensure files are deleted in batches once the batch size is reached. - Concurrent Delete: Simulates concurrent file deletions, ensuring stability when handling concurrent delete operations. - Delete With Failure: Simulates file deletion failures, ensuring the processor can handle failures and correctly record the number of failed deletions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
