THUMarkLau opened a new pull request, #10247: URL: https://github.com/apache/iotdb/pull/10247
In the existing Compaction Read-Write metrics, metrics are obtained by recording I/O data through the associated interfaces within the compaction code, after reading or writing a chunk. This process necessitates the inclusion of such monitoring code in all possible I/O operations involved in compaction, which can easily lead to oversight and consequently, inaccuracies in the metrics. This Pull Request establishes compaction-specific writer and reader mechanisms based on TsFileIOWriter and TsFileSequenceReader. These mechanisms automatically quantify I/O data volume before and after the activation of compaction I/O interfaces. Not only does this approach record the data in the metrics system, but it also controls resource utilization during compaction through RateLimiter regulation. Moreover, this PR provides a comprehensive categorization of I/O data, including aligned data, non-aligned data, and metadata. For each type of compaction task, the I/O status of these three types of da ta is logged individually.  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
