danny0405 commented on PR #9118: URL: https://github.com/apache/hudi/pull/9118#issuecomment-1644912724
> > I kind of think 2 kinds of metrics are more important than the write metrics: > > > > 1. the streaming reader latest instant and max completion time; > > 2. the compaction progress, that is the total pending compaction plans and the current compaction instant > > @danny0405 Hi Danny, thanks for your review! I will update the write metrics document ASAP. And I'd like to add some metrics to indicate the current progress of compaction like all pending log files count & size, compaction IO, compaction execution time, etc. However, I'm not very familiar with Flink stream read path, we could finish that part in the future iteration. In `StreamReadMonitoringFunction` we will bookkeep the latest consumed instant for each round of read, it can be defined as a metric. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
