Hi Team,

I am interested in adding metrics support to HoodieWrapperFileSystem. This
will help track the counts of operations and their latencies and will
provide valuable data to implement and test newer ideas (e.g. RFC 15
<https://cwiki.apache.org/confluence/display/HUDI/RFC+-+15:+HUDI+File+Listing+and+Query+Planning+Improvements>which
is
proposing a consolidated metadata reducing the number of file system
operations).

HUDI metrics are currently implemented in module hudi-client. Modules like
hudi-utilities have hudi-client as their dependency (via pom.xml). But this
cannot be done for hudi-common as this module is itself a dependency for
hudi-client.

Hence, I feel it may be better to move the HUID metrics code to hudi-common
as most modules anyways depend on hudi-common.

What do you think about this? Any other ideas of how to approach this?

Thanks
Prashant

Reply via email to