Hi,

We recently switched to the flink-s3-fs-presto library for checkpointing in
Flink 1.16.0 and we would like to get client-side metrics from the Presto
S3 client (request rate, throttling rate, etc).

I can see that the upstream client from Presto 0.272 already comes with a
metric collector (PrestoS3FileSystemMetricCollector.java
<https://github.com/prestodb/presto/blob/0.272/presto-hive/src/main/java/com/facebook/presto/hive/s3/PrestoS3FileSystemMetricCollector.java>)
that records all sorts of interesting metrics in a PrestoS3FileSystemStats
<https://github.com/prestodb/presto/blob/0.272/presto-hive/src/main/java/com/facebook/presto/hive/s3/PrestoS3FileSystemStats.java>
 object.

If I understand correctly, in the Presto project those metrics are being
exposed via JMX in the HiveS3Module class here
<https://github.com/prestodb/presto/blob/d93d0d8b22756d85cfe3e5c62c7718d8f29dbe54/presto-hive/src/main/java/com/facebook/presto/hive/s3/HiveS3Module.java#L48-L49>
but
we don't use this class to instantiate the client in flink-s3-fs-presto.

Has anyone managed to actually expose those metrics from a Flink
application? If not, what would be recommended way of doing it?

Thank you!

Reply via email to