[
https://issues.apache.org/jira/browse/FLINK-16588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Yao closed FLINK-16588.
----------------------------
Resolution: Won't Do
I would say that AWS Fargate is a niche platform to run Apache Flink
considering that Fargate only allows 10 GB of storage in the Docker writable
layer at the moment. I don't think we should add a new metric to Apache Flink
because free disk space should be monitored externally for the reasons
mentioned in my first comment. I am afraid that at the moment you are left with
forking Apache Flink to add a custom metric, building your own docker image, or
push this information from within your Flink job (e.g., to CloudWatch).
I am closing this ticket now but feel free to re-open if you think otherwise.
> Add Disk Space metrics to TaskManagers
> --------------------------------------
>
> Key: FLINK-16588
> URL: https://issues.apache.org/jira/browse/FLINK-16588
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Metrics
> Affects Versions: 1.10.0
> Reporter: Thomas Wozniakowski
> Priority: Minor
>
> Hi,
> We have recently switched to the RocksDB state backend. We are scraping
> Taskmanager metrics from the REST endpoints to watch for memory and CPU
> issues, but we currently have no good way to get the remaining disk space, so
> we have no way of knowing when RocksDB is going to run out of space for state
> storage.
> How plausible is it to add something like a {{State.FreeStorageBytes}} metric
> or something similar to the standard TaskManager metrics set?
> Thanks,
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
