Hello,
the Metric System
<https://ci.apache.org/projects/flink/flink-docs-release-1.4/monitoring/metrics.html>
should be exactly what you're looking for.
On 15.11.2017 03:55, Nomchin Banga wrote:
Hi
We are a group of graduate students from Purdue University who are
doing an experimental study to compare different data ingestion engines.
For this purpose, we are trying to collect statistics of running jobs
over a few days. However, Flinkās UI captures the statistics for the
last 5 minutes.
We tried to hit the Rest API but that does not contain the data of
statistics other than bytes read/written.
It would be very helpful if you could guide us regarding a way in
which we can capture the entire history of metrics.
Looking forward to hearing from you
Regards
Nomchin Banga