Re: How to visualize the results of Flink processing or aggregation?

2021-03-27 Thread Xiong Qiang
Thank you, @David Anderson and @Fuyao Li. This answered my question and cleared my confusions. On Fri, Mar 26, 2021 at 11:08 AM David Anderson wrote: > Prometheus is a metrics system; you can use Flink's Prometheus metrics > reporter to send metrics to Prometheus. > > Grafana can also be

Re: How to visualize the results of Flink processing or aggregation?

2021-03-26 Thread David Anderson
Prometheus is a metrics system; you can use Flink's Prometheus metrics reporter to send metrics to Prometheus. Grafana can also be connected to influxdb, and to databases like mysql and postgresql, for which sinks are available. And the Elasticsearch sink can be used to create visualizations

Re: [External] : How to visualize the results of Flink processing or aggregation?

2021-03-26 Thread Fuyao Li
Hello Xiong, You can expose monitors through Metric system of Flink. https://ci.apache.org/projects/flink/flink-docs-stable/ops/metrics.html Metrics can be exposed by metric reporter: https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/metric_reporters.html That includes

How to visualize the results of Flink processing or aggregation?

2021-03-26 Thread Xiong Qiang
Hi All, I am new to Flink, so forgive me if it is a naive question. The context is: We have a data streaming coming in, and we will use Flink applications to do the processing or aggregations. After the processing or aggregation, we need some approaches to visualize the results, to either build