RickyHuo commented on issue #3431:
URL:
https://github.com/apache/incubator-seatunnel/issues/3431#issuecomment-1333284636
## Overall Design
### Metircs
#### Format for metric
seatunnel.{metricLayer}.{metricName}.{metricType}
#### Metric types
Detail of metric types refer
https://metrics.dropwizard.io/4.2.0/getting-started.html#
##### Gauge
A gauge is an instantaneous measurement of a value
##### Counter
A counter is just a gauge for an AtomicLong instance. You can increment or
decrement its value.
##### Histogram
A histogram measures the statistical distribution of values in a stream of
data. In addition to minimum, maximum, mean, etc., it also measures median,
75th, 90th, 95th, 98th, 99th, and 99.9th percentiles.
#### Layer of Metric
##### Engine
Provide internal indicators of the engine, describe the overall operation of
the engine, and mainly serve ST-Engine.
eg:
seatunnel.st-engine.inflow.Counter
seatunnel.st-engine.outflow.Counter
seatunnel.st-engine.memoryUsage.Guage
##### Connector
Collect metrics for specific connectors, each connector collects metrics
differently
eg:
seatunnel.connector.source.kafka.offset.partition10.Guage
seatunnel.connector.source.http.reqTime.Histogram
##### Customize
Collect user-defined indicators and will provide interfaces to define
indicators myself.
### Reporter
This module is responsible for outputting the collected indicators to
external systems
ConsoleReport: Report to console.
SparkReport: Output to SparkMetrics system for viewing in Spark UI
FlinkReport: Output to FlinkMetrics system for viewing in Flink UI
etc...
## Architecture
<img width="837" alt="image"
src="https://user-images.githubusercontent.com/18550072/204983556-bc2ec82b-9f96-4324-aa9a-959cf8cafb06.png";>
## Implementation
The metrics system is based on [Dropwizard
Metrics](https://github.com/dropwizard/metrics).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
![https://user-images.githubusercontent.com/18550072/204983556-bc2ec82b-9f96-4324-aa9a-959cf8cafb06.png"](https://user-images.githubusercontent.com/18550072/204983556-bc2ec82b-9f96-4324-aa9a-959cf8cafb06.png"){kind=link}