dybyte opened a new pull request, #11104:
URL: https://github.com/apache/seatunnel/pull/11104
### Purpose of this pull request
This pull request adds lightweight observability exports for
`ReportMetricsOperation` in Zeta workers.
`TaskExecutionService#updateMetricsContextInImap()` periodically reports
local task metrics to the master and also reports them again when a task group
completes. Under high-frequency job submission or many small batch jobs, this
path can create control-plane pressure, but it is currently hard to observe
directly.
This PR adds Prometheus exports for:
- `report_metrics_operation_total{address, result}`
- `report_metrics_operation_last_payload_task_count{address}`
- `report_metrics_operation_last_invocation_latency_ms{address}`
- `report_metrics_operation_max_invocation_latency_ms{address}`
### Does this PR introduce _any_ user-facing change?
Yes.
This PR adds new Prometheus telemetry metrics and updates the Zeta telemetry
documentation in both English and Chinese. It does not change runtime behavior
of jobs, but users monitoring the metrics endpoint will see new exported
metrics compared with current released and unreleased branches.
### How was this patch tested?
- Added collector-level tests for `ReportMetricsOperationExports`
- returns empty when `TaskExecutionService` is unavailable
- exports metric families when stats are available
- verifies `result` labels and exported sample values
- Ran:
- `./mvnw -pl seatunnel-engine/seatunnel-engine-server spotless:apply`
- `./mvnw -pl seatunnel-engine/seatunnel-engine-server -DskipTests verify`
### Check list
* [ ] If any new Jar binary package adding in your PR, please add License
Notice according
[New License
Guide](https://github.com/apache/seatunnel/blob/dev/docs/en/developer/new-license.md)
* [x] If necessary, please update the documentation to describe the new
feature. https://github.com/apache/seatunnel/tree/dev/docs
* [ ] If necessary, please update `incompatible-changes.md` to describe the
incompatibility caused by this PR.
* [ ] If you are contributing the connector code, please check that the
following files are updated:
1. Update
[plugin-mapping.properties](https://github.com/apache/seatunnel/blob/dev/plugin-mapping.properties)
and add new connector information in it
2. Update the pom file of
[seatunnel-dist](https://github.com/apache/seatunnel/blob/dev/seatunnel-dist/pom.xml)
3. Add ci label in
[label-scope-conf](https://github.com/apache/seatunnel/blob/dev/.github/workflows/labeler/label-scope-conf.yml)
4. Add e2e testcase in
[seatunnel-e2e](https://github.com/apache/seatunnel/tree/dev/seatunnel-connector-v2-e2e/)
5. Update connector
[plugin_config](https://github.com/apache/seatunnel/blob/dev/config/plugin_config)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
