songzhendong opened a new pull request, #13891:
URL: https://github.com/apache/skywalking/pull/13891
### Add Apache Airflow monitoring via native OpenTelemetry metrics (SWIP-7)
- [x] If this is non-trivial feature, paste the links/URLs to the design doc.
- SWIP-7:
https://github.com/apache/skywalking/blob/master/docs/en/swip/SWIP-7.md
(included in this PR)
- [x] Update the documentation to include this new feature.
- `docs/en/setup/backend/backend-airflow-monitoring.md`,
`docs/en/swip/SWIP-7.md`, hierarchy docs
- [x] Tests(including UT, IT, E2E) are added to verify the new feature.
- MAL data tests (`airflow-service` / `airflow-instance`)
- Mock OTLP e2e: 30 checks (`test/e2e-v2/cases/airflow/e2e.yaml`)
- Real Celery cluster e2e: 26 checks
(`test/e2e-v2/cases/airflow/e2e-cluster.yaml`)
- [ ] If it's UI related, attach the screenshots below.
- Horizon UI dashboards ship separately in `apache/skywalking-horizon-ui`
(Workflow Scheduler / Airflow layer)
- [ ] If this pull request closes/resolves/fixes an existing issue, replace
the issue number. Closes #<issue number>.
- [x] Update the [\CHANGES\
log](https://github.com/apache/skywalking/blob/master/docs/en/changes/changes.md).
## Summary
- New \AIRFLOW\ layer with Service (cluster) and Instance (host) dimensions
- MAL rules under \otel-rules/airflow/\ for Airflow native OTel metrics
- \hierarchy-definition.yml\ links \AIRFLOW\ to \K8S_SERVICE\`n- CI:
\Airflow\ + \Airflow Cluster\ jobs in \.github/workflows/skywalking.yaml\`n
## Test plan
- [x] \./mvnw checkstyle:check\`n- [x] Local mock e2e (30/30)
- [x] Local cluster e2e (26/26)
- [ ] CI \Airflow\ + \Airflow Cluster\ matrix jobs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
