GitHub user aayostem added a comment to the discussion: Airflow Statsd Exporter
Missing Metrics
The missing metrics you're experiencing are due to
- Airflow's metrics configuration
- StatsD exporter setup
The missing metrics (`airflow_ti_failures`, `airflow_operator_successes`) are
task-level metrics that require specific configuration to be emitted to StatsD.
what you can do it to enable Task-Level Metrics in Airflow Config
Update your Helm `values.yaml` to enable comprehensive metrics collection:
```yaml
# values.yaml
config:
metrics:
# Enable task and operator level metrics
statsd_on: true
statsd_host: statsd-exporter
statsd_port: 9125
statsd_prefix: airflow
# Enable detailed task metrics
statsd_statsd_enabled: true
# Additional metrics configuration
statsd_custom_client_path: airflow.statsd.StatsdClient
# Ensure statsd exporter is properly configured
statsd:
enabled: true
service:
port: 9125
targetPort: 9125
config:
# StatsD mapping configuration
mapping: |
# Airflow metrics mapping
airflow.*.*:
name: "airflow_${1}_${2}"
labels:
component: "${1}"
metric_type: "${2}"
```
GitHub link:
https://github.com/apache/airflow/discussions/58261#discussioncomment-14967089
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
