abhijeets25012-tech opened a new pull request, #61044:
URL: https://github.com/apache/airflow/pull/61044
This change adds support for deploying separate DAG Processor pods per DAG
bundle in the Airflow Helm chart.
- Introduces `deployPerBundle` configuration under `dagProcessor` in
`values.yaml`.
- Allows independent scaling, resource allocation, and failure isolation per
DAG bundle.
- Uses existing `--bundle-name` option in Airflow core.
- Backward compatible: single deployment is used if
`deployPerBundle.enabled` is false.
- Supports bundle-specific overrides for replicas and resources.
Example configuration:
dagProcessor:
deployPerBundle:
enabled: true
args: ["bash", "-c", "exec airflow dag-processor --bundle-name {{
bundleName }}"]
bundleOverrides:
dags-folder:
replicas: 2
resources:
requests:
memory: "2Gi"
cpu: "1000m"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
