GitHub user 62garzon added a comment to the discussion: Large number of
Transactions for the logs when using WASB
To avoid the millions of transactions and their cost, we:
- Created a lifecyle policy in Azure to delete the logs after X days (it´s
executed only once per day)
- Disabled the logGroomerSidecar in all services.
```
logs:
persistence:
enabled: true
existingClaim: pvc-airflow-logs
storageClassName: azureblob-fuse-premium
triggerer:
logGroomerSidecar:
enabled: false
scheduler:
logGroomerSidecar:
enabled: false
workers:
logGroomerSidecar:
enabled: false
dagProcessor:
logGroomerSidecar:
enabled: false
```
GitHub link:
https://github.com/apache/airflow/discussions/34973#discussioncomment-15846569
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
