MiteshSahu opened a new pull request, #61859: URL: https://github.com/apache/airflow/pull/61859
## Description Add minute-level log retention support for log groomer sidecar containers to enable sub-day log rotation in remote logging scenarios (e.g., OpenTelemetry FileLog Receiver). **Changes:** - Add `AIRFLOW__LOG_RETENTION_MINUTES` environment variable (takes precedence over `AIRFLOW__LOG_RETENTION_DAYS`) - Add Helm chart `logGroomerSidecar.retentionMinutes` configuration option for all deployment types (workers, scheduler, triggerer, dag-processor) - Update log cleanup script to use `find -mmin` when minutes are configured, fallback to `-mtime` (days) otherwise - Add unit and Helm integration tests for new functionality - Backward compatible: defaults to days-based retention when minutes not specified ## Type of change - [x] New feature - [ ] Bug fix - [ ] Documentation update - [ ] Breaking change ## Testing - Added parameterized unit tests in `airflow-core/tests/unit/charts/log_groomer.py` - Added Helm integration tests in `helm-tests/tests/chart_utils/log_groomer.py` - Verified prek static code checks pass (RST, YAML, license headers) - Local validation: Helm template rendering and cleanup script logic confirmed ## Related Issue Closes #61814 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
